2024-09-12T00:04:29.311 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:04:29.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:04:29.450 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841 branch: wip-cls-rgw-busy-resharding description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7901841' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkkyWqoalOWylThQpcLsiDtN0k2PMf1TSBFuwhlgjMt7bRFyfxREWqca5mENugIIfcBXzU0aHUgQLqEP2HOdaw= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCJjTX7cZZaa/Y3AXuEYh6IJaPfzSflTD8tryXHJCU7YSrfhX/glf11AzNi/hljTSputwEDIJB6O3wp252riImc= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:04:29.450 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:04:29.451 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:04:29.451 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:04:29.453 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:04:29.475 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:04:29.475 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:04:29.475 INFO:teuthology.packaging:ref: None 2024-09-12T00:04:29.475 INFO:teuthology.packaging:tag: None 2024-09-12T00:04:29.475 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:04:29.476 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:04:29.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:04:29.627 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:04:29.629 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:04:29.667 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:04:29.667 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:04:29.674 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:04:29.685 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:04:29.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:04:29.736 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:57:26.379833', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN9m9mEsi7P+N1aTPxkM3stD7j+DBCHDlHw4ioAtQm8p'} 2024-09-12T00:04:29.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:57:26.381497', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGyL0OorVbA/HSr9k8M/FVQXymn/FFJHl4gUUPQyNPb3'} 2024-09-12T00:04:29.770 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:04:29.775 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-12T00:04:29.775 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-12T00:04:29.775 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:04:29.855 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd711fffbe0>, signals=[15]) 2024-09-12T00:04:29.855 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:04:29.864 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:04:29.864 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-09-12T00:04:29.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:29.958 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:04:29.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:30.052 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:04:30.103 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-09-12T00:04:30.108 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-09-12T00:04:30.109 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-09-12T00:04:30.154 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:04:30.155 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:04:30.156 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-09-12T00:04:30.322 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-12T00:04:30.328 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-12T00:04:30.328 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="22.04" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=jammy 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:04:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:04:30.375 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:04:30.375 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-12T00:04:30.411 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:04:30.465 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:04:30.473 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:04:30.473 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:04:30.476 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:04:30.480 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:04:30.489 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:04:30.489 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:04:30.524 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:04:30.535 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:04:30.617 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:04:30.643 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:04:30.643 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:04:30.643 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:04:30.644 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:04:30.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:04:30.648 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-12T00:04:30.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:04:30.649 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T00:04:30.695 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-56-generic 2024-09-12T00:04:30.695 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.15.0-56-generic 2024-09-12T00:04:30.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2024-09-12T00:04:30.697 INFO:teuthology.orchestra.run.smithi066.stdout:5.15.0-56-generic 2024-09-12T00:04:30.698 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.15.0-56-generic 2024-09-12T00:04:30.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-09-12T00:04:30.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-09-12T00:04:30.850 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-09-12T00:04:30.980 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:04:30.994 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:04:31.005 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:04:31.021 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:04:31.061 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:04:31.087 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:04:31.097 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:04:31.116 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:04:31.224 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:04:31.240 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:04:31.308 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:04:31.344 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:04:31.346 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:04:31.346 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:04:31.347 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:04:31.361 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:04:31.363 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:04:31.365 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:04:31.366 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:04:31.366 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:04:31.368 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:04:31.369 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:04:31.371 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:04:31.379 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:04:31.380 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:04:31.381 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:04:31.381 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:04:31.382 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:04:31.407 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:04:31.407 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:04:31.413 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:04:31.413 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:04:31.415 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:04:31.415 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:04:31.416 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:04:31.417 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:04:31.417 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:04:31.417 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:04:31.417 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:04:31.418 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:04:31.418 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:04:31.421 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:04:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:04:31.452 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:04:31.452 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:04:31.453 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:04:31.453 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:04:31.454 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:04:31.454 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:04:31.455 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:04:31.456 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:04:31.468 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:04:31.486 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:04:31.486 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:04:31.486 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:04:31.486 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:04:31.557 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:04:31.839 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:04:31.861 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:04:32.011 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:04:32.023 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:04:32.024 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:04:32.033 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:04:32.045 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:04:32.046 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:04:32.109 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:04:32.110 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:04:32.117 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:04:32.118 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:04:32.130 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:04:32.131 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:04:32.139 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:04:32.140 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:04:32.146 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:04:32.168 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:04:32.169 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:04:32.172 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:04:32.175 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:04:32.175 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:04:32.189 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:04:32.195 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:04:32.195 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:04:32.196 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:04:32.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:04:32.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:04:32.277 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:04:32.277 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:04:37.904 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 15.8 MB in 2s (7,050 kB/s) 2024-09-12T00:04:37.990 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 15.8 MB in 2s (7,288 kB/s) 2024-09-12T00:04:39.264 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:04:39.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:04:39.337 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:04:39.502 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:04:39.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:04:39.528 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-09-12T00:04:39.528 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-09-12T00:04:39.589 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:04:39.704 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi066.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi066.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi066.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:04:39.705 INFO:teuthology.orchestra.run.smithi066.stdout: python2.7-minimal 2024-09-12T00:04:39.706 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:04:39.707 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi066.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2024-09-12T00:04:39.708 INFO:teuthology.orchestra.run.smithi066.stdout: thermald 2024-09-12T00:04:39.760 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-09-12T00:04:39.760 INFO:teuthology.orchestra.run.smithi066.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:39.760 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:04:39.761 INFO:teuthology.orchestra.run.smithi066.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:39.761 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2024-09-12T00:04:39.762 INFO:teuthology.orchestra.run.smithi066.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:04:39.804 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-12T00:04:39.804 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-12T00:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 113 MB of archives. 2024-09-12T00:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:04:39.817 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:04:40.002 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:04:40.002 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:04:40.002 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:04:40.004 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:04:40.004 INFO:teuthology.orchestra.run.smithi031.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:04:40.004 INFO:teuthology.orchestra.run.smithi031.stdout: python2.7-minimal 2024-09-12T00:04:40.004 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:04:40.005 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-12T00:04:40.005 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:40.005 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:04:40.006 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:40.006 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-12T00:04:40.006 INFO:teuthology.orchestra.run.smithi031.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:04:40.007 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-09-12T00:04:40.007 INFO:teuthology.orchestra.run.smithi031.stdout: thermald 2024-09-12T00:04:40.057 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-12T00:04:40.057 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:40.057 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:04:40.058 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:40.059 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-09-12T00:04:40.060 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:04:40.112 INFO:teuthology.orchestra.run.smithi031.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:04:40.112 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 113 MB of archives. 2024-09-12T00:04:40.113 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:04:40.113 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:04:40.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:04:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:04:40.564 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:04:40.674 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:04:41.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:04:41.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:04:41.256 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:04:41.383 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:04:41.405 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:04:41.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:04:41.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:04:41.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:04:41.644 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:04:41.667 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:04:41.821 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 113 MB in 2s (69.3 MB/s) 2024-09-12T00:04:42.055 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:04:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 113 MB in 2s (70.9 MB/s) 2024-09-12T00:04:42.274 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:04:44.100 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:04:44.104 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:44.212 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:04:44.217 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:44.244 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:44.270 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:46.353 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:04:46.374 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:46.459 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:46.496 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:04:46.518 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:46.611 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:47.039 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:04:47.049 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:04:47.060 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:47.070 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:47.097 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:47.107 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:53.570 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:53.697 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:53.822 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:53.948 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:53.954 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:54.050 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:54.231 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:54.334 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:54.378 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:04:54.401 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:04:54.444 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:04:54.663 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:04:54.685 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:04:54.729 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:05:00.284 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:05:00.320 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:05:00.359 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:00.595 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:05:00.633 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:05:00.670 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:03.091 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:05:03.212 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:05:03.307 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:05:03.432 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:05:03.588 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:05:03.709 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:03.775 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:05:03.826 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:05:03.887 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:03.930 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:03.988 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:05:04.092 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:05.289 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:05.290 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:05.290 INFO:teuthology.orchestra.run.smithi066.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:05.290 INFO:teuthology.orchestra.run.smithi066.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:05.413 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:05.413 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:05.413 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:05.414 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:05.449 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:05.577 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:07.250 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:07.645 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:08.677 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:05:08.786 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:05:08.912 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:08.980 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:05:08.980 INFO:teuthology.orchestra.run.smithi066.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:09.063 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:05:09.198 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:05:09.300 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:09.369 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:05:09.369 INFO:teuthology.orchestra.run.smithi031.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:23.710 INFO:teuthology.orchestra.run.smithi066.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:05:23.710 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:05:23.723 INFO:teuthology.orchestra.run.smithi066.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:23.745 INFO:teuthology.orchestra.run.smithi066.stdout:Generating grub configuration file ... 2024-09-12T00:05:23.910 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:05:23.910 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:05:23.923 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:23.937 INFO:teuthology.orchestra.run.smithi031.stdout:Generating grub configuration file ... 2024-09-12T00:05:24.013 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:24.027 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:24.187 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:24.205 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:24.302 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:24.307 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:24.378 INFO:teuthology.orchestra.run.smithi066.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:24.383 INFO:teuthology.orchestra.run.smithi066.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:24.501 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:24.508 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:24.539 INFO:teuthology.orchestra.run.smithi066.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:24.539 INFO:teuthology.orchestra.run.smithi066.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:24.539 INFO:teuthology.orchestra.run.smithi066.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:24.578 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:24.584 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:24.586 INFO:teuthology.orchestra.run.smithi066.stdout:done 2024-09-12T00:05:24.751 INFO:teuthology.orchestra.run.smithi031.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:24.751 INFO:teuthology.orchestra.run.smithi031.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:24.751 INFO:teuthology.orchestra.run.smithi031.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:24.800 INFO:teuthology.orchestra.run.smithi031.stdout:done 2024-09-12T00:05:24.996 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-09-12T00:05:25.014 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-09-12T00:05:25.014 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-09-12T00:05:25.014 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-09-12T00:05:25.014 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-09-12T00:05:25.014 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 21 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:25.015 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-09-12T00:05:25.015 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:05:25.016 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:05:25.016 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:05:25.016 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-12T00:05:25.016 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:05:25.016 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2024-09-12T00:05:25.177 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-09-12T00:05:25.253 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2024-09-12T00:05:25.276 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 21 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:25.277 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2024-09-12T00:05:25.278 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:25.278 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:25.278 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2024-09-12T00:05:25.278 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:05:25.278 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:05:25.278 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:05:25.278 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:05:25.278 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:05:25.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2024-09-12T00:05:25.293 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:05:25.412 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:05:25.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-09-12T00:05:25.493 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:05:25.574 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:05:25.688 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:05:25.688 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:05:25.747 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:05:25.829 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:05:26.756 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:05:26.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:05:26.843 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:05:27.058 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-09-12T00:05:27.058 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-09-12T00:05:27.130 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:05:27.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:05:27.212 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:05:27.261 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:05:27.261 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:05:27.261 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:05:27.262 INFO:teuthology.orchestra.run.smithi066.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:05:27.262 INFO:teuthology.orchestra.run.smithi066.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:05:27.262 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:05:27.262 INFO:teuthology.orchestra.run.smithi066.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:05:27.262 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:05:27.307 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:05:27.308 DEBUG:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2024-09-12T00:05:27.325 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2024-09-12T00:05:27.325 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2024-09-12T00:05:27.325 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 21 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:27.326 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2024-09-12T00:05:27.327 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T00:05:27.373 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.ngbDz5XeJC 2024-09-12T00:05:27.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ngbDz5XeJC 2024-09-12T00:05:27.416 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-12T00:05:27.417 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-12T00:05:27.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.ngbDz5XeJC 2024-09-12T00:05:27.553 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.ngbDz5XeJC is 10KB 2024-09-12T00:05:27.566 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.ngbDz5XeJC 2024-09-12T00:05:27.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:27.593 INFO:teuthology.orchestra.run.smithi031.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:05:27.594 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:05:27.594 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:05:27.594 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:05:27.594 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:05:27.594 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:05:27.595 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:05:27.595 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:05:27.626 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:05:27.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:05:27.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:27.636 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:05:27.638 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 21 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:27.650 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:27.651 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:27.651 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2024-09-12T00:05:27.651 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:27.651 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:27.651 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2024-09-12T00:05:27.651 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-12T00:05:27.693 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:05:27.693 DEBUG:teuthology.orchestra.run.smithi066:> sudo update-grub 2024-09-12T00:05:27.698 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.2fN1cVrKMQ 2024-09-12T00:05:27.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2fN1cVrKMQ 2024-09-12T00:05:27.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.2fN1cVrKMQ 2024-09-12T00:05:27.873 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.2fN1cVrKMQ is 10KB 2024-09-12T00:05:27.886 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.2fN1cVrKMQ 2024-09-12T00:05:27.891 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:27.946 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:05:27.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:05:27.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:28.013 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:05:28.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo update-grub 2024-09-12T00:05:28.911 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:05:28.912 INFO:teuthology.orchestra.run.smithi066.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:28.914 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-09-12T00:05:29.123 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:29.128 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:05:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-12T00:05:29.341 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:29.346 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:29.389 INFO:teuthology.orchestra.run.smithi066.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:29.395 INFO:teuthology.orchestra.run.smithi066.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:29.395 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:29.402 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:29.527 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:29.528 INFO:teuthology.orchestra.run.smithi066.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:29.528 INFO:teuthology.orchestra.run.smithi066.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:29.545 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-09-12T00:05:29.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-09-12T00:05:29.636 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:29.642 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:29.686 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:29.692 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:29.862 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-12T00:05:29.869 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-09-12T00:05:59.574 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-12T00:05:59.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:05:59.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:05:59.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:05:59.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-12T00:05:59.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:34.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T00:06:43.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:06:43.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:46.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T00:06:58.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:06:58.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:59.888 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:07:08.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-12T00:07:08.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:07:09.276 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-12T00:07:09.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-12T00:07:09.940 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:07:09.941 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-12T00:07:09.989 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-119-generic 2024-09-12T00:07:09.989 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:07:09.990 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:07:09.990 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:07:10.991 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:07:10.991 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:07:11.129 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-09-12T00:07:11.158 DEBUG:teuthology.parallel:result is None 2024-09-12T00:07:58.167 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:08:13.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:08:13.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:08:13.404 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T00:08:14.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:08:14.049 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-12T00:08:14.050 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T00:08:14.097 INFO:teuthology.orchestra.run.smithi066.stdout:5.15.0-119-generic 2024-09-12T00:08:14.097 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:08:14.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:08:14.098 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:08:15.099 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-12T00:08:15.099 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:08:15.183 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-09-12T00:08:15.207 DEBUG:teuthology.parallel:result is None 2024-09-12T00:08:15.207 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:08:15.213 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:08:15.214 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:08:15.216 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:08:15.222 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:08:15.228 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:08:15.235 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:08:15.235 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:08:15.265 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:08:15.288 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:08:15.294 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:08:15.294 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:08:15.326 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:08:15.348 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:08:15.357 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:08:15.358 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:08:15.361 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:08:15.371 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:08:15.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:08:15.406 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:08:15.430 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:08:15.454 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:08:15.454 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:08:15.463 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:08:15.480 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:08:15.513 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:08:15.573 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:08:15.573 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:08:15.652 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:08:15.660 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:08:15.706 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:08:15.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:08:15.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-09-12T00:08:15.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-12T00:08:15.849 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:08:15.988 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:08:15.988 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:08:16.054 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:08:16.093 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2024-09-12T00:08:16.093 DEBUG:teuthology.task.selinux:Excluding smithi066: OS 'ubuntu' does not support SELinux 2024-09-12T00:08:16.093 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:08:16.093 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:08:16.093 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:08:16.093 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:08:16.126 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:08:16.130 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:08:16.286 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:08:16.297 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:08:16.298 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:15:56.707 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com')] 2024-09-12T00:15:56.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-12T00:15:56.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:15:56.832 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-12T00:15:56.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-12T00:15:56.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:15:56.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:15:57.052 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T00:15:57.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T00:15:57.133 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:15:57.146 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:15:57.146 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:15:57.147 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:15:57.149 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:15:57.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:15:57.177 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:15:57.177 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Command line: ntpd -gq 2024-09-12T00:15:57.177 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: ---------------------------------------------------- 2024-09-12T00:15:57.177 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:15:57.177 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: corporation. Support and training for ntp-4 are 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: available at https://www.nwtime.org/support 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: ---------------------------------------------------- 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: proto: precision = 0.045 usec (-24) 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: basedate set to 2022-02-04 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:15:57.178 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:15:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:15:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen normally on 3 ens1f0 172.21.15.31:123 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen normally on 4 lo [::1]:123 2024-09-12T00:15:57.180 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2024-09-12T00:15:57.181 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:15:57 ntpd[18363]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Command line: ntpd -gq 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: ---------------------------------------------------- 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:15:57.207 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: corporation. Support and training for ntp-4 are 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: available at https://www.nwtime.org/support 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: ---------------------------------------------------- 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: proto: precision = 0.047 usec (-24) 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: basedate set to 2022-02-04 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:15:57.208 INFO:teuthology.orchestra.run.smithi066.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:15:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:15:57.209 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:15:57.209 INFO:teuthology.orchestra.run.smithi066.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:15:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:15:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:15:57.210 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:15:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen normally on 3 enp3s0f1 172.21.15.66:123 2024-09-12T00:15:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen normally on 4 lo [::1]:123 2024-09-12T00:15:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8bd%5]:123 2024-09-12T00:15:57.211 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:15:57 ntpd[18523]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:15:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:58 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:15:59.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:15:59.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:15:59.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:15:59.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:15:59.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:15:59.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:15:59.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:15:59.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:15:59 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:00.177 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:00 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:00.177 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:00 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:00.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:00.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:00.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:00.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:00.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:00.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:00 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:01.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:01.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:01 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:02.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:02.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:02 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:02.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:02 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:03 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:04.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:04.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:04.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:04 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:04.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:04.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:04.207 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:04.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:04.208 INFO:teuthology.orchestra.run.smithi066.stdout:12 Sep 00:16:04 ntpd[18523]: ntpd: time slew -0.002370 s 2024-09-12T00:16:04.208 INFO:teuthology.orchestra.run.smithi066.stdout:ntpd: time slew -0.002370s 2024-09-12T00:16:04.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:16:04.208 INFO:teuthology.orchestra.run.smithi066.stderr:12 Sep 00:16:04 ntpd[18523]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:04.264 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:06.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:06.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:06.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:06.180 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:06 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:16:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:16:08.179 INFO:teuthology.orchestra.run.smithi031.stdout:12 Sep 00:16:08 ntpd[18363]: ntpd: time slew +0.000346 s 2024-09-12T00:16:08.179 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew +0.000346s 2024-09-12T00:16:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:16:08.179 INFO:teuthology.orchestra.run.smithi031.stderr:12 Sep 00:16:08 ntpd[18363]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:08.231 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:16:08.232 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:16:08.247 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:16:08.247 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:16:08.247 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:16:08.248 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:16:08.254 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:16:08.254 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:16:08.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2024-09-12T00:16:08.255 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-key list | grep Ceph 2024-09-12T00:16:08.321 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:16:08.331 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:16:08.350 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:16:08.350 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:16:08.351 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:16:08.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:16:08.366 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:16:08.366 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:16:08.366 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:16:08.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:16:08.522 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:16:08.522 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:16:08.533 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:16:08.534 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:16:08.639 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:16:08.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:16:08.649 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:16:08.649 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:16:08.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-09-12T00:16:08.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo apt-get update 2024-09-12T00:16:08.830 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:16:08.839 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:16:08.840 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:16:08.849 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:16:08.856 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:16:08.883 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:16:08.891 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:16:08.904 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:16:08.912 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:16:08.926 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:16:08.934 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:16:08.947 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:16:08.955 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:16:08.955 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:16:08.975 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:16:08.983 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:16:09.037 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:16:09.118 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 29.2 kB in 0s (81.9 kB/s) 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 29.2 kB in 0s (71.1 kB/s) 2024-09-12T00:16:10.250 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:16:10.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:16:10.298 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:16:10.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:16:10.330 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-12T00:16:10.380 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2024-09-12T00:16:10.537 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-12T00:16:10.537 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-12T00:16:10.592 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2024-09-12T00:16:10.593 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2024-09-12T00:16:10.752 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:16:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:16:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:16:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:16:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:16:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:16:10.753 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:16:10.753 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-12T00:16:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:16:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:16:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:16:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet zip 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-09-12T00:16:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2024-09-12T00:16:10.810 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:16:10.810 INFO:teuthology.orchestra.run.smithi066.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:16:10.810 INFO:teuthology.orchestra.run.smithi066.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:16:10.811 INFO:teuthology.orchestra.run.smithi066.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:16:10.811 INFO:teuthology.orchestra.run.smithi066.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:16:10.812 INFO:teuthology.orchestra.run.smithi066.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:16:10.812 INFO:teuthology.orchestra.run.smithi066.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:16:10.812 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2024-09-12T00:16:10.812 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:16:10.812 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:16:10.814 INFO:teuthology.orchestra.run.smithi066.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:16:10.814 INFO:teuthology.orchestra.run.smithi066.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:16:10.814 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:16:10.815 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet zip 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2024-09-12T00:16:10.816 INFO:teuthology.orchestra.run.smithi066.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout:Recommended packages: 2024-09-12T00:16:10.817 INFO:teuthology.orchestra.run.smithi066.stdout: btrfs-tools 2024-09-12T00:16:10.866 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-12T00:16:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:16:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:16:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:16:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:16:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:16:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:16:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:16:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:16:10.926 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2024-09-12T00:16:10.926 INFO:teuthology.orchestra.run.smithi066.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:16:10.926 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:16:10.927 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:16:10.927 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:16:10.927 INFO:teuthology.orchestra.run.smithi066.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:16:10.927 INFO:teuthology.orchestra.run.smithi066.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:16:10.929 INFO:teuthology.orchestra.run.smithi066.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:16:10.929 INFO:teuthology.orchestra.run.smithi066.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:16:10.929 INFO:teuthology.orchestra.run.smithi066.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:16:10.929 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:16:10.929 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:16:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:16:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:16:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:16:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:16:10.930 INFO:teuthology.orchestra.run.smithi066.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:16:10.931 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:16:10.932 INFO:teuthology.orchestra.run.smithi066.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:16:10.988 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:16:10.988 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 251 MB of archives. 2024-09-12T00:16:10.988 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:16:10.988 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:16:11.010 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:16:11.011 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 251 MB of archives. 2024-09-12T00:16:11.011 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:16:11.011 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:16:11.057 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:16:11.071 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:16:11.078 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:16:11.081 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:16:11.097 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:16:11.156 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:16:11.161 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:16:11.174 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:16:11.178 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:16:11.178 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:16:11.179 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:16:11.188 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:16:11.190 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:16:11.193 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:16:11.194 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:16:11.195 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:16:11.197 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:16:11.207 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:16:11.212 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:16:11.217 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:16:11.217 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:16:11.217 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:16:11.217 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:16:11.217 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:16:11.218 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:16:11.218 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:16:11.229 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:16:11.230 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:16:11.247 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:16:11.249 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:16:11.250 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:16:11.250 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:16:11.251 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:16:11.252 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:16:11.252 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:16:11.252 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:16:11.264 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:16:11.264 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:16:11.281 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:16:11.281 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:16:11.287 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:16:11.287 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:16:11.287 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:16:11.288 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:16:11.288 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:16:11.289 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:16:11.291 INFO:teuthology.orchestra.run.smithi066.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:16:11.292 INFO:teuthology.orchestra.run.smithi066.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:16:11.294 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:16:11.298 INFO:teuthology.orchestra.run.smithi066.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:16:11.299 INFO:teuthology.orchestra.run.smithi066.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:16:11.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:16:11.316 INFO:teuthology.orchestra.run.smithi066.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:16:11.317 INFO:teuthology.orchestra.run.smithi066.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:16:11.319 INFO:teuthology.orchestra.run.smithi066.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:16:11.324 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:16:11.324 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:16:11.328 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:16:11.329 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:16:11.334 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:16:11.374 INFO:teuthology.orchestra.run.smithi066.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:16:11.375 INFO:teuthology.orchestra.run.smithi066.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:16:11.376 INFO:teuthology.orchestra.run.smithi066.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:16:11.376 INFO:teuthology.orchestra.run.smithi066.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:16:11.377 INFO:teuthology.orchestra.run.smithi066.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:16:11.380 INFO:teuthology.orchestra.run.smithi066.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:16:11.395 INFO:teuthology.orchestra.run.smithi066.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:16:11.397 INFO:teuthology.orchestra.run.smithi066.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:16:11.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:16:11.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:16:11.436 INFO:teuthology.orchestra.run.smithi066.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:16:11.437 INFO:teuthology.orchestra.run.smithi066.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:16:11.441 INFO:teuthology.orchestra.run.smithi066.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:16:11.443 INFO:teuthology.orchestra.run.smithi066.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:16:11.443 INFO:teuthology.orchestra.run.smithi066.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:16:11.443 INFO:teuthology.orchestra.run.smithi066.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:16:11.444 INFO:teuthology.orchestra.run.smithi066.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:16:11.444 INFO:teuthology.orchestra.run.smithi066.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:16:11.445 INFO:teuthology.orchestra.run.smithi066.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:16:11.445 INFO:teuthology.orchestra.run.smithi066.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:16:11.446 INFO:teuthology.orchestra.run.smithi066.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:16:11.446 INFO:teuthology.orchestra.run.smithi066.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:16:11.451 INFO:teuthology.orchestra.run.smithi066.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:16:11.463 INFO:teuthology.orchestra.run.smithi066.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:16:11.465 INFO:teuthology.orchestra.run.smithi066.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:16:11.466 INFO:teuthology.orchestra.run.smithi066.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:16:11.467 INFO:teuthology.orchestra.run.smithi066.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:16:11.470 INFO:teuthology.orchestra.run.smithi066.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:16:11.473 INFO:teuthology.orchestra.run.smithi066.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:16:11.473 INFO:teuthology.orchestra.run.smithi066.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:16:11.474 INFO:teuthology.orchestra.run.smithi066.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:16:11.477 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:16:11.478 INFO:teuthology.orchestra.run.smithi066.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:16:11.482 INFO:teuthology.orchestra.run.smithi066.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:16:11.490 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:16:11.496 INFO:teuthology.orchestra.run.smithi066.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:16:11.496 INFO:teuthology.orchestra.run.smithi066.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:16:11.497 INFO:teuthology.orchestra.run.smithi066.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:16:11.497 INFO:teuthology.orchestra.run.smithi066.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:16:11.499 INFO:teuthology.orchestra.run.smithi066.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:16:11.499 INFO:teuthology.orchestra.run.smithi066.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:16:11.505 INFO:teuthology.orchestra.run.smithi066.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:16:11.506 INFO:teuthology.orchestra.run.smithi066.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:16:11.506 INFO:teuthology.orchestra.run.smithi066.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:16:11.515 INFO:teuthology.orchestra.run.smithi066.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:16:11.516 INFO:teuthology.orchestra.run.smithi066.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:16:11.571 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:16:11.601 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:16:11.604 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:16:11.613 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:16:11.800 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:16:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:16:11.812 INFO:teuthology.orchestra.run.smithi066.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:16:11.815 INFO:teuthology.orchestra.run.smithi066.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:16:11.825 INFO:teuthology.orchestra.run.smithi066.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:16:11.840 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:16:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:16:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:16:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:16:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:16:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:16:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:16:11.882 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:16:11.962 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:16:11.967 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:16:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:16:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:16:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:16:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:16:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:16:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:16:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:16:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:16:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:16:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:16:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:16:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:16:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:16:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:16:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:16:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:16:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:16:12.208 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:16:12.210 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:16:12.212 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:16:12.213 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:16:12.223 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:16:12.289 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:16:12.290 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:16:12.291 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:16:12.294 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:16:12.298 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:16:12.371 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:16:12.374 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:16:12.375 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:16:12.380 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:16:12.381 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:16:12.453 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:16:12.457 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:16:12.643 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:16:12.643 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:16:12.645 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:16:12.648 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:16:12.649 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:16:12.651 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:16:12.695 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:16:12.698 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:16:12.699 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:16:12.726 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:16:12.731 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:16:12.733 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:16:12.752 INFO:teuthology.orchestra.run.smithi066.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:16:12.767 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:16:12.775 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:16:12.776 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:16:12.810 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:16:12.811 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:16:12.812 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:16:12.813 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:16:12.814 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:16:12.815 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:16:12.820 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:16:12.845 INFO:teuthology.orchestra.run.smithi066.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:16:12.853 INFO:teuthology.orchestra.run.smithi066.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:16:12.853 INFO:teuthology.orchestra.run.smithi066.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:16:12.892 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi066.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:16:13.057 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:16:13.057 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:16:13.058 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:16:13.128 INFO:teuthology.orchestra.run.smithi066.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:16:13.136 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:16:13.138 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:16:13.155 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:16:13.156 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:16:13.156 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:16:13.161 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:16:13.163 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:16:13.790 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:16:13.790 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:16:13.808 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:16:13.850 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:16:13.860 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:16:13.862 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:16:13.982 INFO:teuthology.orchestra.run.smithi066.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:16:13.983 INFO:teuthology.orchestra.run.smithi066.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:16:13.999 INFO:teuthology.orchestra.run.smithi066.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:16:14.043 INFO:teuthology.orchestra.run.smithi066.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:16:14.060 INFO:teuthology.orchestra.run.smithi066.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:16:14.062 INFO:teuthology.orchestra.run.smithi066.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:16:16.052 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:16:16.173 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:16:16.173 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:16:16.276 INFO:teuthology.orchestra.run.smithi066.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:16:16.480 INFO:teuthology.orchestra.run.smithi066.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:16:16.520 INFO:teuthology.orchestra.run.smithi066.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:16:18.052 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:16:18.054 INFO:teuthology.orchestra.run.smithi031.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:16:18.056 INFO:teuthology.orchestra.run.smithi031.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:16:18.423 INFO:teuthology.orchestra.run.smithi031.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:16:18.425 INFO:teuthology.orchestra.run.smithi066.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:16:18.427 INFO:teuthology.orchestra.run.smithi066.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:16:18.429 INFO:teuthology.orchestra.run.smithi066.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:16:18.729 INFO:teuthology.orchestra.run.smithi066.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 251 MB in 8s (33.2 MB/s) 2024-09-12T00:16:19.306 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:16:19.331 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 251 MB in 8s (32.2 MB/s) 2024-09-12T00:16:19.410 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:16:19.416 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:16:19.505 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:16:19.505 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:16:19.696 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:16:19.849 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:16:19.877 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:16:20.020 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:16:20.047 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:16:20.049 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:16:20.232 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:16:20.377 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:16:20.404 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:16:20.444 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:16:20.576 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:16:20.603 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:16:20.643 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:16:20.797 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:16:20.824 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:20.864 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:21.088 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:16:21.115 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:21.163 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:21.283 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:16:21.310 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:21.350 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:21.491 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:16:21.518 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:21.550 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:21.745 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:16:21.772 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:21.811 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:21.919 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:16:21.946 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:16:21.986 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:16:22.339 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:16:22.366 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:16:22.405 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:16:22.466 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2024-09-12T00:16:22.493 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:22.533 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librados2. 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:22.986 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:16:23.012 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:23.044 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:23.177 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:16:23.204 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:23.244 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:23.488 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:16:23.504 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:23.689 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:16:23.715 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:23.755 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:23.857 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.041 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:16:24.057 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:24.099 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.251 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:16:24.278 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:24.317 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.385 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:16:24.412 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:24.443 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.562 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:16:24.589 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:24.620 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.646 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:16:24.673 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:24.712 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:24.906 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:16:24.933 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:24.976 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:25.032 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:16:25.059 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:25.098 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:25.409 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:16:25.435 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:16:25.475 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:16:25.543 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:16:25.570 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:16:25.610 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:16:25.795 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:16:25.821 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:16:25.861 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:16:25.921 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:16:25.948 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:16:25.987 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:16:26.089 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:16:26.104 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:26.138 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:26.207 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:16:26.223 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:26.265 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:26.483 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:16:26.510 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:16:26.549 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:16:26.618 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:16:26.645 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:16:26.709 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:16:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:16:26.843 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:16:26.885 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:16:26.987 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:16:27.179 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:16:27.195 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:16:27.238 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:16:27.356 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:16:27.372 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:16:27.406 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:16:27.516 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:16:27.542 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:16:27.574 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:16:27.767 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:16:27.894 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:16:27.920 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:16:27.960 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:16:28.079 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:16:28.106 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:16:28.145 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:16:28.187 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package zip. 2024-09-12T00:16:28.204 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:16:28.406 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package zip. 2024-09-12T00:16:28.422 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:16:28.464 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:16:28.540 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package unzip. 2024-09-12T00:16:28.567 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:16:28.607 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:16:28.743 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package unzip. 2024-09-12T00:16:28.769 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:16:28.801 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:16:29.230 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:16:29.257 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:16:29.296 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:16:29.451 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:16:29.477 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:29.517 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:29.678 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:16:29.695 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:29.737 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.111 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:16:30.127 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:30.161 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.374 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:16:30.451 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:30.451 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.469 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:16:30.491 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:16:30.531 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:16:30.767 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:16:30.783 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:30.825 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.884 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:16:30.911 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:16:30.942 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:16:31.261 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:16:31.262 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:16:31.289 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:31.289 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:31.328 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:31.328 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:31.782 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:16:31.809 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:31.848 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.008 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:16:33.035 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:33.084 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.294 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:16:33.311 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:33.353 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.653 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:16:33.680 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:16:33.720 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:16:33.940 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:16:33.968 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:16:34.007 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:16:34.022 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:16:34.046 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:16:34.089 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:16:34.309 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:16:34.337 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:16:34.376 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:16:34.408 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:16:34.435 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:16:34.475 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:16:34.704 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:16:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:16:34.731 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:16:34.735 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:16:34.769 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:16:34.770 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:16:35.048 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:16:35.055 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:16:35.072 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:16:35.082 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:16:35.106 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:16:35.121 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:16:35.376 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:16:35.403 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:16:35.442 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:16:35.599 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:16:35.623 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:16:35.658 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:16:35.745 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:16:35.772 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:16:35.812 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:16:35.902 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:16:35.929 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:16:35.969 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:16:36.098 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:16:36.125 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:16:36.271 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:16:36.298 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:16:36.338 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:16:36.451 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:16:36.478 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:16:36.509 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:16:36.641 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:16:36.668 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:16:36.707 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:16:37.079 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:16:37.106 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:16:37.146 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:16:37.190 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:16:37.218 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:16:37.257 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:16:37.518 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:16:37.545 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:16:37.576 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:16:37.777 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:16:37.803 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:16:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:16:37.879 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:16:37.906 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:16:37.945 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:16:38.146 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:16:38.173 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:16:38.213 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:16:38.248 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:16:38.276 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:16:38.315 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:16:38.516 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:16:38.543 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:16:38.582 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:16:38.643 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:16:38.671 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:16:38.709 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:16:38.852 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:16:38.879 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:16:38.918 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:16:39.054 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:16:39.081 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:16:39.112 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:16:39.247 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:16:39.274 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:16:39.321 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:16:39.390 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:16:39.417 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:16:39.456 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:16:39.666 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:16:39.693 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:16:39.736 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:16:39.801 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:16:39.828 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:16:39.871 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:16:40.052 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:16:40.069 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:16:40.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:16:40.162 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:16:40.178 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:16:40.211 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:16:40.363 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:16:40.380 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:16:40.413 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:16:40.500 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:16:40.527 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:16:40.567 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:16:40.750 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:16:40.766 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:16:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:16:41.061 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:16:41.088 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:16:41.152 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:16:41.464 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:16:41.491 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:16:41.531 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:16:41.821 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:16:41.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:16:42.206 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:16:42.233 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:16:42.255 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:16:42.272 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:16:42.282 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:16:42.321 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:16:42.616 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:16:42.617 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:16:42.643 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:16:42.674 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:16:42.903 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:16:42.930 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:16:42.969 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:16:42.969 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:16:42.996 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:16:43.316 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:16:43.343 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:16:43.347 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:16:43.374 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:16:43.382 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:16:43.413 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:16:43.685 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:16:43.712 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:16:43.725 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:16:43.752 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:16:43.752 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:16:43.791 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:16:44.071 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:16:44.077 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:16:44.098 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:16:44.105 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:16:44.144 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:44.475 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:16:44.502 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:16:44.541 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:16:44.852 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:16:44.879 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:16:44.919 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:16:45.224 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:16:45.241 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:45.247 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:16:45.274 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:45.282 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:45.313 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:45.577 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:16:45.604 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:16:45.643 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:16:45.693 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:16:45.720 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:45.759 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:46.037 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:16:46.064 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:16:46.095 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:16:46.155 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:16:46.182 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:16:46.221 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:16:46.524 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:16:46.552 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:46.583 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:46.801 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:46.868 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:46.952 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:16:46.980 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:47.271 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:16:47.298 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:47.337 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:47.874 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:16:47.901 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:47.932 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:48.793 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2024-09-12T00:16:48.820 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:48.850 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:49.052 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph. 2024-09-12T00:16:49.079 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:49.119 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:49.137 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:16:49.164 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:49.203 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:49.446 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:16:49.473 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:49.513 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:49.565 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:16:49.592 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:49.631 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:49.841 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:16:49.857 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:49.890 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:50.051 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:16:50.079 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:50.126 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:50.379 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:16:50.406 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:16:50.470 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:16:50.671 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:16:50.698 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:16:50.737 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:16:50.765 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:16:50.781 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:16:50.814 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:51.065 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:16:51.082 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:16:51.123 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:51.736 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:16:51.764 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:16:51.802 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:52.122 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:16:52.295 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:16:52.323 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:16:52.362 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:52.517 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:16:52.544 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:52.583 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:52.664 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:16:52.692 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:16:52.722 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:16:52.920 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:16:52.948 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:16:52.986 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:16:53.051 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:16:53.078 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:53.109 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:53.323 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:16:53.350 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:16:53.389 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:16:53.437 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:16:53.465 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:16:53.503 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:16:53.726 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:16:53.748 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:16:53.754 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:53.764 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:16:53.793 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:53.797 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:16:54.084 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:16:54.112 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:54.142 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:56.573 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:16:56.604 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:16:56.648 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:16:57.005 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:16:57.023 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:16:57.063 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:16:57.084 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:16:57.101 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:16:57.143 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:16:57.488 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:16:57.509 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:16:57.516 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:16:57.537 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:16:57.554 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:16:57.566 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:16:57.866 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:16:57.896 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:16:57.928 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:16:57.932 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:16:57.956 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:16:57.995 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:16:58.281 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:16:58.309 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:16:58.339 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:16:58.758 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:16:58.786 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:58.901 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:59.014 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:16:59.043 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:16:59.174 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:59.838 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:16:59.866 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:16:59.905 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:17:00.094 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:17:00.123 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:17:00.161 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:17:00.183 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:17:00.211 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:17:00.241 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:17:00.413 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:17:00.430 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:17:00.463 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:17:00.503 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:17:00.531 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:17:00.561 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:17:00.800 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:17:00.828 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:17:00.847 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:17:00.866 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:17:00.875 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:17:00.914 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:17:01.169 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:17:01.198 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:17:01.218 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:17:01.246 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:17:01.314 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:17:01.315 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:17:01.574 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:17:01.601 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:17:01.630 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:17:01.639 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:17:01.658 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:17:01.696 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:17:01.957 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:17:01.959 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:17:01.985 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:17:01.987 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:17:02.015 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:17:02.026 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:17:02.310 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:17:02.339 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:17:02.377 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:17:02.529 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:17:02.557 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:17:02.587 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:17:02.865 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:17:02.893 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:17:02.931 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:17:03.008 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:17:03.025 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:17:03.066 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:03.377 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:17:03.406 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:17:03.443 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:17:03.587 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:17:03.604 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:17:03.646 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:03.780 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:17:03.808 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:17:03.846 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:17:03.931 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:17:03.960 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:17:03.989 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:17:04.099 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2024-09-12T00:17:04.127 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:17:04.165 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:17:04.318 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:17:04.346 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:17:04.384 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:17:04.393 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2024-09-12T00:17:04.410 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:17:04.443 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:17:04.653 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package jq. 2024-09-12T00:17:04.670 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:17:04.711 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:17:04.721 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:17:04.750 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:17:04.788 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:17:04.964 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package socat. 2024-09-12T00:17:04.981 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:17:05.022 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:17:05.109 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:17:05.126 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:05.159 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:05.342 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:17:05.359 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:17:05.400 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:17:05.755 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:17:05.783 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:05.821 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:07.705 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:17:07.733 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:17:07.771 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:08.050 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:17:08.067 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:08.108 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:08.411 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:17:08.440 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:17:08.478 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:17:08.542 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:17:08.570 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:17:08.608 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:08.769 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:17:08.783 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:17:08.815 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:17:08.895 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:17:08.912 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:08.953 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:09.178 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:17:09.206 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:17:09.244 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:17:09.273 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:17:09.301 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:17:09.339 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:17:09.677 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:17:09.691 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:17:09.706 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:17:09.720 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:17:09.743 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:17:09.758 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:17:09.986 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:17:10.003 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:17:10.044 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:17:10.081 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:17:10.109 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:17:10.147 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:17:10.606 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:17:10.643 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:17:10.792 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:17:10.820 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:17:10.858 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:17:10.879 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:17:10.897 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:17:10.938 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:17:11.178 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:17:11.236 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:17:11.357 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:17:11.386 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:17:11.424 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:17:11.539 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:17:11.556 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:17:11.623 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:17:11.735 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:17:11.764 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:17:11.801 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:17:11.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:17:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:17:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:17:12.121 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:17:12.150 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:17:12.188 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:17:12.337 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:17:12.366 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:17:12.403 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:17:12.474 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:17:12.491 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:17:12.524 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:17:12.869 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:17:12.898 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:17:12.899 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:17:12.928 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:17:12.935 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:17:12.966 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:17:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:17:13.227 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:17:13.230 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:17:13.259 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:17:13.260 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:17:13.296 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:17:13.546 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:17:13.575 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:17:13.613 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:17:13.784 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:17:13.813 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:17:13.850 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:17:13.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:17:13.995 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:17:14.033 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:17:14.170 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:17:14.199 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:17:14.236 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:17:14.302 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:17:14.331 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:17:14.368 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:17:14.539 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:17:14.568 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:17:14.605 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:17:14.934 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:17:14.962 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:17:15.000 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:17:15.081 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:17:15.110 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:15.148 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:15.253 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:17:15.270 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:17:15.344 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:17:16.107 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:17:16.136 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:16.173 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:16.184 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:17:16.201 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:16.234 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:16.497 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:17:16.748 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:17:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:17:17.100 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:17:17.126 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:17:17.155 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:17:17.192 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:17.437 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:17:17.514 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:17:17.772 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:17:17.835 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:17:17.898 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:17:17.917 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:18.162 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:17:18.417 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2024-09-12T00:17:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:17:18.618 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:17:18.893 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:17:19.026 INFO:teuthology.orchestra.run.smithi066.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:17:19.108 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:19.153 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:17:19.287 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:17:19.546 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:17:19.617 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user cephadm....done 2024-09-12T00:17:19.806 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:17:19.806 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:17:19.915 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:17:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:17:20.429 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:17:20.602 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:17:20.787 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:17:20.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:17:20.904 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:17:21.137 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:17:21.164 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:17:21.389 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:17:21.431 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:17:21.558 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:17:21.623 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:17:21.866 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:17:21.884 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:17:22.137 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:22.245 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:17:22.418 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:17:22.496 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:17:22.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:17:22.670 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:17:22.795 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:17:23.030 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:17:23.255 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:17:23.273 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:17:23.541 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:17:23.635 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:17:23.660 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:17:23.725 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:17:23.800 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:17:23.851 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:17:24.043 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:24.235 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:17:24.311 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:17:24.378 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:17:24.445 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:17:24.571 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:17:24.670 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:17:24.697 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:17:24.930 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:17:25.190 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:17:25.239 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:17:25.365 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:17:25.583 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:17:25.621 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:17:25.693 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:17:25.819 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:17:26.042 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:17:26.212 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:17:26.302 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:17:26.340 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:17:26.428 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:17:26.553 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:17:26.606 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:17:26.854 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:17:26.873 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:17:27.191 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:17:27.289 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:17:27.292 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:17:27.532 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:17:27.925 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:17:27.961 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:17:28.229 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:17:28.251 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:17:28.355 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:17:28.497 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:17:28.603 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:17:28.799 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:17:28.853 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:17:28.995 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:29.200 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:17:29.289 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:17:29.434 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:17:29.616 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:17:29.811 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:17:30.146 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:17:30.497 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:17:30.756 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:17:30.862 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:17:30.882 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:31.105 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:31.166 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:17:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:17:31.482 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:17:31.484 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:17:31.608 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:17:31.734 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:17:32.036 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:17:32.312 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:17:32.571 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:32.689 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:17:32.748 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:17:32.983 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:32.990 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:17:33.093 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:17:33.250 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:17:33.352 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:17:33.478 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:17:33.559 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:17:33.604 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:17:33.826 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:17:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:17:34.086 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:17:34.165 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:17:34.345 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:17:34.424 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:34.446 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:17:34.528 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:17:34.714 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:17:34.827 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:17:34.840 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:17:35.086 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:17:35.141 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:17:35.362 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:17:35.442 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:17:35.622 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:17:35.701 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:17:35.827 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:17:35.889 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:17:35.953 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:17:36.043 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:17:36.157 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:17:36.266 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:17:36.279 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:17:36.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:17:36.534 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:17:36.643 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:17:36.782 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:17:36.945 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:17:37.042 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:17:37.168 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:17:37.262 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:17:37.435 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:37.530 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:17:37.561 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:17:37.656 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:17:37.782 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:17:37.870 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:17:37.879 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:17:38.109 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:17:38.172 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:17:38.210 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:17:38.447 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:17:38.611 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:17:38.807 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:17:38.879 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:17:39.005 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:17:39.083 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:17:39.273 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:17:39.359 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:17:39.398 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:17:39.729 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:17:39.733 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:17:40.018 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:17:40.114 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:17:40.294 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:17:40.390 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:17:40.419 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:17:40.704 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:17:40.734 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:17:40.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:40.972 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:17:41.003 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:41.129 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:17:41.325 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:17:41.432 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:41.550 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:41.676 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:17:41.718 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:17:41.969 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:42.020 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:17:42.103 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:42.204 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:42.372 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:17:42.409 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:17:42.409 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:17:42.498 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:42.616 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:42.717 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:17:42.922 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.028 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.048 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.162 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.182 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.288 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:17:43.308 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:17:43.573 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.699 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:43.817 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.029 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:17:44.029 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:17:44.527 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.561 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.653 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.687 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.787 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.805 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.906 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:44.913 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:17:45.016 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:45.534 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2024-09-12T00:17:45.876 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2024-09-12T00:17:46.037 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2024-09-12T00:17:46.053 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:17:46.134 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:46.212 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:17:46.234 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:46.352 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:46.478 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:46.573 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:17:46.612 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:47.008 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:47.134 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:47.147 INFO:teuthology.orchestra.run.smithi066.stdout:Adding group ceph....done 2024-09-12T00:17:47.523 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user ceph....done 2024-09-12T00:17:47.597 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:17:47.597 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:17:47.650 INFO:teuthology.orchestra.run.smithi066.stdout:Setting system user ceph properties....done 2024-09-12T00:17:47.666 INFO:teuthology.orchestra.run.smithi066.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:17:47.808 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:17:48.044 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:48.107 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:17:48.398 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:17:48.588 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:48.714 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:48.837 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:49.069 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:17:49.069 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:17:49.227 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:17:49.227 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:17:49.497 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:49.683 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:49.735 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:17:49.736 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:17:50.007 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:17:50.182 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:50.473 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:17:50.473 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:17:50.484 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:50.706 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:17:50.707 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:17:50.976 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:51.102 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:51.170 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:51.253 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:51.395 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:17:51.395 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:17:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:17:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:17:51.889 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:51.929 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.072 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.198 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.254 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:17:52.254 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:17:52.357 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.732 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:17:52.844 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:17:52.858 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:52.988 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:17:53.009 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:53.233 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:17:53.234 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:17:53.652 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:53.820 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:53.954 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:54.096 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:17:54.105 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:17:54.563 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:17:54.726 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:17:54.732 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:54.968 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:17:55.112 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:17:55.945 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:17:56.638 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:17:56.644 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:56.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:17:56.800 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:17:56.820 INFO:teuthology.orchestra.run.smithi031.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:56.820 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:56.820 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:17:56.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:17:56.965 DEBUG:teuthology.orchestra.run.smithi066:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:17:56.985 INFO:teuthology.orchestra.run.smithi066.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:56.986 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:56.986 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:17:56.988 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:17:56.988 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:56.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:17:57.003 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:57.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:17:57.041 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:17:57.041 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:57.041 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:17:57.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:17:57.114 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:57.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:17:57.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:17:57.184 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:17:57.184 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:57.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:17:57.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:17:57.254 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:57.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:17:57.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:17:57.324 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:17:57.324 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:57.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:17:57.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:17:57.395 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:57.395 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:17:57.410 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:17:57.463 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:17:57.547 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:17:57.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-09-12T00:17:57.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2024-09-12T00:17:57.562 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:17:57.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:17:57.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:17:57.617 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:17:57.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:17:57.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:17:57.733 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:17:57.733 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:17:57.733 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7901841', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkkyWqoalOWylThQpcLsiDtN0k2PMf1TSBFuwhlgjMt7bRFyfxREWqca5mENugIIfcBXzU0aHUgQLqEP2HOdaw=', 'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCJjTX7cZZaa/Y3AXuEYh6IJaPfzSflTD8tryXHJCU7YSrfhX/glf11AzNi/hljTSputwEDIJB6O3wp252riImc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:17:57.733 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:17:57.736 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:17:57.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:17:57.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:17:57.797 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:57.797 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:17:57.848 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:17:57.853 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-09-12T00:17:57.900 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:17:57.900 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:57.900 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-09-12T00:17:57.900 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:57.900 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-12 00:12:21.311566316 +0000 2024-09-12T00:17:57.901 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-12 00:12:21.059568567 +0000 2024-09-12T00:17:57.901 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-12 00:12:21.059568567 +0000 2024-09-12T00:17:57.901 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-09-12T00:17:57.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:17:57.955 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-12T00:17:57.955 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-12T00:17:57.955 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00044653 s, 1.1 MB/s 2024-09-12T00:17:57.956 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:17:58.005 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-12 00:12:21.827561706 +0000 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-12 00:12:21.547564208 +0000 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-12 00:12:21.547564208 +0000 2024-09-12T00:17:58.051 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-09-12T00:17:58.051 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:17:58.106 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-12T00:17:58.106 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-12T00:17:58.106 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000419306 s, 1.2 MB/s 2024-09-12T00:17:58.107 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:17:58.156 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-12 00:12:22.287557598 +0000 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-12 00:12:22.051559705 +0000 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-12 00:12:22.051559705 +0000 2024-09-12T00:17:58.203 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-09-12T00:17:58.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:17:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-12T00:17:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-12T00:17:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000360208 s, 1.4 MB/s 2024-09-12T00:17:58.262 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:17:58.312 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-12 00:12:22.531555418 +0000 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-12 00:12:22.527555454 +0000 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-12 00:12:22.527555454 +0000 2024-09-12T00:17:58.359 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-09-12T00:17:58.360 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:17:58.413 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-12T00:17:58.413 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-12T00:17:58.413 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000363743 s, 1.4 MB/s 2024-09-12T00:17:58.414 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:17:58.465 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T00:17:58.465 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:58.465 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:17:58.471 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:17:58.471 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 00:12:22.443633813 +0000 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 00:12:22.195636028 +0000 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 00:12:22.195636028 +0000 2024-09-12T00:17:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-12T00:17:58.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:17:58.575 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T00:17:58.575 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T00:17:58.575 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000361252 s, 1.4 MB/s 2024-09-12T00:17:58.576 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:17:58.630 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-12T00:17:58.676 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:17:58.676 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.676 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-12T00:17:58.676 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.677 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 00:12:22.935629418 +0000 2024-09-12T00:17:58.677 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 00:12:22.663631848 +0000 2024-09-12T00:17:58.677 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 00:12:22.663631848 +0000 2024-09-12T00:17:58.677 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-12T00:17:58.677 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:17:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T00:17:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T00:17:58.735 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000438553 s, 1.2 MB/s 2024-09-12T00:17:58.737 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:17:58.786 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-12T00:17:58.836 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 00:12:23.395625309 +0000 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 00:12:23.171627310 +0000 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 00:12:23.171627310 +0000 2024-09-12T00:17:58.837 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-12T00:17:58.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:17:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T00:17:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T00:17:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000376928 s, 1.4 MB/s 2024-09-12T00:17:58.896 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:17:58.946 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-12T00:17:58.992 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 00:12:23.903620772 +0000 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 00:12:23.631623201 +0000 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 00:12:23.631623201 +0000 2024-09-12T00:17:58.993 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2024-09-12T00:17:58.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:17:59.051 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T00:17:59.051 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T00:17:59.051 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000338747 s, 1.5 MB/s 2024-09-12T00:17:59.052 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:17:59.102 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T00:17:59.102 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T00:17:59.102 INFO:tasks.ceph:Generating config... 2024-09-12T00:17:59.103 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T00:17:59.103 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-12T00:17:59.104 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:17:59.104 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:17:59.104 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:17:59.104 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:17:59.105 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:17:59.105 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:17:59.105 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:17:59.105 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:17:59.105 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:17:59.105 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:17:59.105 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:17:59.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:17:59.141 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:17:59.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:17:59.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:59.287 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31')] 2024-09-12T00:17:59.287 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-12T00:17:59.288 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:59.288 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:17:59.336 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:59.416 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:59.417 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:59.417 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:59.417 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid 9e56bc75-e06d-484a-a616-57879b8b0bec 2024-09-12T00:17:59.417 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-09-12T00:17:59.417 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:fsid 9e56bc75-e06d-484a-a616-57879b8b0bec 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-09-12T00:17:59.421301+0000 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-12T00:17:59.421301+0000 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-09-12T00:17:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-12T00:17:59.420 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:17:59.467 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9e56bc75-e06d-484a-a616-57879b8b0bec... 2024-09-12T00:17:59.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:17:59.512 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-12T00:17:59.541 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:17:59.542 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-12T00:17:59.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = 172.21.15.31 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 9e56bc75-e06d-484a-a616-57879b8b0bec 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.544 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-12T00:17:59.545 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.546 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: debug objclass = 20 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-12T00:17:59.547 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-12T00:17:59.548 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-12T00:17:59.549 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:17:59.550 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:17:59.551 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout: rgw gc obj min wait = 15 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout: debug rgw = 20 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout: setgroup = ceph 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout: setuser = ceph 2024-09-12T00:17:59.552 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2024-09-12T00:17:59.553 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.554 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:17:59.555 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.556 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = 172.21.15.31 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 9e56bc75-e06d-484a-a616-57879b8b0bec 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.557 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:17:59.558 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: debug objclass = 20 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: bdev async discard = True 2024-09-12T00:17:59.559 INFO:teuthology.orchestra.run.smithi066.stdout: bdev enable discard = True 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore allocator = bitmap 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 1/20 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 1/20 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 4/10 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2024-09-12T00:17:59.560 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T00:17:59.561 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:17:59.562 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2024-09-12T00:17:59.563 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: rgw gc obj min wait = 15 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: debug rgw = 20 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: setgroup = ceph 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout: setuser = ceph 2024-09-12T00:17:59.564 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2024-09-12T00:17:59.566 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:17:59.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:17:59.658 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:17:59.658 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:59.658 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:17:59.664 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:59.664 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:17:59.711 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-09-12T00:17:59.711 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:59.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:17:59.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:59.777 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:17:59.777 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:59.823 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:17:59.823 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:59.824 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:17:59.824 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:59.848 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:17:59.848 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:59.941 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:17:59.942 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:17:59.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:18:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:18:00.042 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:18:00.042 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:18:00.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:18:00.119 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:18:00.131 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:18:00.131 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T00:18:00.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:18:00.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T00:18:00.145 INFO:tasks.ceph:role: osd.0 2024-09-12T00:18:00.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-12T00:18:00.146 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:18:00.211 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:18:00.211 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:18:00.212 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:18:00.665 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-12T00:18:00.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-12T00:18:00.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:18:00.756 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:18:00.766 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:18:00.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:18:00.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:18:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:00.881+0000 7f2d891f07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:18:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:00.885+0000 7f2d891f07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:18:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:00.885+0000 7f2d891f07c0 -1 bdev(0x5597c4d13800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:18:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:00.885+0000 7f2d891f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:18:04.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:18:04.070 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:18:04.085 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T00:18:04.085 INFO:tasks.ceph:role: osd.1 2024-09-12T00:18:04.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:18:04.085 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:18:04.148 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:18:04.148 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:18:04.148 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:18:04.149 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:18:04.601 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-09-12T00:18:04.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-09-12T00:18:04.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T00:18:04.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:18:04.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:18:04.713 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:18:04.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:18:04.765 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T00:18:04.765 INFO:tasks.ceph:role: osd.2 2024-09-12T00:18:04.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:18:04.766 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:18:04.827 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:18:04.827 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:18:04.827 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:18:04.827 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:18:04.828 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:18:05.300 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-09-12T00:18:05.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-09-12T00:18:05.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-12T00:18:05.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:18:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:18:05.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:18:05.464 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:18:05.520 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T00:18:05.520 INFO:tasks.ceph:role: osd.3 2024-09-12T00:18:05.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:18:05.520 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:18:05.583 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:18:05.583 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:18:05.583 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:18:05.583 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:18:05.583 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:18:05.584 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:18:05.584 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:18:05.584 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:18:05.584 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:18:05.584 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:18:06.070 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2024-09-12T00:18:06.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2024-09-12T00:18:06.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-12T00:18:06.211 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:18:06.222 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:18:06.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:18:06.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:18:06.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:06.346+0000 7f9b7b3b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:18:06.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:06.346+0000 7f9b7b3b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:18:06.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:06.346+0000 7f9b7b3b77c0 -1 bdev(0x5629f7919800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:18:06.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:06.350+0000 7f9b7b3b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:18:09.497 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:18:09.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:18:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:09.590+0000 7fc9d8a517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:18:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:09.594+0000 7fc9d8a517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:18:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:09.594+0000 7fc9d8a517c0 -1 bdev(0x560e1933b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:18:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:09.594+0000 7fc9d8a517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:18:12.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:18:12.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:18:12.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:12.866+0000 7fa7868517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:18:12.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:12.866+0000 7fa7868517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:18:12.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:12.866+0000 7fa7868517c0 -1 bdev(0x55b5a5b65800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:18:12.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:12.866+0000 7fa7868517c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:18:15.995 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:18:16.053 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:18:16.054 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:18:16.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:18:16.068 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:16.068 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:18:16.107 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:16.107 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:18:16.163 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:16.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:18:16.215 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:16.215 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:18:16.271 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:16.271 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:18:16.321 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:18:16.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:18:16.333 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-09-12T00:18:16.333 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQA4M+JmvHjSNBAAN2a3tv67JXlaLiUATmpRrQ== 2024-09-12T00:18:16.333 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQA4M+JmBUmoARAAgypo4g9lLy80zujh6Ql4qg== 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQA+M+JmVXn3FBAAYc3YHONEPqbTl1j/THOWug== 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBBM+JmhyWHIxAAJkLsG6AfC7aNZJSSEV3+ww== 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBEM+Jmpq3RMxAAobaNusuU5M081mPdMNT8KA== 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-12T00:18:16.334 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQA4M+JmN3gcBxAAGvKtp+HceieiMMdgG/vHpA== 2024-09-12T00:18:16.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:18:16.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:18:16.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:18:16.592 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:18:16.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:18:16.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:18:16.856 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:18:16.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:18:16.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:18:16.959 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:18:16.969 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:18:17.014 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:18:17.015 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:18:17.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:18:17.059 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:18:17.059 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:18:17.060 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:18:17.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:18:17.063 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:18:17.063 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:18:17.063 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:18:17.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:18:17.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4bb5f07640 1 Processor -- start 2024-09-12T00:18:17.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4bb5f07640 1 -- start start 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4bb5f07640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4bb5f07640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb0098bc0 con 0x7f4bb0097210 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4bb5f07640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb0097af0 con 0x7f4bb00968f0 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baf7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4bb0097210 0x7f4bb012be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57744/0 (socket says 172.21.15.31:57744) 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baeffd640 1 -- 172.21.15.31:0/2528960976 learned_addr learned my addr 172.21.15.31:0/2528960976 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baf7fe640 1 -- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 msgr2=0x7f4bb0096cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baf7fe640 1 -- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 msgr2=0x7f4bb0096cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baf7fe640 1 --2- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T00:18:17.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.189+0000 7f4baf7fe640 1 --2- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493522686 0 0) 0x7f4bb0098bc0 con 0x7f4bb0097210 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b98005740 con 0x7f4bb0097210 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951220995 0 0) 0x7f4b98005740 con 0x7f4bb0097210 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 msgr2=0x7f4bb0096cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 --2- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb00988b0 con 0x7f4bb0097210 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 271743035 0 0) 0x7f4ba4001630 con 0x7f4bb0097210 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 >> v1:172.21.15.31:6789/0 conn(0x7f4bb0097210 legacy=0x7f4bb012be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 --2- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4b98006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0097af0 con 0x7f4b98005c70 2024-09-12T00:18:17.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4baf7fe640 1 --2- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4b98006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.193+0000 7f4baf7fe640 1 -- 172.21.15.31:0/2528960976 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b98005740 con 0x7f4b98005c70 2024-09-12T00:18:17.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4baf7fe640 1 --2- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4b98006070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c7a0 tx=0x7f4ba001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705930781d97262c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba000f040 con 0x7f4b98005c70 2024-09-12T00:18:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00b0070 con 0x7f4b98005c70 2024-09-12T00:18:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bae7fc640 1 -- 172.21.15.31:0/2528960976 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00ab700 con 0x7f4b98005c70 2024-09-12T00:18:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 msgr2=0x7f4b98006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 --2- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4b98006070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000c7a0 tx=0x7f4ba001c5d0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2528960976 shutdown_connections 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 --2- 172.21.15.31:0/2528960976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4b98006070 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 --2- 172.21.15.31:0/2528960976 >> v2:172.21.15.31:3300/0 conn(0x7f4bb00968f0 0x7f4bb0096cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2528960976 >> 172.21.15.31:0/2528960976 conn(0x7f4bb009cf70 msgr2=0x7f4bb009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2528960976 shutdown_connections 2024-09-12T00:18:17.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.213+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2528960976 wait complete. 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 Processor -- start 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 -- start start 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb006e880 con 0x7f4b98005c70 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50712/0 (socket says 172.21.15.31:50712) 2024-09-12T00:18:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4baf7fe640 1 -- 172.21.15.31:0/2146325174 learned_addr learned my addr 172.21.15.31:0/2146325174 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4baf7fe640 1 -- 172.21.15.31:0/2146325174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb01267a0 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4baf7fe640 1 --2- 172.21.15.31:0/2146325174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ad040 tx=0x7f4b98007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00c2070 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba00abb60 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ba00bd410 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb01271f0 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb0125130 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ba00c5070 con 0x7f4b98005c70 2024-09-12T00:18:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4ba00ba070 con 0x7f4b98005c70 2024-09-12T00:18:17.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.217+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb0127d00 con 0x7f4b98005c70 2024-09-12T00:18:17.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.221+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4ba00cc020 con 0x7f4b98005c70 2024-09-12T00:18:17.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.285+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4bb01273c0 con 0x7f4b98005c70 2024-09-12T00:18:17.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4b97fff640 1 -- 172.21.15.31:0/2146325174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f4ba00161c0 con 0x7f4b98005c70 2024-09-12T00:18:17.286 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 msgr2=0x7f4bb0124a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 --2- 172.21.15.31:0/2146325174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ad040 tx=0x7f4b98007a50 comp rx=0 tx=0).stop 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 shutdown_connections 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 --2- 172.21.15.31:0/2146325174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b98005c70 0x7f4bb0124a20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 >> 172.21.15.31:0/2146325174 conn(0x7f4bb009cf70 msgr2=0x7f4bb009aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 shutdown_connections 2024-09-12T00:18:17.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:17.289+0000 7f4bb5f07640 1 -- 172.21.15.31:0/2146325174 wait complete. 2024-09-12T00:18:17.305 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:18:17.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:18:17.305 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-12T00:18:17.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:18:17.318 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:17.318 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:18:17.333 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:17.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:18:17.386 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T00:18:17.386 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:18:17.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 65e1d3c3-176c-4471-8ee3-862fc2551683 0 2024-09-12T00:18:17.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4e05c5640 1 Processor -- start 2024-09-12T00:18:17.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4e05c5640 1 -- start start 2024-09-12T00:18:17.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4e05c5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4d8111060 0x7fe4d8111440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4e05c5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d8111b60 con 0x7fe4d81164f0 2024-09-12T00:18:17.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4e05c5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d8117090 con 0x7fe4d8111060 2024-09-12T00:18:17.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4de361640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4d8111060 0x7fe4d8111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4de361640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4d8111060 0x7fe4d8111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:39964/0 (socket says 172.21.15.66:39964) 2024-09-12T00:18:17.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.602+0000 7fe4de361640 1 -- 172.21.15.66:0/2672499095 learned_addr learned my addr 172.21.15.66:0/2672499095 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:17.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4de361640 1 -- 172.21.15.66:0/2672499095 >> v1:172.21.15.31:6789/0 conn(0x7fe4d81164f0 legacy=0x7fe4d8116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4de361640 1 -- 172.21.15.66:0/2672499095 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d8117240 con 0x7fe4d8111060 2024-09-12T00:18:17.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4de361640 1 --2- 172.21.15.66:0/2672499095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d8111440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009e50 tx=0x7fe4d001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83d4cc2a002c38b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4dd35f640 1 -- 172.21.15.66:0/2672499095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0009200 con 0x7fe4d8111060 2024-09-12T00:18:17.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4dd35f640 1 -- 172.21.15.66:0/2672499095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d00a57e0 con 0x7fe4d8111060 2024-09-12T00:18:17.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4dd35f640 1 -- 172.21.15.66:0/2672499095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d00a5ae0 con 0x7fe4d8111060 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 -- 172.21.15.66:0/2672499095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 msgr2=0x7fe4d8111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 --2- 172.21.15.66:0/2672499095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d8111440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009e50 tx=0x7fe4d001c980 comp rx=0 tx=0).stop 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 -- 172.21.15.66:0/2672499095 shutdown_connections 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 --2- 172.21.15.66:0/2672499095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d8111440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 -- 172.21.15.66:0/2672499095 >> 172.21.15.66:0/2672499095 conn(0x7fe4d8071e50 msgr2=0x7fe4d8074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 -- 172.21.15.66:0/2672499095 shutdown_connections 2024-09-12T00:18:17.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.606+0000 7fe4e05c5640 1 -- 172.21.15.66:0/2672499095 wait complete. 2024-09-12T00:18:17.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 Processor -- start 2024-09-12T00:18:17.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 -- start start 2024-09-12T00:18:17.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d811f260 con 0x7fe4d8111060 2024-09-12T00:18:17.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4de361640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4de361640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:39972/0 (socket says 172.21.15.66:39972) 2024-09-12T00:18:17.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4de361640 1 -- 172.21.15.66:0/1548310853 learned_addr learned my addr 172.21.15.66:0/1548310853 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:17.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4de361640 1 -- 172.21.15.66:0/1548310853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d81aa410 con 0x7fe4d8111060 2024-09-12T00:18:17.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4de361640 1 --2- 172.21.15.66:0/1548310853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4d001a5b0 tx=0x7fe4d0019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d00bc020 con 0x7fe4d8111060 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d0007a60 con 0x7fe4d8111060 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d0007d40 con 0x7fe4d8111060 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d81aa6a0 con 0x7fe4d8111060 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d81af700 con 0x7fe4d8111060 2024-09-12T00:18:17.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4d00bf020 con 0x7fe4d8111060 2024-09-12T00:18:17.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe4d00b6750 con 0x7fe4d8111060 2024-09-12T00:18:17.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.610+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d81114c0 con 0x7fe4d8111060 2024-09-12T00:18:17.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.618+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe4d00c6030 con 0x7fe4d8111060 2024-09-12T00:18:17.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65e1d3c3-176c-4471-8ee3-862fc2551683", "id": 0} v 0) -- 0x7fe4d81164f0 con 0x7fe4d8111060 2024-09-12T00:18:17.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4ceffd640 1 -- 172.21.15.66:0/1548310853 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65e1d3c3-176c-4471-8ee3-862fc2551683", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe4d0016600 con 0x7fe4d8111060 2024-09-12T00:18:17.694 INFO:teuthology.orchestra.run.smithi066.stdout:0 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 msgr2=0x7fe4d81a9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 --2- 172.21.15.66:0/1548310853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4d001a5b0 tx=0x7fe4d0019720 comp rx=0 tx=0).stop 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 shutdown_connections 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 --2- 172.21.15.66:0/1548310853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4d8111060 0x7fe4d81a9e40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 >> 172.21.15.66:0/1548310853 conn(0x7fe4d8071e50 msgr2=0x7fe4d8112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.690+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 shutdown_connections 2024-09-12T00:18:17.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.694+0000 7fe4e05c5640 1 -- 172.21.15.66:0/1548310853 wait complete. 2024-09-12T00:18:17.711 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new a399a405-fbce-4b58-abcd-9d6deb8bc985 1 2024-09-12T00:18:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62e6225640 1 Processor -- start 2024-09-12T00:18:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62e6225640 1 -- start start 2024-09-12T00:18:17.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62e6225640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62e0111bb0 0x7f62e006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62e6225640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e006e0c0 con 0x7f62e01116e0 2024-09-12T00:18:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62e6225640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f62e011f420 con 0x7f62e0111bb0 2024-09-12T00:18:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62e0111bb0 0x7f62e006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62e0111bb0 0x7f62e006da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:39988/0 (socket says 172.21.15.66:39988) 2024-09-12T00:18:17.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 -- 172.21.15.66:0/3287027363 learned_addr learned my addr 172.21.15.66:0/3287027363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62df7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f62e01116e0 0x7f62e006d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:54918/0 (socket says 172.21.15.66:54918) 2024-09-12T00:18:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 -- 172.21.15.66:0/3287027363 >> v1:172.21.15.31:6789/0 conn(0x7f62e01116e0 legacy=0x7f62e006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 -- 172.21.15.66:0/3287027363 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e011f5a0 con 0x7f62e0111bb0 2024-09-12T00:18:17.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.822+0000 7f62d6ffd640 1 --2- 172.21.15.66:0/3287027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e0111bb0 0x7f62e006da40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f6884fc904c3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62deffd640 1 -- 172.21.15.66:0/3287027363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c80ab580 con 0x7f62e0111bb0 2024-09-12T00:18:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62deffd640 1 -- 172.21.15.66:0/3287027363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c80b0070 con 0x7f62e0111bb0 2024-09-12T00:18:17.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62deffd640 1 -- 172.21.15.66:0/3287027363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c80ab870 con 0x7f62e0111bb0 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/3287027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e0111bb0 msgr2=0x7f62e006da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 --2- 172.21.15.66:0/3287027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e0111bb0 0x7f62e006da40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c801c430 comp rx=0 tx=0).stop 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/3287027363 shutdown_connections 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 --2- 172.21.15.66:0/3287027363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e0111bb0 0x7f62e006da40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/3287027363 >> 172.21.15.66:0/3287027363 conn(0x7f62e0070d20 msgr2=0x7f62e0073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/3287027363 shutdown_connections 2024-09-12T00:18:17.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/3287027363 wait complete. 2024-09-12T00:18:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 Processor -- start 2024-09-12T00:18:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- start start 2024-09-12T00:18:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f62e011f100 con 0x7f62e01116e0 2024-09-12T00:18:17.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:40004/0 (socket says 172.21.15.66:40004) 2024-09-12T00:18:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62df7fe640 1 -- 172.21.15.66:0/273701557 learned_addr learned my addr 172.21.15.66:0/273701557 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62df7fe640 1 -- 172.21.15.66:0/273701557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e01aa420 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62df7fe640 1 --2- 172.21.15.66:0/273701557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c450 tx=0x7f62d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d0007410 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d00075b0 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d0004960 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e01aa710 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e01af8e0 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.826+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62d001a020 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.830+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f62d001c9a0 con 0x7f62e01116e0 2024-09-12T00:18:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.830+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e0069170 con 0x7f62e01116e0 2024-09-12T00:18:17.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.834+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f62e0069170 con 0x7f62e01116e0 2024-09-12T00:18:17.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.906+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a399a405-fbce-4b58-abcd-9d6deb8bc985", "id": 1} v 0) -- 0x7f62e01aaa50 con 0x7f62e01116e0 2024-09-12T00:18:17.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.906+0000 7f62dcff9640 1 -- 172.21.15.66:0/273701557 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a399a405-fbce-4b58-abcd-9d6deb8bc985", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f62d0021070 con 0x7f62e01116e0 2024-09-12T00:18:17.911 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-09-12T00:18:17.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 msgr2=0x7f62e01a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:17.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 --2- 172.21.15.66:0/273701557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62d000c450 tx=0x7f62d000c910 comp rx=0 tx=0).stop 2024-09-12T00:18:17.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 shutdown_connections 2024-09-12T00:18:17.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 --2- 172.21.15.66:0/273701557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e01116e0 0x7f62e01a9e50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:17.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 >> 172.21.15.66:0/273701557 conn(0x7f62e0070d20 msgr2=0x7f62e0118460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:17.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 shutdown_connections 2024-09-12T00:18:17.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:17.910+0000 7f62e6225640 1 -- 172.21.15.66:0/273701557 wait complete. 2024-09-12T00:18:17.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new dc526bb4-7a5b-4039-aa96-e5f704645a0e 2 2024-09-12T00:18:18.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b87a3640 1 Processor -- start 2024-09-12T00:18:18.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b87a3640 1 -- start start 2024-09-12T00:18:18.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b87a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95b0074b30 0x7f95b010fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b87a3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b00750b0 con 0x7f95b01102d0 2024-09-12T00:18:18.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b87a3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f95b0110740 con 0x7f95b0074b30 2024-09-12T00:18:18.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b653f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95b0074b30 0x7f95b010fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b653f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95b0074b30 0x7f95b010fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:40008/0 (socket says 172.21.15.66:40008) 2024-09-12T00:18:18.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.038+0000 7f95b653f640 1 -- 172.21.15.66:0/3927471185 learned_addr learned my addr 172.21.15.66:0/3927471185 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:18.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b653f640 1 -- 172.21.15.66:0/3927471185 >> v1:172.21.15.31:6789/0 conn(0x7f95b01102d0 legacy=0x7f95b011b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b653f640 1 -- 172.21.15.66:0/3927471185 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b01108c0 con 0x7f95b0074b30 2024-09-12T00:18:18.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b653f640 1 --2- 172.21.15.66:0/3927471185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b010fd90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95a00097f0 tx=0x7f95a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144f5d897bcebcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b553d640 1 -- 172.21.15.66:0/3927471185 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a00ab560 con 0x7f95b0074b30 2024-09-12T00:18:18.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b553d640 1 -- 172.21.15.66:0/3927471185 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a00b0070 con 0x7f95b0074b30 2024-09-12T00:18:18.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b553d640 1 -- 172.21.15.66:0/3927471185 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a00ab850 con 0x7f95b0074b30 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 -- 172.21.15.66:0/3927471185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 msgr2=0x7f95b010fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 --2- 172.21.15.66:0/3927471185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b010fd90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95a00097f0 tx=0x7f95a001c410 comp rx=0 tx=0).stop 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 -- 172.21.15.66:0/3927471185 shutdown_connections 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 --2- 172.21.15.66:0/3927471185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b010fd90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 -- 172.21.15.66:0/3927471185 >> 172.21.15.66:0/3927471185 conn(0x7f95b0070390 msgr2=0x7f95b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 -- 172.21.15.66:0/3927471185 shutdown_connections 2024-09-12T00:18:18.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.042+0000 7f95b87a3640 1 -- 172.21.15.66:0/3927471185 wait complete. 2024-09-12T00:18:18.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 Processor -- start 2024-09-12T00:18:18.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 -- start start 2024-09-12T00:18:18.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95b011f4d0 con 0x7f95b0074b30 2024-09-12T00:18:18.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b653f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b653f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:40020/0 (socket says 172.21.15.66:40020) 2024-09-12T00:18:18.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b653f640 1 -- 172.21.15.66:0/1379593557 learned_addr learned my addr 172.21.15.66:0/1379593557 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:18.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b653f640 1 -- 172.21.15.66:0/1379593557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b01a8550 con 0x7f95b0074b30 2024-09-12T00:18:18.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b653f640 1 --2- 172.21.15.66:0/1379593557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95a0019020 tx=0x7f95a001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a00b4600 con 0x7f95b0074b30 2024-09-12T00:18:18.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b01a87e0 con 0x7f95b0074b30 2024-09-12T00:18:18.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a00b47c0 con 0x7f95b0074b30 2024-09-12T00:18:18.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a00b4ae0 con 0x7f95b0074b30 2024-09-12T00:18:18.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b01ad7c0 con 0x7f95b0074b30 2024-09-12T00:18:18.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95a00c77d0 con 0x7f95b0074b30 2024-09-12T00:18:18.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f95a00a8050 con 0x7f95b0074b30 2024-09-12T00:18:18.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.046+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b010fe10 con 0x7f95b0074b30 2024-09-12T00:18:18.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.054+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f95a0016090 con 0x7f95b0074b30 2024-09-12T00:18:18.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.122+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc526bb4-7a5b-4039-aa96-e5f704645a0e", "id": 2} v 0) -- 0x7f95b01102d0 con 0x7f95b0074b30 2024-09-12T00:18:18.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95a6ffd640 1 -- 172.21.15.66:0/1379593557 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc526bb4-7a5b-4039-aa96-e5f704645a0e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f95a00b4cd0 con 0x7f95b0074b30 2024-09-12T00:18:18.129 INFO:teuthology.orchestra.run.smithi066.stdout:2 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 msgr2=0x7f95b01a7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 --2- 172.21.15.66:0/1379593557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95a0019020 tx=0x7f95a001ac50 comp rx=0 tx=0).stop 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 shutdown_connections 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 --2- 172.21.15.66:0/1379593557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95b0074b30 0x7f95b01a7f80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 >> 172.21.15.66:0/1379593557 conn(0x7f95b0070390 msgr2=0x7f95b0114500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 shutdown_connections 2024-09-12T00:18:18.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.126+0000 7f95b87a3640 1 -- 172.21.15.66:0/1379593557 wait complete. 2024-09-12T00:18:18.146 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 964c4d70-5f2c-4c85-9767-03529a7afd7b 3 2024-09-12T00:18:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6360c59640 1 Processor -- start 2024-09-12T00:18:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6360c59640 1 -- start start 2024-09-12T00:18:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6360c59640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f635c074bd0 0x7f635c10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6360c59640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c110740 con 0x7f635c1102d0 2024-09-12T00:18:18.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6360c59640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f635c110910 con 0x7f635c074bd0 2024-09-12T00:18:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f635a59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f635c074bd0 0x7f635c10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6359d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f635c1102d0 0x7f635c11b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:54932/0 (socket says 172.21.15.66:54932) 2024-09-12T00:18:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f6359d9b640 1 -- 172.21.15.66:0/141664579 learned_addr learned my addr 172.21.15.66:0/141664579 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:18:18.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f635a59c640 1 -- 172.21.15.66:0/141664579 >> v1:172.21.15.31:6789/0 conn(0x7f635c1102d0 legacy=0x7f635c11b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.262+0000 7f635a59c640 1 -- 172.21.15.66:0/141664579 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c110ac0 con 0x7f635c074bd0 2024-09-12T00:18:18.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635a59c640 1 --2- 172.21.15.66:0/141664579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c10fd90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f634c009740 tx=0x7f634c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aecfd038e01baa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635959a640 1 -- 172.21.15.66:0/141664579 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c0b1070 con 0x7f635c074bd0 2024-09-12T00:18:18.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635959a640 1 -- 172.21.15.66:0/141664579 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c0ac570 con 0x7f635c074bd0 2024-09-12T00:18:18.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635959a640 1 -- 172.21.15.66:0/141664579 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c0ac870 con 0x7f635c074bd0 2024-09-12T00:18:18.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- 172.21.15.66:0/141664579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 msgr2=0x7f635c10fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 --2- 172.21.15.66:0/141664579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c10fd90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f634c009740 tx=0x7f634c01c400 comp rx=0 tx=0).stop 2024-09-12T00:18:18.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- 172.21.15.66:0/141664579 shutdown_connections 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 --2- 172.21.15.66:0/141664579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c10fd90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- 172.21.15.66:0/141664579 >> 172.21.15.66:0/141664579 conn(0x7f635c070390 msgr2=0x7f635c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- 172.21.15.66:0/141664579 shutdown_connections 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- 172.21.15.66:0/141664579 wait complete. 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 Processor -- start 2024-09-12T00:18:18.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- start start 2024-09-12T00:18:18.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f6360c59640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f635c11f4a0 con 0x7f635c074bd0 2024-09-12T00:18:18.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:40034/0 (socket says 172.21.15.66:40034) 2024-09-12T00:18:18.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635a59c640 1 -- 172.21.15.66:0/77415828 learned_addr learned my addr 172.21.15.66:0/77415828 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:18.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.266+0000 7f635a59c640 1 -- 172.21.15.66:0/77415828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c1a8430 con 0x7f635c074bd0 2024-09-12T00:18:18.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f635a59c640 1 --2- 172.21.15.66:0/77415828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f634c01a030 tx=0x7f634c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c0b1050 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c0b2040 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c1a86c0 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c0aaae0 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c1ad6a0 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f634c0bf030 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f634c0bd070 con 0x7f635c074bd0 2024-09-12T00:18:18.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.270+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c10fd90 con 0x7f635c074bd0 2024-09-12T00:18:18.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.274+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f634c0c6020 con 0x7f635c074bd0 2024-09-12T00:18:18.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.346+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "964c4d70-5f2c-4c85-9767-03529a7afd7b", "id": 3} v 0) -- 0x7f635c1102d0 con 0x7f635c074bd0 2024-09-12T00:18:18.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f634affd640 1 -- 172.21.15.66:0/77415828 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "964c4d70-5f2c-4c85-9767-03529a7afd7b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f634c015ff0 con 0x7f635c074bd0 2024-09-12T00:18:18.353 INFO:teuthology.orchestra.run.smithi066.stdout:3 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 msgr2=0x7f635c1a7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 --2- 172.21.15.66:0/77415828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f634c01a030 tx=0x7f634c01ac40 comp rx=0 tx=0).stop 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 shutdown_connections 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 --2- 172.21.15.66:0/77415828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f635c074bd0 0x7f635c1a7e60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 >> 172.21.15.66:0/77415828 conn(0x7f635c070390 msgr2=0x7f635c1186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 shutdown_connections 2024-09-12T00:18:18.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:18.350+0000 7f6360c59640 1 -- 172.21.15.66:0/77415828 wait complete. 2024-09-12T00:18:18.372 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:18:18.373 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:18:18.375 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:18:18.375 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:18:18.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:18:18.377 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:18:18.377 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:18:18.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:18:18.379 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:18:18.379 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:18:18.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:18:18.382 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:18:18.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.505+0000 7f0239e74640 1 Processor -- start 2024-09-12T00:18:18.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.505+0000 7f0239e74640 1 -- start start 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0234132420 0x7f0234134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023412b9d0 con 0x7f023412aee0 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0234071e70 con 0x7f0234132420 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0234132420 0x7f0234134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0234132420 0x7f0234134810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50724/0 (socket says 172.21.15.31:50724) 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 -- 172.21.15.31:0/743727532 learned_addr learned my addr 172.21.15.31:0/743727532 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f02337fe640 1 --1- 172.21.15.31:0/743727532 >> v1:172.21.15.31:6789/0 conn(0x7f023412aee0 0x7f023412b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57764/0 (socket says 172.21.15.31:57764) 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 -- 172.21.15.31:0/743727532 >> v1:172.21.15.31:6789/0 conn(0x7f023412aee0 legacy=0x7f023412b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 -- 172.21.15.31:0/743727532 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340008e0 con 0x7f0234132420 2024-09-12T00:18:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f02327fc640 1 -- 172.21.15.31:0/743727532 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658690410 0 0) 0x7f023412b9d0 con 0x7f023412aee0 2024-09-12T00:18:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0232ffd640 1 --2- 172.21.15.31:0/743727532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0234132420 0x7f0234134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02280097f0 tx=0x7f022801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a252edd15e27d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f02327fc640 1 -- 172.21.15.31:0/743727532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02280ab580 con 0x7f0234132420 2024-09-12T00:18:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f02327fc640 1 -- 172.21.15.31:0/743727532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02280b0070 con 0x7f0234132420 2024-09-12T00:18:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f02327fc640 1 -- 172.21.15.31:0/743727532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02280ab870 con 0x7f0234132420 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 -- 172.21.15.31:0/743727532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0234132420 msgr2=0x7f0234134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 --2- 172.21.15.31:0/743727532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0234132420 0x7f0234134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02280097f0 tx=0x7f022801c430 comp rx=0 tx=0).stop 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 -- 172.21.15.31:0/743727532 shutdown_connections 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 --2- 172.21.15.31:0/743727532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0234132420 0x7f0234134810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.509+0000 7f0239e74640 1 -- 172.21.15.31:0/743727532 >> 172.21.15.31:0/743727532 conn(0x7f02340a0a60 msgr2=0x7f023406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- 172.21.15.31:0/743727532 shutdown_connections 2024-09-12T00:18:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- 172.21.15.31:0/743727532 wait complete. 2024-09-12T00:18:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 Processor -- start 2024-09-12T00:18:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- start start 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0234137570 con 0x7f023412aee0 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f02337fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f02337fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50740/0 (socket says 172.21.15.31:50740) 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f02337fe640 1 -- 172.21.15.31:0/3477436812 learned_addr learned my addr 172.21.15.31:0/3477436812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f02337fe640 1 -- 172.21.15.31:0/3477436812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023411ce20 con 0x7f023412aee0 2024-09-12T00:18:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f02337fe640 1 --2- 172.21.15.31:0/3477436812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3d0 tx=0x7f022400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224007410 con 0x7f023412aee0 2024-09-12T00:18:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02240075d0 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224004960 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023411b820 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0234129d60 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0224011070 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f022401d5d0 con 0x7f023412aee0 2024-09-12T00:18:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.513+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023411be20 con 0x7f023412aee0 2024-09-12T00:18:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.517+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f022401d7d0 con 0x7f023412aee0 2024-09-12T00:18:18.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f023412b2c0 con 0x7f023412aee0 2024-09-12T00:18:18.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f021bfff640 1 -- 172.21.15.31:0/3477436812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f0224004b00 con 0x7f023412aee0 2024-09-12T00:18:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:18.356100+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:18.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 msgr2=0x7f0234129650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:18.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 --2- 172.21.15.31:0/3477436812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3d0 tx=0x7f022400c890 comp rx=0 tx=0).stop 2024-09-12T00:18:18.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 shutdown_connections 2024-09-12T00:18:18.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 --2- 172.21.15.31:0/3477436812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023412aee0 0x7f0234129650 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:18.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 >> 172.21.15.31:0/3477436812 conn(0x7f02340a0a60 msgr2=0x7f02340a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:18.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 shutdown_connections 2024-09-12T00:18:18.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:18.577+0000 7f0239e74640 1 -- 172.21.15.31:0/3477436812 wait complete. 2024-09-12T00:18:18.594 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:18:18.594 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:18:18.997 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:19.125 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.125+0000 7f2933be1640 1 Processor -- start 2024-09-12T00:18:19.126 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.125+0000 7f2933be1640 1 -- start start 2024-09-12T00:18:19.126 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.125+0000 7f2933be1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f292c132520 0x7f292c134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:19.126 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292c12bc50 con 0x7f292c12bfe0 2024-09-12T00:18:19.126 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f292c0691a0 con 0x7f292c132520 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293117c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f292c132520 0x7f292c134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293197d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f292c12bfe0 0x7f292c12c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57776/0 (socket says 172.21.15.31:57776) 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293197d640 1 -- 172.21.15.31:0/215362191 learned_addr learned my addr 172.21.15.31:0/215362191 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293117c640 1 -- 172.21.15.31:0/215362191 >> v1:172.21.15.31:6789/0 conn(0x7f292c12bfe0 legacy=0x7f292c12c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293117c640 1 -- 172.21.15.31:0/215362191 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c073870 con 0x7f292c132520 2024-09-12T00:18:19.127 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293097b640 1 -- 172.21.15.31:0/215362191 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898905293 0 0) 0x7f292c12bc50 con 0x7f292c12bfe0 2024-09-12T00:18:19.128 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293117c640 1 --2- 172.21.15.31:0/215362191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c132520 0x7f292c134910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f291c009740 tx=0x7f291c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded1910625cdb46d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:19.128 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293097b640 1 -- 172.21.15.31:0/215362191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c0b0070 con 0x7f292c132520 2024-09-12T00:18:19.129 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293097b640 1 -- 172.21.15.31:0/215362191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c0ab530 con 0x7f292c132520 2024-09-12T00:18:19.129 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f293097b640 1 -- 172.21.15.31:0/215362191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f291c0ab830 con 0x7f292c132520 2024-09-12T00:18:19.129 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- 172.21.15.31:0/215362191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c132520 msgr2=0x7f292c134910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 --2- 172.21.15.31:0/215362191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c132520 0x7f292c134910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f291c009740 tx=0x7f291c01c400 comp rx=0 tx=0).stop 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- 172.21.15.31:0/215362191 shutdown_connections 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 --2- 172.21.15.31:0/215362191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c132520 0x7f292c134910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- 172.21.15.31:0/215362191 >> 172.21.15.31:0/215362191 conn(0x7f292c070630 msgr2=0x7f292c072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- 172.21.15.31:0/215362191 shutdown_connections 2024-09-12T00:18:19.130 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.129+0000 7f2933be1640 1 -- 172.21.15.31:0/215362191 wait complete. 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 Processor -- start 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 -- start start 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f292c1377f0 con 0x7f292c12bfe0 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f293197d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f293197d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50756/0 (socket says 172.21.15.31:50756) 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f293197d640 1 -- 172.21.15.31:0/2167529768 learned_addr learned my addr 172.21.15.31:0/2167529768 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f293197d640 1 -- 172.21.15.31:0/2167529768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c117600 con 0x7f292c12bfe0 2024-09-12T00:18:19.132 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f293197d640 1 --2- 172.21.15.31:0/2167529768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f292800c7f0 tx=0x7f292800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2928018070 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2928004d80 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c1186c0 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292800a7b0 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1253c0 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f292801b070 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f29280078d0 con 0x7f292c12bfe0 2024-09-12T00:18:19.133 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.133+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c12c3c0 con 0x7f292c12bfe0 2024-09-12T00:18:19.134 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.137+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2928022070 con 0x7f292c12bfe0 2024-09-12T00:18:19.194 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f292c131970 con 0x7f292c12bfe0 2024-09-12T00:18:19.195 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f29227fc640 1 -- 172.21.15.31:0/2167529768 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f29280071e0 con 0x7f292c12bfe0 2024-09-12T00:18:19.195 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-12T00:18:19.195 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":6,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:18.356100+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:19.196 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 msgr2=0x7f292c124e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:19.196 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 --2- 172.21.15.31:0/2167529768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f292800c7f0 tx=0x7f292800ccb0 comp rx=0 tx=0).stop 2024-09-12T00:18:19.196 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 shutdown_connections 2024-09-12T00:18:19.196 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 --2- 172.21.15.31:0/2167529768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f292c12bfe0 0x7f292c124e80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:19.196 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 >> 172.21.15.31:0/2167529768 conn(0x7f292c070630 msgr2=0x7f292c129ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:19.197 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 shutdown_connections 2024-09-12T00:18:19.197 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:19.197+0000 7f2933be1640 1 -- 172.21.15.31:0/2167529768 wait complete. 2024-09-12T00:18:19.212 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T00:18:19.732 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-12T00:18:19.733+0000 7f8b40db07c0 -1 Falling back to public interface 2024-09-12T00:18:19.769 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-09-12T00:18:19.766+0000 7f6030f0f7c0 -1 Falling back to public interface 2024-09-12T00:18:19.941 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-09-12T00:18:19.938+0000 7f7f248d67c0 -1 Falling back to public interface 2024-09-12T00:18:20.244 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-09-12T00:18:20.242+0000 7febeea637c0 -1 Falling back to public interface 2024-09-12T00:18:20.474 INFO:tasks.ceph.mgr.x.smithi066.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:18:20.474 INFO:tasks.ceph.mgr.x.smithi066.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:18:20.474 INFO:tasks.ceph.mgr.x.smithi066.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:18:23.503 INFO:tasks.ceph.mgr.x.smithi066.stderr:2024-09-12T00:18:23.498+0000 7feebc410640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-12T00:18:23.592 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-12T00:18:23.593+0000 7f8b40db07c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:18:23.981 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-09-12T00:18:23.978+0000 7f6030f0f7c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:18:23.999 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-09-12T00:18:23.998+0000 7f7f248d67c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:18:24.198 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-09-12T00:18:24.194+0000 7febeea637c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:18:25.615 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:25.735 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff5354ae640 1 Processor -- start 2024-09-12T00:18:25.735 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff5354ae640 1 -- start start 2024-09-12T00:18:25.736 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff5354ae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff53012f710 0x7ff53012faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:25.736 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff5354ae640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530073b00 con 0x7ff530130030 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff5354ae640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff530073e60 con 0x7ff53012f710 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff53012f710 0x7ff53012faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52e7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff530130030 0x7ff53006edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41430/0 (socket says 172.21.15.31:41430) 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52e7fc640 1 -- 172.21.15.31:0/2268986785 learned_addr learned my addr 172.21.15.31:0/2268986785 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52dffb640 1 -- 172.21.15.31:0/2268986785 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 356132184 0 0) 0x7ff530073b00 con 0x7ff530130030 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52dffb640 1 -- 172.21.15.31:0/2268986785 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff518003530 con 0x7ff530130030 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52effd640 1 -- 172.21.15.31:0/2268986785 >> v1:172.21.15.31:6789/0 conn(0x7ff530130030 legacy=0x7ff53006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:25.737 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.737+0000 7ff52effd640 1 -- 172.21.15.31:0/2268986785 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff530070460 con 0x7ff53012f710 2024-09-12T00:18:25.738 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 --2- 172.21.15.31:0/2268986785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff53012faf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff520009740 tx=0x7ff52001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fd22678fc8a7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:25.739 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52dffb640 1 -- 172.21.15.31:0/2268986785 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5200b0070 con 0x7ff53012f710 2024-09-12T00:18:25.739 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52dffb640 1 -- 172.21.15.31:0/2268986785 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5200ab530 con 0x7ff53012f710 2024-09-12T00:18:25.739 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52dffb640 1 -- 172.21.15.31:0/2268986785 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5200ab830 con 0x7ff53012f710 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- 172.21.15.31:0/2268986785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 msgr2=0x7ff53012faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 --2- 172.21.15.31:0/2268986785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff53012faf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff520009740 tx=0x7ff52001c3c0 comp rx=0 tx=0).stop 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- 172.21.15.31:0/2268986785 shutdown_connections 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 --2- 172.21.15.31:0/2268986785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff53012faf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- 172.21.15.31:0/2268986785 >> 172.21.15.31:0/2268986785 conn(0x7ff530072b80 msgr2=0x7ff530072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- 172.21.15.31:0/2268986785 shutdown_connections 2024-09-12T00:18:25.740 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- 172.21.15.31:0/2268986785 wait complete. 2024-09-12T00:18:25.741 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 Processor -- start 2024-09-12T00:18:25.741 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- start start 2024-09-12T00:18:25.741 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:25.742 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff5354ae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff530070dd0 con 0x7ff53012f710 2024-09-12T00:18:25.742 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:25.742 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48364/0 (socket says 172.21.15.31:48364) 2024-09-12T00:18:25.742 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 -- 172.21.15.31:0/338707729 learned_addr learned my addr 172.21.15.31:0/338707729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:25.742 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 -- 172.21.15.31:0/338707729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff530117380 con 0x7ff53012f710 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.741+0000 7ff52effd640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff520019ff0 tx=0x7ff52001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5200b0050 con 0x7ff53012f710 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5200b1040 con 0x7ff53012f710 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5200b5740 con 0x7ff53012f710 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff530118460 con 0x7ff53012f710 2024-09-12T00:18:25.743 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff530118020 con 0x7ff53012f710 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 48276+0+0 (secure 0 0 0) 0x7ff5200be030 con 0x7ff53012f710 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 0x7ff51c03d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7ff5200bc070 con 0x7ff53012f710 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53012faf0 con 0x7ff53012f710 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff52e7fc640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 0x7ff51c03d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:25.744 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.745+0000 7ff52e7fc640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 0x7ff51c03d600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff524007fd0 tx=0x7ff524007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:25.757 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.757+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff5200c5020 con 0x7ff53012f710 2024-09-12T00:18:25.958 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff530126210 con 0x7ff53012f710 2024-09-12T00:18:25.959 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5177fe640 1 -- 172.21.15.31:0/338707729 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7ff520015fb0 con 0x7ff53012f710 2024-09-12T00:18:25.960 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-12T00:18:25.960 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":8,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:25.554146+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:25.961 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 msgr2=0x7ff51c03d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:25.961 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 0x7ff51c03d600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff524007fd0 tx=0x7ff524007980 comp rx=0 tx=0).stop 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 msgr2=0x7ff5301c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff520019ff0 tx=0x7ff52001ac00 comp rx=0 tx=0).stop 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 shutdown_connections 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff51c03b140 0x7ff51c03d600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 --2- 172.21.15.31:0/338707729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53012f710 0x7ff5301c7610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 >> 172.21.15.31:0/338707729 conn(0x7ff530072b80 msgr2=0x7ff5301287e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 shutdown_connections 2024-09-12T00:18:25.962 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:25.961+0000 7ff5354ae640 1 -- 172.21.15.31:0/338707729 wait complete. 2024-09-12T00:18:25.977 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T00:18:26.499 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-12T00:18:26.501+0000 7f8b3cd59640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:18:26.528 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-12T00:18:26.529+0000 7f8b34b8b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:27.286 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-09-12T00:18:27.282+0000 7febeaa0c640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:18:27.308 INFO:tasks.ceph.osd.3.smithi066.stderr:2024-09-12T00:18:27.306+0000 7febe283e640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:27.323 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-09-12T00:18:27.318+0000 7f7f21091640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:18:27.335 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-09-12T00:18:27.330+0000 7f602ceb8640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:18:27.357 INFO:tasks.ceph.osd.1.smithi066.stderr:2024-09-12T00:18:27.354+0000 7f7f186b1640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:27.357 INFO:tasks.ceph.osd.2.smithi066.stderr:2024-09-12T00:18:27.354+0000 7f6024cea640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:32.381 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:32.506 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9ff487b640 1 Processor -- start 2024-09-12T00:18:32.506 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9ff487b640 1 -- start start 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9ff487b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff0110da0 0x7f9ff0111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9ff487b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff006dd90 con 0x7f9ff01116c0 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9ff487b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff01120d0 con 0x7f9ff0110da0 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fee59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff0110da0 0x7f9ff0111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fedd9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ff01116c0 0x7f9ff012be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41432/0 (socket says 172.21.15.31:41432) 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fee59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ff0110da0 0x7f9ff0111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48368/0 (socket says 172.21.15.31:48368) 2024-09-12T00:18:32.507 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fedd9b640 1 -- 172.21.15.31:0/3572309909 learned_addr learned my addr 172.21.15.31:0/3572309909 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:32.508 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fee59c640 1 -- 172.21.15.31:0/3572309909 >> v1:172.21.15.31:6789/0 conn(0x7f9ff01116c0 legacy=0x7f9ff012be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.508 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.509+0000 7f9fee59c640 1 -- 172.21.15.31:0/3572309909 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff0112970 con 0x7f9ff0110da0 2024-09-12T00:18:32.510 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 --2- 172.21.15.31:0/3572309909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff0111180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0402b1e68a0265c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.510 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fed59a640 1 -- 172.21.15.31:0/3572309909 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe80a6560 con 0x7f9ff0110da0 2024-09-12T00:18:32.510 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fed59a640 1 -- 172.21.15.31:0/3572309909 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe80a6700 con 0x7f9ff0110da0 2024-09-12T00:18:32.510 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fed59a640 1 -- 172.21.15.31:0/3572309909 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe80a6a00 con 0x7f9ff0110da0 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3572309909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 msgr2=0x7f9ff0111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3572309909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff0111180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe801c8c0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3572309909 shutdown_connections 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3572309909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff0111180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3572309909 >> 172.21.15.31:0/3572309909 conn(0x7f9ff00709a0 msgr2=0x7f9ff0072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:32.511 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3572309909 shutdown_connections 2024-09-12T00:18:32.512 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3572309909 wait complete. 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 Processor -- start 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- start start 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff01379f0 con 0x7f9ff0110da0 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48372/0 (socket says 172.21.15.31:48372) 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 -- 172.21.15.31:0/3657574754 learned_addr learned my addr 172.21.15.31:0/3657574754 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 -- 172.21.15.31:0/3657574754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff011b4d0 con 0x7f9ff0110da0 2024-09-12T00:18:32.513 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fee59c640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.514 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe80bb570 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe80c0070 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe80bb840 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff011c4d0 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.513+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01197e0 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff0134900 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9fe80bb9e0 con 0x7f9ff0110da0 2024-09-12T00:18:32.515 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9fe6ffd640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 0x7f9fd003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.516 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f9fe80ea1d0 con 0x7f9ff0110da0 2024-09-12T00:18:32.516 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9fedd9b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 0x7f9fd003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.516 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.517+0000 7f9fedd9b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 0x7f9fd003d690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8001670 tx=0x7f9fd8007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.520 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.521+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9fe80ac030 con 0x7f9ff0110da0 2024-09-12T00:18:32.691 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.693+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ff0111180 con 0x7f9ff0110da0 2024-09-12T00:18:32.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.693+0000 7f9fe6ffd640 1 -- 172.21.15.31:0/3657574754 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7975 (secure 0 0 0) 0x7f9fe8016540 con 0x7f9ff0110da0 2024-09-12T00:18:32.692 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-12T00:18:32.692 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:30.590119+0000","last_up_change":"2024-09-12T00:18:27.505132+0000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:28.545884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6801","nonce":3108862692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6803","nonce":3108862692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6807","nonce":3108862692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6805","nonce":3108862692}]},"public_addr":"172.21.15.31:6801/3108862692","cluster_addr":"172.21.15.31:6803/3108862692","heartbeat_back_addr":"172.21.15.31:6807/3108862692","heartbeat_front_addr":"172.21.15.31:6805/3108862692","state":["exists","up"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6809","nonce":1373122057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6811","nonce":1373122057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6815","nonce":1373122057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6813","nonce":1373122057}]},"public_addr":"172.21.15.66:6809/1373122057","cluster_addr":"172.21.15.66:6811/1373122057","heartbeat_back_addr":"172.21.15.66:6815/1373122057","heartbeat_front_addr":"172.21.15.66:6813/1373122057","state":["exists","up"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6801","nonce":1272812173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6803","nonce":1272812173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6807","nonce":1272812173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6805","nonce":1272812173}]},"public_addr":"172.21.15.66:6801/1272812173","cluster_addr":"172.21.15.66:6803/1272812173","heartbeat_back_addr":"172.21.15.66:6807/1272812173","heartbeat_front_addr":"172.21.15.66:6805/1272812173","state":["exists","up"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6817","nonce":2782209626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6819","nonce":2782209626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6823","nonce":2782209626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6821","nonce":2782209626}]},"public_addr":"172.21.15.66:6817/2782209626","cluster_addr":"172.21.15.66:6819/2782209626","heartbeat_back_addr":"172.21.15.66:6823/2782209626","heartbeat_front_addr":"172.21.15.66:6821/2782209626","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.633499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.991972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.986989+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:25.155160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:32.694 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 msgr2=0x7f9fd003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 0x7f9fd003d690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8001670 tx=0x7f9fd8007ad0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 msgr2=0x7f9ff01192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009d90 tx=0x7f9fe8019660 comp rx=0 tx=0).stop 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 shutdown_connections 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fd003b1d0 0x7f9fd003d690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 --2- 172.21.15.31:0/3657574754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff0110da0 0x7f9ff01192a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 >> 172.21.15.31:0/3657574754 conn(0x7f9ff00709a0 msgr2=0x7f9ff0129f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 shutdown_connections 2024-09-12T00:18:32.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-12T00:18:32.697+0000 7f9ff487b640 1 -- 172.21.15.31:0/3657574754 wait complete. 2024-09-12T00:18:32.711 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-12T00:18:32.711 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:18:32.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:18:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57b97f640 1 Processor -- start 2024-09-12T00:18:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57b97f640 1 -- start start 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57b97f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc57409a690 0x7fc574134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57b97f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57409bd60 con 0x7fc57412f4b0 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57b97f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc57412ffa0 con 0x7fc57409a690 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57971b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc57412f4b0 0x7fc57412f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41446/0 (socket says 172.21.15.31:41446) 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc57971b640 1 -- 172.21.15.31:0/4255486834 learned_addr learned my addr 172.21.15.31:0/4255486834 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc578f1a640 1 --2- 172.21.15.31:0/4255486834 >> v2:172.21.15.31:3300/0 conn(0x7fc57409a690 0x7fc574134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc573fff640 1 -- 172.21.15.31:0/4255486834 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299875801 0 0) 0x7fc57409bd60 con 0x7fc57412f4b0 2024-09-12T00:18:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc573fff640 1 -- 172.21.15.31:0/4255486834 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc55c003530 con 0x7fc57412f4b0 2024-09-12T00:18:32.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc578f1a640 1 -- 172.21.15.31:0/4255486834 >> v1:172.21.15.31:6789/0 conn(0x7fc57412f4b0 legacy=0x7fc57412f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.833+0000 7fc578f1a640 1 -- 172.21.15.31:0/4255486834 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57409aea0 con 0x7fc57409a690 2024-09-12T00:18:32.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc578f1a640 1 --2- 172.21.15.31:0/4255486834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc574134710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc568009740 tx=0x7fc56801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb89c73c96cb50ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc573fff640 1 -- 172.21.15.31:0/4255486834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5680b0070 con 0x7fc57409a690 2024-09-12T00:18:32.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc573fff640 1 -- 172.21.15.31:0/4255486834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5680ab530 con 0x7fc57409a690 2024-09-12T00:18:32.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc573fff640 1 -- 172.21.15.31:0/4255486834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5680ab830 con 0x7fc57409a690 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/4255486834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 msgr2=0x7fc574134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 --2- 172.21.15.31:0/4255486834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc574134710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc568009740 tx=0x7fc56801c400 comp rx=0 tx=0).stop 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/4255486834 shutdown_connections 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 --2- 172.21.15.31:0/4255486834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc574134710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/4255486834 >> 172.21.15.31:0/4255486834 conn(0x7fc5740a0010 msgr2=0x7fc5740a0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/4255486834 shutdown_connections 2024-09-12T00:18:32.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/4255486834 wait complete. 2024-09-12T00:18:32.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 Processor -- start 2024-09-12T00:18:32.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- start start 2024-09-12T00:18:32.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc574137800 con 0x7fc57409a690 2024-09-12T00:18:32.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57971b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57971b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48394/0 (socket says 172.21.15.31:48394) 2024-09-12T00:18:32.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57971b640 1 -- 172.21.15.31:0/2125221412 learned_addr learned my addr 172.21.15.31:0/2125221412 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57971b640 1 -- 172.21.15.31:0/2125221412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574129900 con 0x7fc57409a690 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57971b640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cb40 tx=0x7fc56c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c00ab50 con 0x7fc57409a690 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c00acf0 con 0x7fc57409a690 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc574129b90 con 0x7fc57409a690 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c012530 con 0x7fc57409a690 2024-09-12T00:18:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.837+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5741c7220 con 0x7fc57409a690 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc56c0126d0 con 0x7fc57409a690 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57409e6f0 con 0x7fc57409a690 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc571ffb640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 0x7fc56003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fc56c04f210 con 0x7fc57409a690 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc578f1a640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 0x7fc56003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:32.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.841+0000 7fc578f1a640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 0x7fc56003d690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5680ad000 tx=0x7fc5680a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:32.845+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc56c01a360 con 0x7fc57409a690 2024-09-12T00:18:33.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.013+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc57409c1b0 con 0x7fc57409a690 2024-09-12T00:18:33.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.601+0000 7fc571ffb640 1 -- 172.21.15.31:0/2125221412 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7fc56c0129c0 con 0x7fc57409a690 2024-09-12T00:18:33.599 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'rbd' created 2024-09-12T00:18:33.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 msgr2=0x7fc56003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 0x7fc56003d690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5680ad000 tx=0x7fc5680a6000 comp rx=0 tx=0).stop 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 msgr2=0x7fc5741c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00cb40 tx=0x7fc56c00a060 comp rx=0 tx=0).stop 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 shutdown_connections 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc56003b1d0 0x7fc56003d690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 --2- 172.21.15.31:0/2125221412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57409a690 0x7fc5741c6b10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 >> 172.21.15.31:0/2125221412 conn(0x7fc5740a0010 msgr2=0x7fc5741330c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 shutdown_connections 2024-09-12T00:18:33.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.605+0000 7fc57b97f640 1 -- 172.21.15.31:0/2125221412 wait complete. 2024-09-12T00:18:33.623 DEBUG:teuthology.orchestra.run.smithi031:> rbd --cluster ceph pool init rbd 2024-09-12T00:18:33.671 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:33.671 INFO:teuthology.orchestra.run.smithi031.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:33.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f3c01100 1 Processor -- start 2024-09-12T00:18:33.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f3c01100 1 -- start start 2024-09-12T00:18:33.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f3c01100 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f758db480 0x560f758db860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:33.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f3c01100 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x560f7569ac50 con 0x560f758dbda0 2024-09-12T00:18:33.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f3c01100 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560f7571b600 con 0x560f758db480 2024-09-12T00:18:33.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f270a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f758db480 0x560f758db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:33.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f1f09640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560f758dbda0 0x560f7582dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37758/0 (socket says 172.21.15.31:37758) 2024-09-12T00:18:33.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.673+0000 7f83f1f09640 1 -- 172.21.15.31:0/953359847 learned_addr learned my addr 172.21.15.31:0/953359847 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:33.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f270a640 1 -- 172.21.15.31:0/953359847 >> v1:172.21.15.31:6789/0 conn(0x560f758dbda0 legacy=0x560f7582dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:33.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f270a640 1 -- 172.21.15.31:0/953359847 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f75845c70 con 0x560f758db480 2024-09-12T00:18:33.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f270a640 1 --2- 172.21.15.31:0/953359847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758db860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83e400a480 tx=0x7f83e401b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cf2ae228d565d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:33.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f1708640 1 -- 172.21.15.31:0/953359847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40a7580 con 0x560f758db480 2024-09-12T00:18:33.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f1708640 1 -- 172.21.15.31:0/953359847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e40a7720 con 0x560f758db480 2024-09-12T00:18:33.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f1708640 1 -- 172.21.15.31:0/953359847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40a7a20 con 0x560f758db480 2024-09-12T00:18:33.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 -- 172.21.15.31:0/953359847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 msgr2=0x560f758db860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:33.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 --2- 172.21.15.31:0/953359847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758db860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83e400a480 tx=0x7f83e401b610 comp rx=0 tx=0).stop 2024-09-12T00:18:33.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 -- 172.21.15.31:0/953359847 shutdown_connections 2024-09-12T00:18:33.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 --2- 172.21.15.31:0/953359847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758db860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:33.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 -- 172.21.15.31:0/953359847 >> 172.21.15.31:0/953359847 conn(0x560f7584d9c0 msgr2=0x560f7584ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:33.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 -- 172.21.15.31:0/953359847 shutdown_connections 2024-09-12T00:18:33.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.677+0000 7f83f3c01100 1 -- 172.21.15.31:0/953359847 wait complete. 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 Processor -- start 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 -- start start 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f7571f5b0 con 0x560f758db480 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f270a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f270a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48934/0 (socket says 172.21.15.31:48934) 2024-09-12T00:18:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f270a640 1 -- 172.21.15.31:0/1775132853 learned_addr learned my addr 172.21.15.31:0/1775132853 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:33.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f270a640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f758cc750 con 0x560f758db480 2024-09-12T00:18:33.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f270a640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83e4018220 tx=0x7f83e40183b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:33.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40afa70 con 0x560f758db480 2024-09-12T00:18:33.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e40bf070 con 0x560f758db480 2024-09-12T00:18:33.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f758cc9f0 con 0x560f758db480 2024-09-12T00:18:33.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40afd60 con 0x560f758db480 2024-09-12T00:18:33.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f758c9b50 con 0x560f758db480 2024-09-12T00:18:33.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83e40a5040 con 0x560f758db480 2024-09-12T00:18:33.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 0x7f83d403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7f83e40e9a60 con 0x560f758db480 2024-09-12T00:18:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x560f758ecb80 con 0x560f758db480 2024-09-12T00:18:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.681+0000 7f83f1f09640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 0x7f83d403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:33.685+0000 7f83f1f09640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 0x7f83d403bf80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83e8001d80 tx=0x7f83e80012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:34.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.609+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 141+0+0 (secure 0 0 0) 0x560f758cc750 con 0x560f758db480 2024-09-12T00:18:34.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.609+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83e40a7720 con 0x560f758db480 2024-09-12T00:18:34.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.613+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f83e40b9b40 con 0x560f758db480 2024-09-12T00:18:34.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.613+0000 7f83e3fff640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f83d8002af0 con 0x560f758db480 2024-09-12T00:18:34.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.617+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 8 ==== osd_map(14..14 src has 1..14) ==== 650+0+0 (secure 0 0 0) 0x7f83e40b9d70 con 0x560f758db480 2024-09-12T00:18:34.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.617+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 0x560f758f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:34.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.621+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x560f758f2440 con 0x560f758dbda0 2024-09-12T00:18:34.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.621+0000 7f83f396c640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 0x560f758f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:34.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.621+0000 7f83f396c640 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 0x560f758f1f00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.625+0000 7f83f396c640 1 -- 172.21.15.31:0/1775132853 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x560f758dbda0 2024-09-12T00:18:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.629+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x560f75944450 con 0x560f758dbda0 2024-09-12T00:18:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.629+0000 7f83f396c640 1 -- 172.21.15.31:0/1775132853 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x560f758dbda0 2024-09-12T00:18:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.629+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) -- 0x560f75943460 con 0x560f758dbda0 2024-09-12T00:18:34.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.633+0000 7f83f396c640 1 -- 172.21.15.31:0/1775132853 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x560f758dbda0 2024-09-12T00:18:34.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:34.633+0000 7f83f0f07640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f83cc001f10 con 0x560f758db480 2024-09-12T00:18:35.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.625+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) ==== 55+0+0 (secure 0 0 0) 0x7f83e40dc080 con 0x560f758db480 2024-09-12T00:18:35.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.625+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f83d403f670 con 0x560f758db480 2024-09-12T00:18:35.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.625+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 10 ==== osd_map(15..15 src has 1..15) ==== 626+0+0 (secure 0 0 0) 0x7f83e40c3ce0 con 0x560f758db480 2024-09-12T00:18:35.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.625+0000 7f83e3fff640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7f83d8005790 con 0x560f758dbda0 2024-09-12T00:18:35.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.633+0000 7f83f396c640 1 -- 172.21.15.31:0/1775132853 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x560f758dbda0 2024-09-12T00:18:35.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:35.633+0000 7f83f0f07640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) -- 0x7f83cc003360 con 0x560f758db480 2024-09-12T00:18:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.629+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) ==== 43+0+0 (secure 0 0 0) 0x7f83e40e5020 con 0x560f758db480 2024-09-12T00:18:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.629+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f83d403f8f0 con 0x560f758db480 2024-09-12T00:18:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.629+0000 7f83e27fc640 1 -- 172.21.15.31:0/1775132853 <== mon.0 v2:172.21.15.31:3300/0 12 ==== osd_map(16..16 src has 1..16) ==== 654+0+0 (secure 0 0 0) 0x7f83e40e7310 con 0x560f758db480 2024-09-12T00:18:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.629+0000 7f83e3fff640 1 -- 172.21.15.31:0/1775132853 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f83d8005b50 con 0x560f758dbda0 2024-09-12T00:18:36.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f396c640 1 -- 172.21.15.31:0/1775132853 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec00a4d0 con 0x560f758dbda0 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 msgr2=0x560f758f1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 0x560f758f1f00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 msgr2=0x7f83d403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 0x7f83d403bf80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83e8001d80 tx=0x7f83e80012e0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 msgr2=0x560f758c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:36.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83e4018220 tx=0x7f83e40183b0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 shutdown_connections 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f758dbda0 0x560f758f1f00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f83d4039ac0 0x7f83d403bf80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 --2- 172.21.15.31:0/1775132853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f758db480 0x560f758c9610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 >> 172.21.15.31:0/1775132853 conn(0x560f7584d9c0 msgr2=0x560f75848f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 shutdown_connections 2024-09-12T00:18:36.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.637+0000 7f83f3c01100 1 -- 172.21.15.31:0/1775132853 wait complete. 2024-09-12T00:18:36.646 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:18:36.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:18:36.647 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:18:36.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff71cf640 1 Processor -- start 2024-09-12T00:18:36.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff71cf640 1 -- start start 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff71cf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efff0130260 0x7efff0132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff71cf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff01122f0 con 0x7efff012d2e0 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff71cf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7efff006dcb0 con 0x7efff0130260 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff4f6b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efff012d2e0 0x7efff012d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37760/0 (socket says 172.21.15.31:37760) 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7efff4f6b640 1 -- 172.21.15.31:0/923484271 learned_addr learned my addr 172.21.15.31:0/923484271 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7effeffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efff0130260 0x7efff0132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7effef7fe640 1 -- 172.21.15.31:0/923484271 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529671541 0 0) 0x7efff01122f0 con 0x7efff012d2e0 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7effef7fe640 1 -- 172.21.15.31:0/923484271 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd8003530 con 0x7efff012d2e0 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7effeffff640 1 -- 172.21.15.31:0/923484271 >> v1:172.21.15.31:6789/0 conn(0x7efff012d2e0 legacy=0x7efff012d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:36.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.825+0000 7effeffff640 1 -- 172.21.15.31:0/923484271 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff0073ad0 con 0x7efff0130260 2024-09-12T00:18:36.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7effeffff640 1 --2- 172.21.15.31:0/923484271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff0130260 0x7efff0132650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7effe0009740 tx=0x7effe001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8653d86f3bffb26a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:36.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7effef7fe640 1 -- 172.21.15.31:0/923484271 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00b0070 con 0x7efff0130260 2024-09-12T00:18:36.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7effef7fe640 1 -- 172.21.15.31:0/923484271 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00ab530 con 0x7efff0130260 2024-09-12T00:18:36.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7effef7fe640 1 -- 172.21.15.31:0/923484271 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe00ab830 con 0x7efff0130260 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- 172.21.15.31:0/923484271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff0130260 msgr2=0x7efff0132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 --2- 172.21.15.31:0/923484271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff0130260 0x7efff0132650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7effe0009740 tx=0x7effe001c370 comp rx=0 tx=0).stop 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- 172.21.15.31:0/923484271 shutdown_connections 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 --2- 172.21.15.31:0/923484271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff0130260 0x7efff0132650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- 172.21.15.31:0/923484271 >> 172.21.15.31:0/923484271 conn(0x7efff0070940 msgr2=0x7efff0072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- 172.21.15.31:0/923484271 shutdown_connections 2024-09-12T00:18:36.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- 172.21.15.31:0/923484271 wait complete. 2024-09-12T00:18:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 Processor -- start 2024-09-12T00:18:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- start start 2024-09-12T00:18:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff71cf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efff0135740 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff4f6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff4f6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48948/0 (socket says 172.21.15.31:48948) 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.829+0000 7efff4f6b640 1 -- 172.21.15.31:0/3841261015 learned_addr learned my addr 172.21.15.31:0/3841261015 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7efff4f6b640 1 -- 172.21.15.31:0/3841261015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01262c0 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7efff4f6b640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effe400c450 tx=0x7effe400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4017070 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe4005ce0 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff0126730 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effe4007200 con 0x7efff012d2e0 2024-09-12T00:18:36.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff0123c20 con 0x7efff012d2e0 2024-09-12T00:18:36.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff012d6c0 con 0x7efff012d2e0 2024-09-12T00:18:36.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7effe401a070 con 0x7efff012d2e0 2024-09-12T00:18:36.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 0x7effdc03d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:36.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7effe404e070 con 0x7efff012d2e0 2024-09-12T00:18:36.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effeffff640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 0x7effdc03d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:36.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.833+0000 7effeffff640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 0x7effdc03d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effe00ad000 tx=0x7effe0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:36.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:36.837+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7effe4012400 con 0x7efff012d2e0 2024-09-12T00:18:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.009+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7efff0123f10 con 0x7efff012d2e0 2024-09-12T00:18:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.009+0000 7effed7fa640 1 -- 172.21.15.31:0/3841261015 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7effe4012780 con 0x7efff012d2e0 2024-09-12T00:18:37.009 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 msgr2=0x7effdc03d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 0x7effdc03d670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effe00ad000 tx=0x7effe0008040 comp rx=0 tx=0).stop 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 msgr2=0x7efff01236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effe400c450 tx=0x7effe400c910 comp rx=0 tx=0).stop 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 shutdown_connections 2024-09-12T00:18:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7effdc03b1b0 0x7effdc03d670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 --2- 172.21.15.31:0/3841261015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff012d2e0 0x7efff01236e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 >> 172.21.15.31:0/3841261015 conn(0x7efff0070940 msgr2=0x7efff012ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 shutdown_connections 2024-09-12T00:18:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.013+0000 7efff71cf640 1 -- 172.21.15.31:0/3841261015 wait complete. 2024-09-12T00:18:37.029 INFO:teuthology.orchestra.run.smithi031.stdout:[{"version":5,"timestamp":"2024-09-12T00:18:27.340241+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5325.825917"}]}] 2024-09-12T00:18:37.029 INFO:tasks.ceph_manager:config epoch is 5 2024-09-12T00:18:37.029 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:18:37.029 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:18:37.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:18:37.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.149+0000 7fcda24b2640 1 Processor -- start 2024-09-12T00:18:37.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.149+0000 7fcda24b2640 1 -- start start 2024-09-12T00:18:37.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd9c12f150 0x7fcd9c131540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9c06dcb0 con 0x7fcd9c128c60 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcd9c075000 con 0x7fcd9c12f150 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd9c12f150 0x7fcd9c131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcd9c128c60 0x7fcd9c129040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37776/0 (socket says 172.21.15.31:37776) 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9bfff640 1 -- 172.21.15.31:0/1225850635 learned_addr learned my addr 172.21.15.31:0/1225850635 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9b7fe640 1 -- 172.21.15.31:0/1225850635 >> v1:172.21.15.31:6789/0 conn(0x7fcd9c128c60 legacy=0x7fcd9c129040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9b7fe640 1 -- 172.21.15.31:0/1225850635 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c073a90 con 0x7fcd9c12f150 2024-09-12T00:18:37.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9affd640 1 -- 172.21.15.31:0/1225850635 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496561918 0 0) 0x7fcd9c06dcb0 con 0x7fcd9c128c60 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9b7fe640 1 --2- 172.21.15.31:0/1225850635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c12f150 0x7fcd9c131540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009d90 tx=0x7fcd8401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e7b57546d8ae4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9affd640 1 -- 172.21.15.31:0/1225850635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd840a6640 con 0x7fcd9c12f150 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9affd640 1 -- 172.21.15.31:0/1225850635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd840a67e0 con 0x7fcd9c12f150 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcd9affd640 1 -- 172.21.15.31:0/1225850635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd840a6ae0 con 0x7fcd9c12f150 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- 172.21.15.31:0/1225850635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c12f150 msgr2=0x7fcd9c131540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 --2- 172.21.15.31:0/1225850635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c12f150 0x7fcd9c131540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009d90 tx=0x7fcd8401c8c0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- 172.21.15.31:0/1225850635 shutdown_connections 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 --2- 172.21.15.31:0/1225850635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c12f150 0x7fcd9c131540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- 172.21.15.31:0/1225850635 >> 172.21.15.31:0/1225850635 conn(0x7fcd9c070900 msgr2=0x7fcd9c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- 172.21.15.31:0/1225850635 shutdown_connections 2024-09-12T00:18:37.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.153+0000 7fcda24b2640 1 -- 172.21.15.31:0/1225850635 wait complete. 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 Processor -- start 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 -- start start 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c134630 con 0x7fcd9c128c60 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48962/0 (socket says 172.21.15.31:48962) 2024-09-12T00:18:37.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd9bfff640 1 -- 172.21.15.31:0/3100293297 learned_addr learned my addr 172.21.15.31:0/3100293297 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd9bfff640 1 -- 172.21.15.31:0/3100293297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c115240 con 0x7fcd9c128c60 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd9bfff640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c3d0 tx=0x7fcd8c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd8c007410 con 0x7fcd9c128c60 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0075d0 con 0x7fcd9c128c60 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd8c004960 con 0x7fcd9c128c60 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c12bc60 con 0x7fcd9c128c60 2024-09-12T00:18:37.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c1158d0 con 0x7fcd9c128c60 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9c129040 con 0x7fcd9c128c60 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcd8c011070 con 0x7fcd9c128c60 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 0x7fcd7c041aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.157+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fcd8c04e8b0 con 0x7fcd9c128c60 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.161+0000 7fcd9b7fe640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 0x7fcd7c041aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.161+0000 7fcd9b7fe640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 0x7fcd7c041aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd840af000 tx=0x7fcd840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.165+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcd8c010d50 con 0x7fcd9c128c60 2024-09-12T00:18:37.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.381+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcd9c1265d0 con 0x7fcd9c128c60 2024-09-12T00:18:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.385+0000 7fcd98ff9640 1 -- 172.21.15.31:0/3100293297 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92908 (secure 0 0 0) 0x7fcd8c012d70 con 0x7fcd9c128c60 2024-09-12T00:18:37.384 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 msgr2=0x7fcd7c041aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 0x7fcd7c041aa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd840af000 tx=0x7fcd840a7000 comp rx=0 tx=0).stop 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 msgr2=0x7fcd9c121700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c3d0 tx=0x7fcd8c00c890 comp rx=0 tx=0).stop 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 shutdown_connections 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd7c03f5e0 0x7fcd7c041aa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 --2- 172.21.15.31:0/3100293297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd9c128c60 0x7fcd9c121700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 >> 172.21.15.31:0/3100293297 conn(0x7fcd9c070900 msgr2=0x7fcd9c070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 shutdown_connections 2024-09-12T00:18:37.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.389+0000 7fcda24b2640 1 -- 172.21.15.31:0/3100293297 wait complete. 2024-09-12T00:18:37.402 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2854630610},{"type":"v1","addr":"172.21.15.66:6825","nonce":2854630610}]},"active_addr":"172.21.15.66:6825/2854630610","active_change":"2024-09-12T00:18:22.494307+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3902269458}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":1370772894}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":956517204}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":555643429}]}]} 2024-09-12T00:18:37.404 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:18:37.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:18:37.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f5014b87640 1 Processor -- start 2024-09-12T00:18:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f5014b87640 1 -- start start 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f5014b87640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5010132420 0x7f5010134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f5014b87640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501012b9d0 con 0x7f501012aee0 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f5014b87640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5010071e70 con 0x7f5010132420 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f501012aee0 0x7f501012b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37780/0 (socket says 172.21.15.31:37780) 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500e59c640 1 -- 172.21.15.31:0/757478577 learned_addr learned my addr 172.21.15.31:0/757478577 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500dd9b640 1 --2- 172.21.15.31:0/757478577 >> v2:172.21.15.31:3300/0 conn(0x7f5010132420 0x7f5010134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966404330 0 0) 0x7f501012b9d0 con 0x7f501012aee0 2024-09-12T00:18:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff8003530 con 0x7f501012aee0 2024-09-12T00:18:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1426105679 0 0) 0x7f4ff8003530 con 0x7f501012aee0 2024-09-12T00:18:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500dd9b640 1 -- 172.21.15.31:0/757478577 >> v1:172.21.15.31:6789/0 conn(0x7f501012aee0 legacy=0x7f501012b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500dd9b640 1 -- 172.21.15.31:0/757478577 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50100008e0 con 0x7f5010132420 2024-09-12T00:18:37.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500dd9b640 1 --2- 172.21.15.31:0/757478577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010132420 0x7f5010134810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5004009740 tx=0x7f500401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301ee3e4378c4090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50040b0070 con 0x7f5010132420 2024-09-12T00:18:37.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50040ab400 con 0x7f5010132420 2024-09-12T00:18:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.533+0000 7f500d59a640 1 -- 172.21.15.31:0/757478577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50000019b0 con 0x7f5010132420 2024-09-12T00:18:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/757478577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010132420 msgr2=0x7f5010134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 --2- 172.21.15.31:0/757478577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010132420 0x7f5010134810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5004009740 tx=0x7f500401c290 comp rx=0 tx=0).stop 2024-09-12T00:18:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/757478577 shutdown_connections 2024-09-12T00:18:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 --2- 172.21.15.31:0/757478577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010132420 0x7f5010134810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/757478577 >> 172.21.15.31:0/757478577 conn(0x7f50100a0a60 msgr2=0x7f501006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/757478577 shutdown_connections 2024-09-12T00:18:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/757478577 wait complete. 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 Processor -- start 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- start start 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f50101376f0 con 0x7f501012aee0 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f500e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f500e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48974/0 (socket says 172.21.15.31:48974) 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f500e59c640 1 -- 172.21.15.31:0/1018583629 learned_addr learned my addr 172.21.15.31:0/1018583629 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f500e59c640 1 -- 172.21.15.31:0/1018583629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501011b710 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f500e59c640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f500000cf70 tx=0x7f500000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f500000ad10 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5000012400 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501011b030 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5000012720 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501011c330 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501012b2c0 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50000128c0 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.537+0000 7f4ffeffd640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 0x7f4ff003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.541+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f500004f4d0 con 0x7f501012aee0 2024-09-12T00:18:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.541+0000 7f500dd9b640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 0x7f4ff003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.541+0000 7f500dd9b640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 0x7f4ff003d690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50040ad000 tx=0x7f5004008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.545+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f500001a360 con 0x7f501012aee0 2024-09-12T00:18:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.709+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f501011bf30 con 0x7f501012aee0 2024-09-12T00:18:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f4ffeffd640 1 -- 172.21.15.31:0/1018583629 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9875 (secure 0 0 0) 0x7f5000007a30 con 0x7f501012aee0 2024-09-12T00:18:37.710 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:37.710 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:36.622129+0000","last_up_change":"2024-09-12T00:18:27.505132+0000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:28.545884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:33.023201+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6801","nonce":3108862692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6803","nonce":3108862692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6807","nonce":3108862692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6805","nonce":3108862692}]},"public_addr":"172.21.15.31:6801/3108862692","cluster_addr":"172.21.15.31:6803/3108862692","heartbeat_back_addr":"172.21.15.31:6807/3108862692","heartbeat_front_addr":"172.21.15.31:6805/3108862692","state":["exists","up"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6809","nonce":1373122057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6811","nonce":1373122057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6815","nonce":1373122057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6813","nonce":1373122057}]},"public_addr":"172.21.15.66:6809/1373122057","cluster_addr":"172.21.15.66:6811/1373122057","heartbeat_back_addr":"172.21.15.66:6815/1373122057","heartbeat_front_addr":"172.21.15.66:6813/1373122057","state":["exists","up"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6801","nonce":1272812173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6803","nonce":1272812173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6807","nonce":1272812173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6805","nonce":1272812173}]},"public_addr":"172.21.15.66:6801/1272812173","cluster_addr":"172.21.15.66:6803/1272812173","heartbeat_back_addr":"172.21.15.66:6807/1272812173","heartbeat_front_addr":"172.21.15.66:6805/1272812173","state":["exists","up"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6817","nonce":2782209626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6819","nonce":2782209626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6823","nonce":2782209626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6821","nonce":2782209626}]},"public_addr":"172.21.15.66:6817/2782209626","cluster_addr":"172.21.15.66:6819/2782209626","heartbeat_back_addr":"172.21.15.66:6823/2782209626","heartbeat_front_addr":"172.21.15.66:6821/2782209626","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.633499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.991972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.986989+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:25.155160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 msgr2=0x7f4ff003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 0x7f4ff003d690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50040ad000 tx=0x7f5004008040 comp rx=0 tx=0).stop 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 msgr2=0x7f5010129340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f500000cf70 tx=0x7f500000a430 comp rx=0 tx=0).stop 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 shutdown_connections 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4ff003b1d0 0x7f4ff003d690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 --2- 172.21.15.31:0/1018583629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501012aee0 0x7f5010129340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 >> 172.21.15.31:0/1018583629 conn(0x7f50100a0a60 msgr2=0x7f50100a1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 shutdown_connections 2024-09-12T00:18:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.713+0000 7f5014b87640 1 -- 172.21.15.31:0/1018583629 wait complete. 2024-09-12T00:18:37.729 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:18:37.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:37.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.845+0000 7fca6fb6d640 1 Processor -- start 2024-09-12T00:18:37.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.845+0000 7fca6fb6d640 1 -- start start 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.845+0000 7fca6fb6d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca68110da0 0x7fca68111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.845+0000 7fca6fb6d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca68073a90 con 0x7fca681116c0 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.845+0000 7fca6fb6d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fca680696e0 con 0x7fca68110da0 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d909640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca68110da0 0x7fca68111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d108640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fca681116c0 0x7fca681231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37792/0 (socket says 172.21.15.31:37792) 2024-09-12T00:18:37.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d108640 1 -- 172.21.15.31:0/3849596994 learned_addr learned my addr 172.21.15.31:0/3849596994 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6c907640 1 -- 172.21.15.31:0/3849596994 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228827761 0 0) 0x7fca68073a90 con 0x7fca681116c0 2024-09-12T00:18:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6c907640 1 -- 172.21.15.31:0/3849596994 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca54003530 con 0x7fca681116c0 2024-09-12T00:18:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d909640 1 -- 172.21.15.31:0/3849596994 >> v1:172.21.15.31:6789/0 conn(0x7fca681116c0 legacy=0x7fca681231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d909640 1 -- 172.21.15.31:0/3849596994 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6806dd50 con 0x7fca68110da0 2024-09-12T00:18:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6d909640 1 --2- 172.21.15.31:0/3849596994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68111180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009740 tx=0x7fca5c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a787ec36fb2d25ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6c907640 1 -- 172.21.15.31:0/3849596994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c0b0070 con 0x7fca68110da0 2024-09-12T00:18:37.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6c907640 1 -- 172.21.15.31:0/3849596994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c0ab530 con 0x7fca68110da0 2024-09-12T00:18:37.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6c907640 1 -- 172.21.15.31:0/3849596994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c0ab830 con 0x7fca68110da0 2024-09-12T00:18:37.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 -- 172.21.15.31:0/3849596994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 msgr2=0x7fca68111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:37.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/3849596994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68111180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009740 tx=0x7fca5c01c370 comp rx=0 tx=0).stop 2024-09-12T00:18:37.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 -- 172.21.15.31:0/3849596994 shutdown_connections 2024-09-12T00:18:37.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/3849596994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68111180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:37.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 -- 172.21.15.31:0/3849596994 >> 172.21.15.31:0/3849596994 conn(0x7fca68070900 msgr2=0x7fca68072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:37.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 -- 172.21.15.31:0/3849596994 shutdown_connections 2024-09-12T00:18:37.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.849+0000 7fca6fb6d640 1 -- 172.21.15.31:0/3849596994 wait complete. 2024-09-12T00:18:37.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 Processor -- start 2024-09-12T00:18:37.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 -- start start 2024-09-12T00:18:37.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca68135470 con 0x7fca68110da0 2024-09-12T00:18:37.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d909640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d909640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48980/0 (socket says 172.21.15.31:48980) 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d909640 1 -- 172.21.15.31:0/1370785123 learned_addr learned my addr 172.21.15.31:0/1370785123 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d909640 1 -- 172.21.15.31:0/1370785123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca68132d10 con 0x7fca68110da0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d909640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0ae040 tx=0x7fca5c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c0b8020 con 0x7fca68110da0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c0b4410 con 0x7fca68110da0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca68122140 con 0x7fca68110da0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c0b0040 con 0x7fca68110da0 2024-09-12T00:18:37.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca68122650 con 0x7fca68110da0 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca68111180 con 0x7fca68110da0 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fca5c0bb020 con 0x7fca68110da0 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 0x7fca4c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fca5c0e89e0 con 0x7fca68110da0 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.853+0000 7fca6d108640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 0x7fca4c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:37.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.857+0000 7fca6d108640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 0x7fca4c03d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca640020b0 tx=0x7fca640016a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:37.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:37.857+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fca5c0c2030 con 0x7fca68110da0 2024-09-12T00:18:38.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.029+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca68132800 con 0x7fca68110da0 2024-09-12T00:18:38.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca5a7fc640 1 -- 172.21.15.31:0/1370785123 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9875 (secure 0 0 0) 0x7fca5c015ff0 con 0x7fca68110da0 2024-09-12T00:18:38.030 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:38.030 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:18:36.622129+0000","last_up_change":"2024-09-12T00:18:27.505132+0000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:28.545884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:33.023201+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6801","nonce":3108862692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6803","nonce":3108862692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6807","nonce":3108862692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6805","nonce":3108862692}]},"public_addr":"172.21.15.31:6801/3108862692","cluster_addr":"172.21.15.31:6803/3108862692","heartbeat_back_addr":"172.21.15.31:6807/3108862692","heartbeat_front_addr":"172.21.15.31:6805/3108862692","state":["exists","up"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6809","nonce":1373122057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6811","nonce":1373122057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6815","nonce":1373122057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6813","nonce":1373122057}]},"public_addr":"172.21.15.66:6809/1373122057","cluster_addr":"172.21.15.66:6811/1373122057","heartbeat_back_addr":"172.21.15.66:6815/1373122057","heartbeat_front_addr":"172.21.15.66:6813/1373122057","state":["exists","up"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6801","nonce":1272812173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6803","nonce":1272812173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6807","nonce":1272812173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6805","nonce":1272812173}]},"public_addr":"172.21.15.66:6801/1272812173","cluster_addr":"172.21.15.66:6803/1272812173","heartbeat_back_addr":"172.21.15.66:6807/1272812173","heartbeat_front_addr":"172.21.15.66:6805/1272812173","state":["exists","up"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6817","nonce":2782209626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6819","nonce":2782209626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6823","nonce":2782209626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6821","nonce":2782209626}]},"public_addr":"172.21.15.66:6817/2782209626","cluster_addr":"172.21.15.66:6819/2782209626","heartbeat_back_addr":"172.21.15.66:6823/2782209626","heartbeat_front_addr":"172.21.15.66:6821/2782209626","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.633499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.991972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.986989+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:25.155160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 msgr2=0x7fca4c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 0x7fca4c03d690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca640020b0 tx=0x7fca640016a0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 msgr2=0x7fca68121c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0ae040 tx=0x7fca5c019110 comp rx=0 tx=0).stop 2024-09-12T00:18:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 shutdown_connections 2024-09-12T00:18:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fca4c03b1d0 0x7fca4c03d690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 --2- 172.21.15.31:0/1370785123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca68110da0 0x7fca68121c00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 >> 172.21.15.31:0/1370785123 conn(0x7fca68070900 msgr2=0x7fca68071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 shutdown_connections 2024-09-12T00:18:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.033+0000 7fca6fb6d640 1 -- 172.21.15.31:0/1370785123 wait complete. 2024-09-12T00:18:38.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:18:38.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:18:38.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:18:38.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:18:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8729e63640 1 Processor -- start 2024-09-12T00:18:38.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8cf34640 1 Processor -- start 2024-09-12T00:18:38.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8729e63640 1 -- start start 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8cf34640 1 -- start start 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8cf34640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d8809ee60 0x7f2d881325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8cf34640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8806df40 con 0x7f2d8809e370 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8cf34640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2d8809f8a0 con 0x7f2d8809ee60 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d8809ee60 0x7f2d881325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d8809ee60 0x7f2d881325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48996/0 (socket says 172.21.15.31:48996) 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 -- 172.21.15.31:0/1677869019 learned_addr learned my addr 172.21.15.31:0/1677869019 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8729e63640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f872412c700 0x7f87241346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8659c640 1 --1- 172.21.15.31:0/1677869019 >> v1:172.21.15.31:6789/0 conn(0x7f2d8809e370 0x7f2d8809e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37804/0 (socket says 172.21.15.31:37804) 2024-09-12T00:18:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8729e63640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8724073830 con 0x7f872412bc10 2024-09-12T00:18:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8729e63640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8724071eb0 con 0x7f872412c700 2024-09-12T00:18:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f87237fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f872412bc10 0x7f872412bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37814/0 (socket says 172.21.15.31:37814) 2024-09-12T00:18:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f87237fe640 1 -- 172.21.15.31:0/4061241987 learned_addr learned my addr 172.21.15.31:0/4061241987 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 -- 172.21.15.31:0/1677869019 >> v1:172.21.15.31:6789/0 conn(0x7f2d8809e370 legacy=0x7f2d8809e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 -- 172.21.15.31:0/1677869019 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8809fcc0 con 0x7f2d8809ee60 2024-09-12T00:18:38.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8722ffd640 1 --2- 172.21.15.31:0/4061241987 >> v2:172.21.15.31:3300/0 conn(0x7f872412c700 0x7f87241346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f87227fc640 1 -- 172.21.15.31:0/4061241987 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540517023 0 0) 0x7f8724073830 con 0x7f872412bc10 2024-09-12T00:18:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f87227fc640 1 -- 172.21.15.31:0/4061241987 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f870c003530 con 0x7f872412bc10 2024-09-12T00:18:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc61d001640 1 Processor -- start 2024-09-12T00:18:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8722ffd640 1 -- 172.21.15.31:0/4061241987 >> v1:172.21.15.31:6789/0 conn(0x7f872412bc10 legacy=0x7f872412bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f8722ffd640 1 -- 172.21.15.31:0/4061241987 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87240a30b0 con 0x7f872412c700 2024-09-12T00:18:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc61d001640 1 -- start start 2024-09-12T00:18:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64f14b9640 1 Processor -- start 2024-09-12T00:18:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64f14b9640 1 -- start start 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc61d001640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc61812d000 0x7fc61812d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc61d001640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61809f7f0 con 0x7fc61812d920 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc61d001640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc61809ebb0 con 0x7fc61812d000 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc616d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc61812d000 0x7fc61812d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64f14b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64ec112740 0x7f64ec112b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64f14b9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ec113c10 con 0x7f64ec113060 2024-09-12T00:18:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64f14b9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec073130 con 0x7f64ec112740 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc616d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc61812d000 0x7fc61812d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49020/0 (socket says 172.21.15.31:49020) 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc616d9d640 1 -- 172.21.15.31:0/2077945120 learned_addr learned my addr 172.21.15.31:0/2077945120 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64ea7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f64ec113060 0x7f64ec121fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37844/0 (socket says 172.21.15.31:37844) 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64ea7fc640 1 -- 172.21.15.31:0/2378464434 learned_addr learned my addr 172.21.15.31:0/2378464434 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc616d9d640 1 -- 172.21.15.31:0/2077945120 >> v1:172.21.15.31:6789/0 conn(0x7fc61812d920 legacy=0x7fc618126780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7fc616d9d640 1 -- 172.21.15.31:0/2077945120 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61809f430 con 0x7fc61812d000 2024-09-12T00:18:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152349846 0 0) 0x7f64ec113c10 con 0x7f64ec113060 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64d8003530 con 0x7f64ec113060 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3269369603 0 0) 0x7f64d8003530 con 0x7f64ec113060 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 >> v2:172.21.15.31:3300/0 conn(0x7f64ec112740 msgr2=0x7f64ec112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 --2- 172.21.15.31:0/2378464434 >> v2:172.21.15.31:3300/0 conn(0x7f64ec112740 0x7f64ec112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec073a60 con 0x7f64ec113060 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 271743035 0 0) 0x7f64dc001630 con 0x7f64ec113060 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 >> v1:172.21.15.31:6789/0 conn(0x7f64ec113060 legacy=0x7f64ec121fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 --2- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64d8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f64d8004810 con 0x7f64d8003ab0 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64eaffd640 1 --2- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64d8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f64eaffd640 1 -- 172.21.15.31:0/2378464434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d8003530 con 0x7f64d8003ab0 2024-09-12T00:18:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d85d9b640 1 --2- 172.21.15.31:0/1677869019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809ee60 0x7f2d881325c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097f0 tx=0x7f2d7c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43144d49c76c3f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.161+0000 7f2d8559a640 1 -- 172.21.15.31:0/1677869019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c0ab580 con 0x7f2d8809ee60 2024-09-12T00:18:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8559a640 1 -- 172.21.15.31:0/1677869019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0b0070 con 0x7f2d8809ee60 2024-09-12T00:18:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8559a640 1 -- 172.21.15.31:0/1677869019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c0ab870 con 0x7f2d8809ee60 2024-09-12T00:18:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8722ffd640 1 --2- 172.21.15.31:0/4061241987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412c700 0x7f87241346a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8718009740 tx=0x7f871801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afed92ca6ccccfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87227fc640 1 -- 172.21.15.31:0/4061241987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87180b0070 con 0x7f872412c700 2024-09-12T00:18:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87227fc640 1 -- 172.21.15.31:0/4061241987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87180ab530 con 0x7f872412c700 2024-09-12T00:18:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87227fc640 1 -- 172.21.15.31:0/4061241987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87180ab830 con 0x7f872412c700 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/1677869019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809ee60 msgr2=0x7f2d881325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/1677869019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809ee60 0x7f2d881325c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097f0 tx=0x7f2d7c01c430 comp rx=0 tx=0).stop 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/1677869019 shutdown_connections 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/1677869019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809ee60 0x7f2d881325c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/1677869019 >> 172.21.15.31:0/1677869019 conn(0x7f2d88071630 msgr2=0x7f2d8809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/1677869019 shutdown_connections 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- 172.21.15.31:0/4061241987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412c700 msgr2=0x7f87241346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 --2- 172.21.15.31:0/4061241987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412c700 0x7f87241346a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8718009740 tx=0x7f871801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:38.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/1677869019 wait complete. 2024-09-12T00:18:38.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc616d9d640 1 --2- 172.21.15.31:0/2077945120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc61812d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6080097f0 tx=0x7fc60801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4fa8d23c6cf141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- 172.21.15.31:0/4061241987 shutdown_connections 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 --2- 172.21.15.31:0/4061241987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412c700 0x7f87241346a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- 172.21.15.31:0/4061241987 >> 172.21.15.31:0/4061241987 conn(0x7f87240a0a60 msgr2=0x7f872406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- 172.21.15.31:0/4061241987 shutdown_connections 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- 172.21.15.31:0/4061241987 wait complete. 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61659c640 1 -- 172.21.15.31:0/2077945120 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6080b0070 con 0x7fc61812d000 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61659c640 1 -- 172.21.15.31:0/2077945120 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6080ab530 con 0x7fc61812d000 2024-09-12T00:18:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61659c640 1 -- 172.21.15.31:0/2077945120 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6080ab830 con 0x7fc61812d000 2024-09-12T00:18:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 Processor -- start 2024-09-12T00:18:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- start start 2024-09-12T00:18:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64eaffd640 1 --2- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64d8003eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009c20 tx=0x7f64e401cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fea0e6fbf27b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e40b2070 con 0x7f64d8003ab0 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e40a5bf0 con 0x7f64d8003ab0 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64e9ffb640 1 -- 172.21.15.31:0/2378464434 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e4006e60 con 0x7f64d8003ab0 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 -- 172.21.15.31:0/2077945120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 msgr2=0x7fc61812d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 --2- 172.21.15.31:0/2077945120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc61812d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6080097f0 tx=0x7fc60801c430 comp rx=0 tx=0).stop 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 Processor -- start 2024-09-12T00:18:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- start start 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 -- 172.21.15.31:0/2077945120 shutdown_connections 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 --2- 172.21.15.31:0/2077945120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc61812d3e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 -- 172.21.15.31:0/2077945120 >> 172.21.15.31:0/2077945120 conn(0x7fc618071e50 msgr2=0x7fc618072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881356b0 con 0x7f2d8809e370 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49054/0 (socket says 172.21.15.31:49054) 2024-09-12T00:18:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8659c640 1 -- 172.21.15.31:0/4036603847 learned_addr learned my addr 172.21.15.31:0/4036603847 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f8729e63640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8724137790 con 0x7f872412bc10 2024-09-12T00:18:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8659c640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d881277a0 con 0x7f2d8809e370 2024-09-12T00:18:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 -- 172.21.15.31:0/2077945120 shutdown_connections 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 -- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 msgr2=0x7f64d8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 --2- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64d8003eb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009c20 tx=0x7f64e401cd10 comp rx=0 tx=0).stop 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 -- 172.21.15.31:0/2378464434 shutdown_connections 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 --2- 172.21.15.31:0/2378464434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64d8003eb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 --2- 172.21.15.31:0/2378464434 >> v2:172.21.15.31:3300/0 conn(0x7f64ec112740 0x7f64ec112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 -- 172.21.15.31:0/2378464434 >> 172.21.15.31:0/2378464434 conn(0x7f64ec070480 msgr2=0x7f64ec0728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87237fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 -- 172.21.15.31:0/2378464434 shutdown_connections 2024-09-12T00:18:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7fc61d001640 1 -- 172.21.15.31:0/2077945120 wait complete. 2024-09-12T00:18:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87237fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49056/0 (socket says 172.21.15.31:49056) 2024-09-12T00:18:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87237fe640 1 -- 172.21.15.31:0/116585535 learned_addr learned my addr 172.21.15.31:0/116585535 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8659c640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800c450 tx=0x7f2d7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d78007410 con 0x7f2d8809e370 2024-09-12T00:18:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d780075b0 con 0x7f2d8809e370 2024-09-12T00:18:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8811a240 con 0x7f2d8809e370 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d88119040 con 0x7f2d8809e370 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87237fe640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8724073a50 con 0x7f872412bc10 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f87237fe640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f871400c450 tx=0x7f871400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714017070 con 0x7f872412bc10 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8714005ce0 con 0x7f872412bc10 2024-09-12T00:18:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8714007200 con 0x7f872412bc10 2024-09-12T00:18:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 Processor -- start 2024-09-12T00:18:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872411c1b0 con 0x7f872412bc10 2024-09-12T00:18:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872412ab90 con 0x7f872412bc10 2024-09-12T00:18:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d78004960 con 0x7f2d8809e370 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d6c000f90 con 0x7f2d8809e370 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d7801a020 con 0x7f2d8809e370 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.165+0000 7f64f14b9640 1 -- 172.21.15.31:0/2378464434 wait complete. 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 -- start start 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181355b0 con 0x7fc61812d000 2024-09-12T00:18:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 Processor -- start 2024-09-12T00:18:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 0x7f2d6803d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 -- start start 2024-09-12T00:18:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec1119c0 con 0x7f64d8003ab0 2024-09-12T00:18:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8704000f90 con 0x7f872412bc10 2024-09-12T00:18:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f2d7804e5c0 con 0x7f2d8809e370 2024-09-12T00:18:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 0x7f2d68042d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d78013e50 con 0x7f2d680408e0 2024-09-12T00:18:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f2d78055050 con 0x7f2d8809e370 2024-09-12T00:18:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc616d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc616d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49072/0 (socket says 172.21.15.31:49072) 2024-09-12T00:18:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc616d9d640 1 -- 172.21.15.31:0/1266024161 learned_addr learned my addr 172.21.15.31:0/1266024161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d85d9b640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 0x7f2d6803d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f871401a070 con 0x7f872412bc10 2024-09-12T00:18:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d86d9d640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 0x7f2d68042d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64eaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64eaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49064/0 (socket says 172.21.15.31:49064) 2024-09-12T00:18:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64eaffd640 1 -- 172.21.15.31:0/1916225844 learned_addr learned my addr 172.21.15.31:0/1916225844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc616d9d640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6181265a0 con 0x7fc61812d000 2024-09-12T00:18:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 0x7f871003d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f871404dff0 con 0x7f872412bc10 2024-09-12T00:18:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc616d9d640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc60801a060 tx=0x7fc60801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64eaffd640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec12f100 con 0x7f64d8003ab0 2024-09-12T00:18:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 0x7f8710042e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87100434f0 con 0x7f87100409a0 2024-09-12T00:18:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8714050580 con 0x7f872412bc10 2024-09-12T00:18:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f8722ffd640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 0x7f871003d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64eaffd640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b0040 tx=0x7f64d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6080ba020 con 0x7fc61812d000 2024-09-12T00:18:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6080aa5d0 con 0x7fc61812d000 2024-09-12T00:18:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc618127790 con 0x7fc61812d000 2024-09-12T00:18:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6080b0040 con 0x7fc61812d000 2024-09-12T00:18:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc618070530 con 0x7fc61812d000 2024-09-12T00:18:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d85d9b640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 0x7f2d6803d620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af000 tx=0x7f2d7c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f8723fff640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 0x7f8710042e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f2d86d9d640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 0x7f2d68042d60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e40bb070 con 0x7f64d8003ab0 2024-09-12T00:18:38.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4004190 con 0x7f64d8003ab0 2024-09-12T00:18:38.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec130de0 con 0x7f64d8003ab0 2024-09-12T00:18:38.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64e40b2040 con 0x7f64d8003ab0 2024-09-12T00:18:38.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec08ba70 con 0x7f64d8003ab0 2024-09-12T00:18:38.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc618070820 con 0x7fc61812d000 2024-09-12T00:18:38.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.169+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc6080bd020 con 0x7fc61812d000 2024-09-12T00:18:38.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f8722ffd640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 0x7f871003d6e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87180ad000 tx=0x7f8718008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 0x7fc5f803d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f8723fff640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 0x7f8710042e20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fc6080e92c0 con 0x7fc61812d000 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 0x7fc5f8042e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc60800af30 con 0x7fc5f80409d0 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fc6080f0050 con 0x7fc61812d000 2024-09-12T00:18:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f64e40044b0 con 0x7f64d8003ab0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64ec126560 con 0x7f64d8003ab0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 0x7f64cc03d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f64e40e9570 con 0x7f64d8003ab0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 0x7f64cc042e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64e40baec0 con 0x7f64cc0409a0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f64e40f0050 con 0x7f64d8003ab0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60e59c640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 0x7fc5f803d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d78013e50 con 0x7f2d680408e0 2024-09-12T00:18:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f64eb7fe640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 0x7f64cc042e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc61759e640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 0x7fc5f8042e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60e59c640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 0x7fc5f803d710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc600001630 tx=0x7fc600007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc61759e640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 0x7fc5f8042e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f87100434f0 con 0x7f87100409a0 2024-09-12T00:18:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.173+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc60800af30 con 0x7fc5f80409d0 2024-09-12T00:18:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.177+0000 7f64ea7fc640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 0x7f64cc03d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.177+0000 7f64eb7fe640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 0x7f64cc042e20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.177+0000 7f64ea7fc640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 0x7f64cc03d6e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64dc001e70 tx=0x7f64dc001170 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.177+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64e40baec0 con 0x7f64cc0409a0 2024-09-12T00:18:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.185+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d6c002c80 con 0x7f2d680408e0 2024-09-12T00:18:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.185+0000 7f2d76ffd640 1 -- 172.21.15.31:0/4036603847 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d6c002c80 con 0x7f2d680408e0 2024-09-12T00:18:38.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 msgr2=0x7f2d68042d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 0x7f2d68042d60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 msgr2=0x7f2d6803d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 0x7f2d6803d620 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af000 tx=0x7f2d7c0a7000 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 msgr2=0x7f2d88118b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800c450 tx=0x7f2d7800c910 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 shutdown_connections 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7f2d680408e0 0x7f2d68042d60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2d6803b160 0x7f2d6803d620 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 --2- 172.21.15.31:0/4036603847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8809e370 0x7f2d88118b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 >> 172.21.15.31:0/4036603847 conn(0x7f2d88071630 msgr2=0x7f2d8812ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 shutdown_connections 2024-09-12T00:18:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.189+0000 7f2d8cf34640 1 -- 172.21.15.31:0/4036603847 wait complete. 2024-09-12T00:18:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64ec126560 con 0x7f64cc0409a0 2024-09-12T00:18:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64e37fe640 1 -- 172.21.15.31:0/1916225844 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64ec126560 con 0x7f64cc0409a0 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 msgr2=0x7f64cc042e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 0x7f64cc042e20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 msgr2=0x7f64cc03d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 0x7f64cc03d6e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f64dc001e70 tx=0x7f64dc001170 comp rx=0 tx=0).stop 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 msgr2=0x7f64ec08b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b0040 tx=0x7f64d8005840 comp rx=0 tx=0).stop 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 shutdown_connections 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f64cc0409a0 0x7f64cc042e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f64cc03b220 0x7f64cc03d6e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 --2- 172.21.15.31:0/1916225844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64d8003ab0 0x7f64ec08b530 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 >> 172.21.15.31:0/1916225844 conn(0x7f64ec070480 msgr2=0x7f64ec072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 shutdown_connections 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.193+0000 7f64f14b9640 1 -- 172.21.15.31:0/1916225844 wait complete. 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.201+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8704002c80 con 0x7f87100409a0 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f870bfff640 1 -- 172.21.15.31:0/116585535 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8704002c80 con 0x7f87100409a0 2024-09-12T00:18:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc61812d3e0 con 0x7fc5f80409d0 2024-09-12T00:18:38.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 msgr2=0x7f8710042e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 0x7f8710042e20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 msgr2=0x7f871003d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 0x7f871003d6e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87180ad000 tx=0x7f8718008040 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 msgr2=0x7f872412a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f871400c450 tx=0x7f871400c910 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 shutdown_connections 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f87100409a0 0x7f8710042e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f871003b220 0x7f871003d6e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 --2- 172.21.15.31:0/116585535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872412bc10 0x7f872412a650 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 >> 172.21.15.31:0/116585535 conn(0x7f87240a0a60 msgr2=0x7f8724070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 shutdown_connections 2024-09-12T00:18:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7f8729e63640 1 -- 172.21.15.31:0/116585535 wait complete. 2024-09-12T00:18:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc60ffff640 1 -- 172.21.15.31:0/1266024161 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc61812d3e0 con 0x7fc5f80409d0 2024-09-12T00:18:38.205 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-12T00:18:38.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 msgr2=0x7fc5f8042e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 0x7fc5f8042e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 msgr2=0x7fc5f803d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 0x7fc5f803d710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc600001630 tx=0x7fc600007a00 comp rx=0 tx=0).stop 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 msgr2=0x7fc618126060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc60801a060 tx=0x7fc60801ac70 comp rx=0 tx=0).stop 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 shutdown_connections 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc5f80409d0 0x7fc5f8042e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc5f803b250 0x7fc5f803d710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 --2- 172.21.15.31:0/1266024161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61812d000 0x7fc618126060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 >> 172.21.15.31:0/1266024161 conn(0x7fc618071e50 msgr2=0x7fc61809b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 shutdown_connections 2024-09-12T00:18:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.205+0000 7fc61d001640 1 -- 172.21.15.31:0/1266024161 wait complete. 2024-09-12T00:18:38.210 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-09-12T00:18:38.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:18:38.222 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-09-12T00:18:38.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:18:38.223 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-12T00:18:38.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd934ac640 1 Processor -- start 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd934ac640 1 -- start start 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd934ac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd8c12c030 0x7fbd8c12c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd934ac640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8c069430 con 0x7fbd8c12c950 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd934ac640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c09de30 con 0x7fbd8c12c030 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd91248640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd8c12c030 0x7fbd8c12c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd90a47640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbd8c12c950 0x7fbd8c125770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37858/0 (socket says 172.21.15.31:37858) 2024-09-12T00:18:38.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd90a47640 1 -- 172.21.15.31:0/3742924501 learned_addr learned my addr 172.21.15.31:0/3742924501 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:38.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd91248640 1 -- 172.21.15.31:0/3742924501 >> v1:172.21.15.31:6789/0 conn(0x7fbd8c12c950 legacy=0x7fbd8c125770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd83fff640 1 -- 172.21.15.31:0/3742924501 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707798414 0 0) 0x7fbd8c069430 con 0x7fbd8c12c950 2024-09-12T00:18:38.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.317+0000 7fbd91248640 1 -- 172.21.15.31:0/3742924501 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c073c00 con 0x7fbd8c12c030 2024-09-12T00:18:38.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd91248640 1 --2- 172.21.15.31:0/3742924501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c12c410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009740 tx=0x7fbd8801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de53e18c30ad8ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd83fff640 1 -- 172.21.15.31:0/3742924501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880b0070 con 0x7fbd8c12c030 2024-09-12T00:18:38.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd83fff640 1 -- 172.21.15.31:0/3742924501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880ab530 con 0x7fbd8c12c030 2024-09-12T00:18:38.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd83fff640 1 -- 172.21.15.31:0/3742924501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880ab830 con 0x7fbd8c12c030 2024-09-12T00:18:38.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- 172.21.15.31:0/3742924501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 msgr2=0x7fbd8c12c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 --2- 172.21.15.31:0/3742924501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c12c410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009740 tx=0x7fbd8801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- 172.21.15.31:0/3742924501 shutdown_connections 2024-09-12T00:18:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 --2- 172.21.15.31:0/3742924501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c12c410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- 172.21.15.31:0/3742924501 >> 172.21.15.31:0/3742924501 conn(0x7fbd8c0715b0 msgr2=0x7fbd8c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- 172.21.15.31:0/3742924501 shutdown_connections 2024-09-12T00:18:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- 172.21.15.31:0/3742924501 wait complete. 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 Processor -- start 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- start start 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd934ac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1345e0 con 0x7fbd8c12c030 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd91248640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd91248640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49098/0 (socket says 172.21.15.31:49098) 2024-09-12T00:18:38.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.321+0000 7fbd91248640 1 -- 172.21.15.31:0/1041414446 learned_addr learned my addr 172.21.15.31:0/1041414446 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd91248640 1 -- 172.21.15.31:0/1041414446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c117b30 con 0x7fbd8c12c030 2024-09-12T00:18:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd91248640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd88019fa0 tx=0x7fbd8801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880b0050 con 0x7fbd8c12c030 2024-09-12T00:18:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd880b1040 con 0x7fbd8c12c030 2024-09-12T00:18:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c118ba0 con 0x7fbd8c12c030 2024-09-12T00:18:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880b5930 con 0x7fbd8c12c030 2024-09-12T00:18:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c124820 con 0x7fbd8c12c030 2024-09-12T00:18:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd880be030 con 0x7fbd8c12c030 2024-09-12T00:18:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 0x7fbd7003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fbd880bc070 con 0x7fbd8c12c030 2024-09-12T00:18:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd90a47640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 0x7fbd7003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8c12c410 con 0x7fbd8c12c030 2024-09-12T00:18:38.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.325+0000 7fbd90a47640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 0x7fbd7003d6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c007fd0 tx=0x7fbd7c007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.333+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbd88015ff0 con 0x7fbd8c12c030 2024-09-12T00:18:38.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f458298a640 1 Processor -- start 2024-09-12T00:18:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f458298a640 1 -- start start 2024-09-12T00:18:38.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f458298a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f457c12c180 0x7f457c12c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f458298a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c116c10 con 0x7f457c12caa0 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f458298a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f457c06ff90 con 0x7f457c12c180 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f457bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f457c12c180 0x7f457c12c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f457bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f457c12c180 0x7f457c12c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49106/0 (socket says 172.21.15.31:49106) 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f457bfff640 1 -- 172.21.15.31:0/2785220454 learned_addr learned my addr 172.21.15.31:0/2785220454 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f457bfff640 1 -- 172.21.15.31:0/2785220454 >> v1:172.21.15.31:6789/0 conn(0x7f457c12caa0 legacy=0x7f457c12f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f457bfff640 1 -- 172.21.15.31:0/2785220454 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c117050 con 0x7f457c12c180 2024-09-12T00:18:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41c2255640 1 Processor -- start 2024-09-12T00:18:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41c2255640 1 -- start start 2024-09-12T00:18:38.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41c2255640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41bc12c700 0x7f41bc1346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41c2255640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41bc073830 con 0x7f41bc12bc10 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41c2255640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f41bc071eb0 con 0x7f41bc12c700 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41baffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41bc12c700 0x7f41bc1346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41baffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41bc12c700 0x7f41bc1346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49120/0 (socket says 172.21.15.31:49120) 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41baffd640 1 -- 172.21.15.31:0/3810831493 learned_addr learned my addr 172.21.15.31:0/3810831493 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41ba7fc640 1 -- 172.21.15.31:0/3810831493 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937806286 0 0) 0x7f41bc073830 con 0x7f41bc12bc10 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41ba7fc640 1 -- 172.21.15.31:0/3810831493 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a4003530 con 0x7f41bc12bc10 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41baffd640 1 -- 172.21.15.31:0/3810831493 >> v1:172.21.15.31:6789/0 conn(0x7f41bc12bc10 legacy=0x7f41bc12bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.373+0000 7f41baffd640 1 -- 172.21.15.31:0/3810831493 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc0a30b0 con 0x7f41bc12c700 2024-09-12T00:18:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae7328a640 1 Processor -- start 2024-09-12T00:18:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae7328a640 1 -- start start 2024-09-12T00:18:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 --2- 172.21.15.31:0/2785220454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c12c560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f456c0097f0 tx=0x7f456c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0e07af7ffe6b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457affd640 1 -- 172.21.15.31:0/2785220454 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c0b0070 con 0x7f457c12c180 2024-09-12T00:18:38.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457affd640 1 -- 172.21.15.31:0/2785220454 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456c0ab530 con 0x7f457c12c180 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457affd640 1 -- 172.21.15.31:0/2785220454 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c0ab830 con 0x7f457c12c180 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae7328a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae6c06e760 0x7fae6c1347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae7328a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c09d690 con 0x7fae6c09c160 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae7328a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fae6c073a20 con 0x7fae6c06e760 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2785220454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 msgr2=0x7f457c12c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 --2- 172.21.15.31:0/2785220454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c12c560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f456c0097f0 tx=0x7f456c01c4c0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae70825640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae6c06e760 0x7fae6c1347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2785220454 shutdown_connections 2024-09-12T00:18:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 --2- 172.21.15.31:0/2785220454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c12c560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2785220454 >> 172.21.15.31:0/2785220454 conn(0x7f457c071e50 msgr2=0x7f457c072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae70825640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae6c06e760 0x7fae6c1347d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49122/0 (socket says 172.21.15.31:49122) 2024-09-12T00:18:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae70825640 1 -- 172.21.15.31:0/2613540182 learned_addr learned my addr 172.21.15.31:0/2613540182 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2785220454 shutdown_connections 2024-09-12T00:18:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2785220454 wait complete. 2024-09-12T00:18:38.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae70825640 1 -- 172.21.15.31:0/2613540182 >> v1:172.21.15.31:6789/0 conn(0x7fae6c09c160 legacy=0x7fae6c09c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7fae70825640 1 -- 172.21.15.31:0/2613540182 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c06deb0 con 0x7fae6c06e760 2024-09-12T00:18:38.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 Processor -- start 2024-09-12T00:18:38.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- start start 2024-09-12T00:18:38.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41baffd640 1 --2- 172.21.15.31:0/3810831493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12c700 0x7f41bc1346a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f41b00097f0 tx=0x7f41b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1226fc34b25418f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f457c137a90 con 0x7f457c12c180 2024-09-12T00:18:38.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41ba7fc640 1 -- 172.21.15.31:0/3810831493 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41b00b0070 con 0x7f41bc12c700 2024-09-12T00:18:38.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41ba7fc640 1 -- 172.21.15.31:0/3810831493 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00ab530 con 0x7f41bc12c700 2024-09-12T00:18:38.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41ba7fc640 1 -- 172.21.15.31:0/3810831493 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41b00ab830 con 0x7f41bc12c700 2024-09-12T00:18:38.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49134/0 (socket says 172.21.15.31:49134) 2024-09-12T00:18:38.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 -- 172.21.15.31:0/2185399787 learned_addr learned my addr 172.21.15.31:0/2185399787 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 -- 172.21.15.31:0/2185399787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c135180 con 0x7f457c12c180 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f457bfff640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f456c01a0f0 tx=0x7f456c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c0b0040 con 0x7f457c12c180 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f456c0b4440 con 0x7f457c12c180 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2185399787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457c1353b0 con 0x7f457c12c180 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c0b4760 con 0x7f457c12c180 2024-09-12T00:18:38.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f458298a640 1 -- 172.21.15.31:0/2185399787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457c132fc0 con 0x7f457c12c180 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41c2255640 1 -- 172.21.15.31:0/3810831493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12c700 msgr2=0x7f41bc1346a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41c2255640 1 --2- 172.21.15.31:0/3810831493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12c700 0x7f41bc1346a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f41b00097f0 tx=0x7f41b001c430 comp rx=0 tx=0).stop 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41c2255640 1 -- 172.21.15.31:0/3810831493 shutdown_connections 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41c2255640 1 --2- 172.21.15.31:0/3810831493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12c700 0x7f41bc1346a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.377+0000 7f41c2255640 1 -- 172.21.15.31:0/3810831493 >> 172.21.15.31:0/3810831493 conn(0x7f41bc0a0a60 msgr2=0x7f41bc06e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 -- 172.21.15.31:0/3810831493 shutdown_connections 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 -- 172.21.15.31:0/3810831493 wait complete. 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae70825640 1 --2- 172.21.15.31:0/2613540182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c1347d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097f0 tx=0x7fae5c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b85ba0a62dd919b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4554005090 con 0x7f457c12c180 2024-09-12T00:18:38.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae63fff640 1 -- 172.21.15.31:0/2613540182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c0b0070 con 0x7fae6c06e760 2024-09-12T00:18:38.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae63fff640 1 -- 172.21.15.31:0/2613540182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5c0ab530 con 0x7fae6c06e760 2024-09-12T00:18:38.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae63fff640 1 -- 172.21.15.31:0/2613540182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5c0ab830 con 0x7fae6c06e760 2024-09-12T00:18:38.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f456c0bb020 con 0x7f457c12c180 2024-09-12T00:18:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 Processor -- start 2024-09-12T00:18:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 -- start start 2024-09-12T00:18:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f4578ff9640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 0x7f456803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f456c0b9020 con 0x7f457c12c180 2024-09-12T00:18:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f457b7fe640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 0x7f456803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41c2255640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc137790 con 0x7f41bc12bc10 2024-09-12T00:18:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae7328a640 1 -- 172.21.15.31:0/2613540182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 msgr2=0x7fae6c1347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae7328a640 1 --2- 172.21.15.31:0/2613540182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c1347d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097f0 tx=0x7fae5c01c430 comp rx=0 tx=0).stop 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae7328a640 1 -- 172.21.15.31:0/2613540182 shutdown_connections 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae7328a640 1 --2- 172.21.15.31:0/2613540182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c1347d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7fae7328a640 1 -- 172.21.15.31:0/2613540182 >> 172.21.15.31:0/2613540182 conn(0x7fae6c071630 msgr2=0x7fae6c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49150/0 (socket says 172.21.15.31:49150) 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41bb7fe640 1 -- 172.21.15.31:0/3517220312 learned_addr learned my addr 172.21.15.31:0/3517220312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41bb7fe640 1 -- 172.21.15.31:0/3517220312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc073a50 con 0x7f41bc12bc10 2024-09-12T00:18:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f457b7fe640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 0x7f456803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4570001630 tx=0x7f4570007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.381+0000 7f41bb7fe640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c410 tx=0x7f41ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 -- 172.21.15.31:0/2613540182 shutdown_connections 2024-09-12T00:18:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 -- 172.21.15.31:0/2613540182 wait complete. 2024-09-12T00:18:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f456c0c2020 con 0x7f457c12c180 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac017070 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc11c1b0 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc12ab90 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac005200 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ac011650 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41bc12bff0 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f41ac01a070 con 0x7f41bc12bc10 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 0x7f41a803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f41ac04e080 con 0x7f41bc12bc10 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.389+0000 7f41baffd640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 0x7f41a803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.389+0000 7f41baffd640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 0x7f41a803d730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41b00ad000 tx=0x7f41b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 Processor -- start 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 -- start start 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae7328a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c1378c0 con 0x7fae6c06e760 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae71026640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae71026640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49166/0 (socket says 172.21.15.31:49166) 2024-09-12T00:18:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.385+0000 7fae71026640 1 -- 172.21.15.31:0/3771290208 learned_addr learned my addr 172.21.15.31:0/3771290208 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.389+0000 7fae71026640 1 -- 172.21.15.31:0/3771290208 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c116a80 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.389+0000 7fae71026640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c430 tx=0x7fae6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae68017070 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68005200 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c133f80 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae68003600 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c117a80 con 0x7fae6c06e760 2024-09-12T00:18:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f41ac0102e0 con 0x7f41bc12bc10 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c116e10 con 0x7fae6c06e760 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fae6801a070 con 0x7fae6c06e760 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 0x7fae5003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fae6804e280 con 0x7fae6c06e760 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae70825640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 0x7fae5003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:38.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.393+0000 7fae70825640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 0x7fae5003d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae6c074200 tx=0x7fae5c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:38.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.397+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fae6c116e10 con 0x7fae6c06e760 2024-09-12T00:18:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.505+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbd8c06d2c0 con 0x7fbd8c12c030 2024-09-12T00:18:38.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.505+0000 7fbd81ffb640 1 -- 172.21.15.31:0/1041414446 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd880e7950 con 0x7fbd8c12c030 2024-09-12T00:18:38.506 INFO:teuthology.orchestra.run.smithi031.stdout:38654705667 2024-09-12T00:18:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 msgr2=0x7fbd7003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 0x7fbd7003d6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c007fd0 tx=0x7fbd7c007900 comp rx=0 tx=0).stop 2024-09-12T00:18:38.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 msgr2=0x7fbd8c1242e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd88019fa0 tx=0x7fbd8801abb0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 shutdown_connections 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd7003b200 0x7fbd7003d6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 --2- 172.21.15.31:0/1041414446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd8c12c030 0x7fbd8c1242e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 >> 172.21.15.31:0/1041414446 conn(0x7fbd8c0715b0 msgr2=0x7fbd8c06dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 shutdown_connections 2024-09-12T00:18:38.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.509+0000 7fbd934ac640 1 -- 172.21.15.31:0/1041414446 wait complete. 2024-09-12T00:18:38.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2024-09-12T00:18:38.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.553+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4554005380 con 0x7f457c12c180 2024-09-12T00:18:38.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.553+0000 7f4578ff9640 1 -- 172.21.15.31:0/2185399787 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f456c0160b0 con 0x7f457c12c180 2024-09-12T00:18:38.553 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 msgr2=0x7f456803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 0x7f456803d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4570001630 tx=0x7f4570007a00 comp rx=0 tx=0).stop 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 msgr2=0x7f457c1328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f456c01a0f0 tx=0x7f456c019260 comp rx=0 tx=0).stop 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 shutdown_connections 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f456803b1d0 0x7f456803d690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 --2- 172.21.15.31:0/2185399787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f457c12c180 0x7f457c1328b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 >> 172.21.15.31:0/2185399787 conn(0x7f457c071e50 msgr2=0x7f457c125650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 shutdown_connections 2024-09-12T00:18:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.557+0000 7f45627fc640 1 -- 172.21.15.31:0/2185399787 wait complete. 2024-09-12T00:18:38.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-12T00:18:38.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.577+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f41bc11d370 con 0x7f41bc12bc10 2024-09-12T00:18:38.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.577+0000 7f41a3fff640 1 -- 172.21.15.31:0/3517220312 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41ac003600 con 0x7f41bc12bc10 2024-09-12T00:18:38.576 INFO:teuthology.orchestra.run.smithi031.stdout:38654705668 2024-09-12T00:18:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 msgr2=0x7f41a803d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 0x7f41a803d730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41b00ad000 tx=0x7f41b0008040 comp rx=0 tx=0).stop 2024-09-12T00:18:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 msgr2=0x7f41bc12a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c410 tx=0x7f41ac00c8d0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 shutdown_connections 2024-09-12T00:18:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f41a803b270 0x7f41a803d730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 --2- 172.21.15.31:0/3517220312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41bc12bc10 0x7f41bc12a650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 >> 172.21.15.31:0/3517220312 conn(0x7f41bc0a0a60 msgr2=0x7f41bc070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 shutdown_connections 2024-09-12T00:18:38.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.581+0000 7f41c2255640 1 -- 172.21.15.31:0/3517220312 wait complete. 2024-09-12T00:18:38.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fae6c068e50 con 0x7fae6c06e760 2024-09-12T00:18:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae61ffb640 1 -- 172.21.15.31:0/3771290208 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae68021080 con 0x7fae6c06e760 2024-09-12T00:18:38.592 INFO:teuthology.orchestra.run.smithi031.stdout:38654705667 2024-09-12T00:18:38.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.1 2024-09-12T00:18:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 msgr2=0x7fae5003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 0x7fae5003d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae6c074200 tx=0x7fae5c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:18:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 msgr2=0x7fae6c120240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c430 tx=0x7fae6800c8f0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 shutdown_connections 2024-09-12T00:18:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fae5003b1d0 0x7fae5003d690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 --2- 172.21.15.31:0/3771290208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c06e760 0x7fae6c120240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 >> 172.21.15.31:0/3771290208 conn(0x7fae6c071630 msgr2=0x7fae6c12bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 shutdown_connections 2024-09-12T00:18:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:38.593+0000 7fae7328a640 1 -- 172.21.15.31:0/3771290208 wait complete. 2024-09-12T00:18:38.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2024-09-12T00:18:39.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:18:39.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:18:39.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:18:39.608 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:18:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16de7fb640 1 Processor -- start 2024-09-12T00:18:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16de7fb640 1 -- start start 2024-09-12T00:18:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16de7fb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16d812fc70 0x7f16d81346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16de7fb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d80718c0 con 0x7f16d812f180 2024-09-12T00:18:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16de7fb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f16d8071150 con 0x7f16d812fc70 2024-09-12T00:18:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16d7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16d812f180 0x7f16d812f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37890/0 (socket says 172.21.15.31:37890) 2024-09-12T00:18:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16d77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16d812fc70 0x7f16d81346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16d7fff640 1 -- 172.21.15.31:0/405275345 learned_addr learned my addr 172.21.15.31:0/405275345 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16d77fe640 1 -- 172.21.15.31:0/405275345 >> v1:172.21.15.31:6789/0 conn(0x7f16d812f180 legacy=0x7f16d812f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.661+0000 7f16d77fe640 1 -- 172.21.15.31:0/405275345 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d8073450 con 0x7f16d812fc70 2024-09-12T00:18:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16d77fe640 1 --2- 172.21.15.31:0/405275345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812fc70 0x7f16d81346b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009740 tx=0x7f16cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623371ccb61c3796 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16d6ffd640 1 -- 172.21.15.31:0/405275345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16cc0ab550 con 0x7f16d812fc70 2024-09-12T00:18:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16d6ffd640 1 -- 172.21.15.31:0/405275345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc0b0070 con 0x7f16d812fc70 2024-09-12T00:18:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16d6ffd640 1 -- 172.21.15.31:0/405275345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16cc0ab840 con 0x7f16d812fc70 2024-09-12T00:18:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- 172.21.15.31:0/405275345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812fc70 msgr2=0x7f16d81346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 --2- 172.21.15.31:0/405275345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812fc70 0x7f16d81346b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009740 tx=0x7f16cc01c400 comp rx=0 tx=0).stop 2024-09-12T00:18:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- 172.21.15.31:0/405275345 shutdown_connections 2024-09-12T00:18:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 --2- 172.21.15.31:0/405275345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812fc70 0x7f16d81346b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- 172.21.15.31:0/405275345 >> 172.21.15.31:0/405275345 conn(0x7f16d809ba60 msgr2=0x7f16d806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- 172.21.15.31:0/405275345 shutdown_connections 2024-09-12T00:18:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- 172.21.15.31:0/405275345 wait complete. 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 Processor -- start 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- start start 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.665+0000 7f16de7fb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81377a0 con 0x7f16d812f180 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49192/0 (socket says 172.21.15.31:49192) 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d7fff640 1 -- 172.21.15.31:0/1795254142 learned_addr learned my addr 172.21.15.31:0/1795254142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d7fff640 1 -- 172.21.15.31:0/1795254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d8121230 con 0x7f16d812f180 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d7fff640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c450 tx=0x7f16c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16c8017070 con 0x7f16d812f180 2024-09-12T00:18:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c8005c20 con 0x7f16d812f180 2024-09-12T00:18:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16de7fb640 1 -- 172.21.15.31:0/1795254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d8120000 con 0x7f16d812f180 2024-09-12T00:18:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16c80070d0 con 0x7f16d812f180 2024-09-12T00:18:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16de7fb640 1 -- 172.21.15.31:0/1795254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d812e770 con 0x7f16d812f180 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d812eab0 con 0x7f16d812f180 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f16c801a070 con 0x7f16d812f180 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 0x7f16c403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f16c804df70 con 0x7f16d812f180 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.669+0000 7f16d77fe640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 0x7f16c403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.673+0000 7f16d77fe640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 0x7f16c403d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0af000 tx=0x7f16cc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.673+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f16d8121230 con 0x7f16d812f180 2024-09-12T00:18:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.693+0000 7f9f1d73e640 1 Processor -- start 2024-09-12T00:18:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.693+0000 7f9f1d73e640 1 -- start start 2024-09-12T00:18:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f1d73e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f1809c160 0x7f9f1809c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f1d73e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809d690 con 0x7f9f1806e760 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f1d73e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9f18073a20 con 0x7f9f1809c160 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f16ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f1809c160 0x7f9f1809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f167fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9f1806e760 0x7f9f18128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37900/0 (socket says 172.21.15.31:37900) 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f167fc640 1 -- 172.21.15.31:0/3315568877 learned_addr learned my addr 172.21.15.31:0/3315568877 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f16ffd640 1 -- 172.21.15.31:0/3315568877 >> v1:172.21.15.31:6789/0 conn(0x7f9f1806e760 legacy=0x7f9f18128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f15ffb640 1 -- 172.21.15.31:0/3315568877 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708300523 0 0) 0x7f9f1809d690 con 0x7f9f1806e760 2024-09-12T00:18:39.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f16ffd640 1 -- 172.21.15.31:0/3315568877 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1806deb0 con 0x7f9f1809c160 2024-09-12T00:18:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f16ffd640 1 --2- 172.21.15.31:0/3315568877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1809c160 0x7f9f1809c540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009740 tx=0x7f9f0801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75355005a95db28f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f15ffb640 1 -- 172.21.15.31:0/3315568877 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f080b1070 con 0x7f9f1809c160 2024-09-12T00:18:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f15ffb640 1 -- 172.21.15.31:0/3315568877 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f080ac520 con 0x7f9f1809c160 2024-09-12T00:18:39.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f15ffb640 1 -- 172.21.15.31:0/3315568877 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f080ac820 con 0x7f9f1809c160 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f1d73e640 1 -- 172.21.15.31:0/3315568877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1809c160 msgr2=0x7f9f1809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.697+0000 7f9f1d73e640 1 --2- 172.21.15.31:0/3315568877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1809c160 0x7f9f1809c540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009740 tx=0x7f9f0801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/3315568877 shutdown_connections 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 --2- 172.21.15.31:0/3315568877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1809c160 0x7f9f1809c540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/3315568877 >> 172.21.15.31:0/3315568877 conn(0x7f9f18071630 msgr2=0x7f9f1809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/3315568877 shutdown_connections 2024-09-12T00:18:39.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/3315568877 wait complete. 2024-09-12T00:18:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 Processor -- start 2024-09-12T00:18:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- start start 2024-09-12T00:18:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18137b80 con 0x7f9f1806e760 2024-09-12T00:18:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f16ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f16ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49202/0 (socket says 172.21.15.31:49202) 2024-09-12T00:18:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f16ffd640 1 -- 172.21.15.31:0/2692409668 learned_addr learned my addr 172.21.15.31:0/2692409668 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f16ffd640 1 -- 172.21.15.31:0/2692409668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1811a580 con 0x7f9f1806e760 2024-09-12T00:18:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f16ffd640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f080af040 tx=0x7f9f08019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f080b9070 con 0x7f9f1806e760 2024-09-12T00:18:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f080b5410 con 0x7f9f1806e760 2024-09-12T00:18:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f080b1040 con 0x7f9f1806e760 2024-09-12T00:18:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/2692409668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f18127e30 con 0x7f9f1806e760 2024-09-12T00:18:39.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9f1d73e640 1 -- 172.21.15.31:0/2692409668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f181282f0 con 0x7f9f1806e760 2024-09-12T00:18:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef0005090 con 0x7f9f1806e760 2024-09-12T00:18:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.701+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9f080bc070 con 0x7f9f1806e760 2024-09-12T00:18:39.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.705+0000 7f9eff7fe640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 0x7f9f0403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.705+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f9f080e8ab0 con 0x7f9f1806e760 2024-09-12T00:18:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.705+0000 7f9f167fc640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 0x7f9f0403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.705+0000 7f9f167fc640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 0x7f9f0403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007fd0 tx=0x7f9f0c0078e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.713+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9f080a9070 con 0x7f9f1806e760 2024-09-12T00:18:39.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f7d2ec640 1 Processor -- start 2024-09-12T00:18:39.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba32930640 1 Processor -- start 2024-09-12T00:18:39.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba32930640 1 -- start start 2024-09-12T00:18:39.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f7d2ec640 1 -- start start 2024-09-12T00:18:39.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba32930640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fba2c1141a0 0x7fba2c114580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba32930640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2c116c60 con 0x7fba2c116370 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba32930640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fba2c115610 con 0x7fba2c1141a0 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2b7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fba2c116370 0x7fba2c1254a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37904/0 (socket says 172.21.15.31:37904) 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2b7fe640 1 -- 172.21.15.31:0/3977045168 learned_addr learned my addr 172.21.15.31:0/3977045168 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f7d2ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f7806e7d0 0x7f1f78132600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f7d2ec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f78114aa0 con 0x7f1f7806dce0 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f7d2ec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1f78114e40 con 0x7f1f7806e7d0 2024-09-12T00:18:39.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2bfff640 1 --2- 172.21.15.31:0/3977045168 >> v2:172.21.15.31:3300/0 conn(0x7fba2c1141a0 0x7fba2c114580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f76ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1f7806dce0 0x7f1f7806e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37912/0 (socket says 172.21.15.31:37912) 2024-09-12T00:18:39.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f76ffd640 1 -- 172.21.15.31:0/2400691339 learned_addr learned my addr 172.21.15.31:0/2400691339 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:39.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f767fc640 1 --2- 172.21.15.31:0/2400691339 >> v2:172.21.15.31:3300/0 conn(0x7f1f7806e7d0 0x7f1f78132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2affd640 1 -- 172.21.15.31:0/3977045168 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347661079 0 0) 0x7fba2c116c60 con 0x7fba2c116370 2024-09-12T00:18:39.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2affd640 1 -- 172.21.15.31:0/3977045168 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14003530 con 0x7fba2c116370 2024-09-12T00:18:39.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f767fc640 1 -- 172.21.15.31:0/2400691339 >> v1:172.21.15.31:6789/0 conn(0x7f1f7806dce0 legacy=0x7f1f7806e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7f1f767fc640 1 -- 172.21.15.31:0/2400691339 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f78073b10 con 0x7f1f7806e7d0 2024-09-12T00:18:39.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2bfff640 1 -- 172.21.15.31:0/3977045168 >> v1:172.21.15.31:6789/0 conn(0x7fba2c116370 legacy=0x7fba2c1254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.733+0000 7fba2bfff640 1 -- 172.21.15.31:0/3977045168 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c0736f0 con 0x7fba2c1141a0 2024-09-12T00:18:39.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f767fc640 1 --2- 172.21.15.31:0/2400691339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806e7d0 0x7f1f78132600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009740 tx=0x7f1f6c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d17f70f4c5b0a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f75ffb640 1 -- 172.21.15.31:0/2400691339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c0b0070 con 0x7f1f7806e7d0 2024-09-12T00:18:39.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f75ffb640 1 -- 172.21.15.31:0/2400691339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0ab530 con 0x7f1f7806e7d0 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f75ffb640 1 -- 172.21.15.31:0/2400691339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c0ab830 con 0x7f1f7806e7d0 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2400691339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806e7d0 msgr2=0x7f1f78132600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2400691339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806e7d0 0x7f1f78132600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009740 tx=0x7f1f6c01c370 comp rx=0 tx=0).stop 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2400691339 shutdown_connections 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2400691339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806e7d0 0x7f1f78132600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2400691339 >> 172.21.15.31:0/2400691339 conn(0x7f1f780709b0 msgr2=0x7f1f78072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2400691339 shutdown_connections 2024-09-12T00:18:39.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2400691339 wait complete. 2024-09-12T00:18:39.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba2bfff640 1 --2- 172.21.15.31:0/3977045168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c1141a0 0x7fba2c114580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009740 tx=0x7fba1c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f91d07abdd7a3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba2affd640 1 -- 172.21.15.31:0/3977045168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c0b0070 con 0x7fba2c1141a0 2024-09-12T00:18:39.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba2affd640 1 -- 172.21.15.31:0/3977045168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c0ab530 con 0x7fba2c1141a0 2024-09-12T00:18:39.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba2affd640 1 -- 172.21.15.31:0/3977045168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c0b0070 con 0x7fba2c1141a0 2024-09-12T00:18:39.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 Processor -- start 2024-09-12T00:18:39.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- start start 2024-09-12T00:18:39.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 -- 172.21.15.31:0/3977045168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c1141a0 msgr2=0x7fba2c114580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 --2- 172.21.15.31:0/3977045168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c1141a0 0x7fba2c114580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009740 tx=0x7fba1c01c370 comp rx=0 tx=0).stop 2024-09-12T00:18:39.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 -- 172.21.15.31:0/3977045168 shutdown_connections 2024-09-12T00:18:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 --2- 172.21.15.31:0/3977045168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c1141a0 0x7fba2c114580 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009740 tx=0x7fba1c01c370 comp rx=0 tx=0).stop 2024-09-12T00:18:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 -- 172.21.15.31:0/3977045168 >> 172.21.15.31:0/3977045168 conn(0x7fba2c06f950 msgr2=0x7fba2c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 -- 172.21.15.31:0/3977045168 shutdown_connections 2024-09-12T00:18:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7fba32930640 1 -- 172.21.15.31:0/3977045168 wait complete. 2024-09-12T00:18:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f7d2ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78135570 con 0x7f1f7806dce0 2024-09-12T00:18:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f76ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49224/0 (socket says 172.21.15.31:49224) 2024-09-12T00:18:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.737+0000 7f1f76ffd640 1 -- 172.21.15.31:0/2544145554 learned_addr learned my addr 172.21.15.31:0/2544145554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f76ffd640 1 -- 172.21.15.31:0/2544145554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f78132170 con 0x7f1f7806dce0 2024-09-12T00:18:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba32930640 1 Processor -- start 2024-09-12T00:18:39.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f76ffd640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c450 tx=0x7f1f6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba32930640 1 -- start start 2024-09-12T00:18:39.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f68017070 con 0x7f1f7806dce0 2024-09-12T00:18:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f68005c20 con 0x7f1f7806dce0 2024-09-12T00:18:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f781159b0 con 0x7f1f7806dce0 2024-09-12T00:18:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f680070d0 con 0x7f1f7806dce0 2024-09-12T00:18:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f78116830 con 0x7f1f7806dce0 2024-09-12T00:18:39.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba32930640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba32930640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c137b70 con 0x7fba2c116370 2024-09-12T00:18:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49236/0 (socket says 172.21.15.31:49236) 2024-09-12T00:18:39.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba2bfff640 1 -- 172.21.15.31:0/2757420727 learned_addr learned my addr 172.21.15.31:0/2757420727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58005090 con 0x7f1f7806dce0 2024-09-12T00:18:39.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba2bfff640 1 -- 172.21.15.31:0/2757420727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c129980 con 0x7fba2c116370 2024-09-12T00:18:39.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1f6801a070 con 0x7f1f7806dce0 2024-09-12T00:18:39.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 0x7f1f6403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7fba2bfff640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba1c019fa0 tx=0x7fba1c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f1f6804e020 con 0x7f1f7806dce0 2024-09-12T00:18:39.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f767fc640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 0x7f1f6403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.741+0000 7f1f767fc640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 0x7f1f6403d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0ad000 tx=0x7f1f6c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c0b0070 con 0x7fba2c116370 2024-09-12T00:18:39.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c004030 con 0x7fba2c116370 2024-09-12T00:18:39.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c006e20 con 0x7fba2c116370 2024-09-12T00:18:39.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2c134e00 con 0x7fba2c116370 2024-09-12T00:18:39.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2c117350 con 0x7fba2c116370 2024-09-12T00:18:39.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.745+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1f6801b3b0 con 0x7f1f7806dce0 2024-09-12T00:18:39.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2c114580 con 0x7fba2c116370 2024-09-12T00:18:39.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fba1c004310 con 0x7fba2c116370 2024-09-12T00:18:39.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba28ff9640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 0x7fba1803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:39.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fba1c0e9730 con 0x7fba2c116370 2024-09-12T00:18:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba2b7fe640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 0x7fba1803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.749+0000 7fba2b7fe640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 0x7fba1803d690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba20007fd0 tx=0x7fba20007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.753+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fba1c015ff0 con 0x7fba2c116370 2024-09-12T00:18:39.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f16d812f560 con 0x7f16d812f180 2024-09-12T00:18:39.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16d4ff9640 1 -- 172.21.15.31:0/1795254142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f16c8007270 con 0x7f16d812f180 2024-09-12T00:18:39.851 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 msgr2=0x7f16c403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16be7fc640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 0x7f16c403d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0af000 tx=0x7f16cc0a7000 comp rx=0 tx=0).stop 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 msgr2=0x7f16d812e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.853+0000 7f16be7fc640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c450 tx=0x7f16c800c910 comp rx=0 tx=0).stop 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 shutdown_connections 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f16c403b1d0 0x7f16c403d690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 --2- 172.21.15.31:0/1795254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16d812f180 0x7f16d812e230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 >> 172.21.15.31:0/1795254142 conn(0x7f16d809ba60 msgr2=0x7f16d81326a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 shutdown_connections 2024-09-12T00:18:39.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.857+0000 7f16be7fc640 1 -- 172.21.15.31:0/1795254142 wait complete. 2024-09-12T00:18:39.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-09-12T00:18:39.874 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.893+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9ef0005380 con 0x7f9f1806e760 2024-09-12T00:18:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.893+0000 7f9eff7fe640 1 -- 172.21.15.31:0/2692409668 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f08015ff0 con 0x7f9f1806e760 2024-09-12T00:18:39.892 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 msgr2=0x7f9f0403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 0x7f9f0403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c007fd0 tx=0x7f9f0c0078e0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 msgr2=0x7f9f181278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f080af040 tx=0x7f9f08019110 comp rx=0 tx=0).stop 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 shutdown_connections 2024-09-12T00:18:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9f0403b1d0 0x7f9f0403d690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 --2- 172.21.15.31:0/2692409668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806e760 0x7f9f181278f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 >> 172.21.15.31:0/2692409668 conn(0x7f9f18071630 msgr2=0x7f9f1809d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 shutdown_connections 2024-09-12T00:18:39.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.897+0000 7f9efd7fa640 1 -- 172.21.15.31:0/2692409668 wait complete. 2024-09-12T00:18:39.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-12T00:18:39.909 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:39.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1f58005380 con 0x7f1f7806dce0 2024-09-12T00:18:39.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f5f7fe640 1 -- 172.21.15.31:0/2544145554 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f6801b730 con 0x7f1f7806dce0 2024-09-12T00:18:39.910 INFO:teuthology.orchestra.run.smithi031.stdout:38654705670 2024-09-12T00:18:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 msgr2=0x7f1f6403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 0x7f1f6403d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0ad000 tx=0x7f1f6c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:18:39.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 msgr2=0x7f1f781c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c450 tx=0x7f1f6800c910 comp rx=0 tx=0).stop 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 shutdown_connections 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1f6403b1d0 0x7f1f6403d690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 --2- 172.21.15.31:0/2544145554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7806dce0 0x7f1f781c4af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 >> 172.21.15.31:0/2544145554 conn(0x7f1f780709b0 msgr2=0x7f1f78124380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 shutdown_connections 2024-09-12T00:18:39.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.913+0000 7f1f7d2ec640 1 -- 172.21.15.31:0/2544145554 wait complete. 2024-09-12T00:18:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.921+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fba2c068e50 con 0x7fba2c116370 2024-09-12T00:18:39.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.921+0000 7fba28ff9640 1 -- 172.21.15.31:0/2757420727 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba1c0b5d20 con 0x7fba2c116370 2024-09-12T00:18:39.921 INFO:teuthology.orchestra.run.smithi031.stdout:38654705669 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 msgr2=0x7fba1803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 0x7fba1803d690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba20007fd0 tx=0x7fba20007900 comp rx=0 tx=0).stop 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 msgr2=0x7fba2c132a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba1c019fa0 tx=0x7fba1c01abb0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 shutdown_connections 2024-09-12T00:18:39.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fba1803b1d0 0x7fba1803d690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 --2- 172.21.15.31:0/2757420727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba2c116370 0x7fba2c132a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 >> 172.21.15.31:0/2757420727 conn(0x7fba2c06f950 msgr2=0x7fba2c12f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 shutdown_connections 2024-09-12T00:18:39.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:39.925+0000 7fba32930640 1 -- 172.21.15.31:0/2757420727 wait complete. 2024-09-12T00:18:39.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-09-12T00:18:39.928 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:39.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-09-12T00:18:39.938 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:39.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:18:39.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdff29de640 1 Processor -- start 2024-09-12T00:18:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdff29de640 1 -- start start 2024-09-12T00:18:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdff29de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfec06e7d0 0x7fdfec134850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdff29de640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfec075e50 con 0x7fdfec06dce0 2024-09-12T00:18:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdff29de640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec09c160 con 0x7fdfec06e7d0 2024-09-12T00:18:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfeb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfec06e7d0 0x7fdfec134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfebfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdfec06dce0 0x7fdfec06e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37916/0 (socket says 172.21.15.31:37916) 2024-09-12T00:18:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfeb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfec06e7d0 0x7fdfec134850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49246/0 (socket says 172.21.15.31:49246) 2024-09-12T00:18:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfebfff640 1 -- 172.21.15.31:0/39915467 learned_addr learned my addr 172.21.15.31:0/39915467 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfeb7fe640 1 -- 172.21.15.31:0/39915467 >> v1:172.21.15.31:6789/0 conn(0x7fdfec06dce0 legacy=0x7fdfec06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.093+0000 7fdfeb7fe640 1 -- 172.21.15.31:0/39915467 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec09d660 con 0x7fdfec06e7d0 2024-09-12T00:18:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfeb7fe640 1 --2- 172.21.15.31:0/39915467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06e7d0 0x7fdfec134850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009770 tx=0x7fdfd401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c8d5595d3c8972 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfeaffd640 1 -- 172.21.15.31:0/39915467 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfd40b0070 con 0x7fdfec06e7d0 2024-09-12T00:18:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfeaffd640 1 -- 172.21.15.31:0/39915467 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40ab530 con 0x7fdfec06e7d0 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/39915467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06e7d0 msgr2=0x7fdfec134850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 --2- 172.21.15.31:0/39915467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06e7d0 0x7fdfec134850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009770 tx=0x7fdfd401c370 comp rx=0 tx=0).stop 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/39915467 shutdown_connections 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 --2- 172.21.15.31:0/39915467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06e7d0 0x7fdfec134850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/39915467 >> 172.21.15.31:0/39915467 conn(0x7fdfec0715c0 msgr2=0x7fdfec09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/39915467 shutdown_connections 2024-09-12T00:18:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/39915467 wait complete. 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 Processor -- start 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- start start 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1377c0 con 0x7fdfec06dce0 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49260/0 (socket says 172.21.15.31:49260) 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfebfff640 1 -- 172.21.15.31:0/1127586984 learned_addr learned my addr 172.21.15.31:0/1127586984 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfebfff640 1 -- 172.21.15.31:0/1127586984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec1339c0 con 0x7fdfec06dce0 2024-09-12T00:18:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfebfff640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400cb40 tx=0x7fdfe400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4017070 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec11b190 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe400aba0 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4012400 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.097+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec11b460 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec11b7a0 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdfe401a070 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdfe8ff9640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 0x7fdfcc03d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fdfe404ea30 con 0x7fdfec06dce0 2024-09-12T00:18:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdfeb7fe640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 0x7fdfcc03d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.101+0000 7fdfeb7fe640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 0x7fdfcc03d640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ad000 tx=0x7fdfd40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.105+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdfec11b7a0 con 0x7fdfec06dce0 2024-09-12T00:18:40.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.265+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfec06e0c0 con 0x7fdfcc03b180 2024-09-12T00:18:40.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdfe8ff9640 1 -- 172.21.15.31:0/1127586984 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32184 (secure 0 0 0) 0x7fdfec06e0c0 con 0x7fdfcc03b180 2024-09-12T00:18:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:40.268 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:18:40.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 msgr2=0x7fdfcc03d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 0x7fdfcc03d640 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40ad000 tx=0x7fdfd40a6000 comp rx=0 tx=0).stop 2024-09-12T00:18:40.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 msgr2=0x7fdfec1c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400cb40 tx=0x7fdfe400a060 comp rx=0 tx=0).stop 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 shutdown_connections 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdfcc03b180 0x7fdfcc03d640 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 --2- 172.21.15.31:0/1127586984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfec06dce0 0x7fdfec1c69e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 >> 172.21.15.31:0/1127586984 conn(0x7fdfec0715c0 msgr2=0x7fdfec09d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 shutdown_connections 2024-09-12T00:18:40.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.269+0000 7fdff29de640 1 -- 172.21.15.31:0/1127586984 wait complete. 2024-09-12T00:18:40.284 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-12T00:18:38.501630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109844,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377516,"statfs":{"total":386547056640,"available":386434576384,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":110618393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.901093"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.634922+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:18:36.634922+0000","last_peered":"2024-09-12T00:18:36.634922+0000","last_clean":"2024-09-12T00:18:36.634922+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:18:36.634922+0000","last_undegraded":"2024-09-12T00:18:36.634922+0000","last_fullsized":"2024-09-12T00:18:36.634922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.631250+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:18:36.631250+0000","last_peered":"2024-09-12T00:18:36.631250+0000","last_clean":"2024-09-12T00:18:36.631250+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:18:36.631250+0000","last_undegraded":"2024-09-12T00:18:36.631250+0000","last_fullsized":"2024-09-12T00:18:36.631250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.634772+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:18:36.634772+0000","last_peered":"2024-09-12T00:18:36.634772+0000","last_clean":"2024-09-12T00:18:36.634772+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:18:36.634772+0000","last_undegraded":"2024-09-12T00:18:36.634772+0000","last_fullsized":"2024-09-12T00:18:36.634772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.631349+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:18:36.631349+0000","last_peered":"2024-09-12T00:18:36.631349+0000","last_clean":"2024-09-12T00:18:36.631349+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:18:36.631349+0000","last_undegraded":"2024-09-12T00:18:36.631349+0000","last_fullsized":"2024-09-12T00:18:36.631349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.636399+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:18:36.636399+0000","last_peered":"2024-09-12T00:18:36.636399+0000","last_clean":"2024-09-12T00:18:36.636399+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:18:36.636399+0000","last_undegraded":"2024-09-12T00:18:36.636399+0000","last_fullsized":"2024-09-12T00:18:36.636399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.689595+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:18:36.689595+0000","last_peered":"2024-09-12T00:18:36.689595+0000","last_clean":"2024-09-12T00:18:36.689595+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:18:36.689595+0000","last_undegraded":"2024-09-12T00:18:36.689595+0000","last_fullsized":"2024-09-12T00:18:36.689595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.633162+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:18:36.633162+0000","last_peered":"2024-09-12T00:18:36.633162+0000","last_clean":"2024-09-12T00:18:36.633162+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:18:36.633162+0000","last_undegraded":"2024-09-12T00:18:36.633162+0000","last_fullsized":"2024-09-12T00:18:36.633162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.633083+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:18:36.633083+0000","last_peered":"2024-09-12T00:18:36.633083+0000","last_clean":"2024-09-12T00:18:36.633083+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:18:36.633083+0000","last_undegraded":"2024-09-12T00:18:36.633083+0000","last_fullsized":"2024-09-12T00:18:36.633083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":111,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:37.151049+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:18:37.151049+0000","last_peered":"2024-09-12T00:18:37.151049+0000","last_clean":"2024-09-12T00:18:37.151049+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:18:37.151049+0000","last_undegraded":"2024-09-12T00:18:37.151049+0000","last_fullsized":"2024-09-12T00:18:37.151049+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:40.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:40.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb29f6e640 1 Processor -- start 2024-09-12T00:18:40.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb29f6e640 1 -- start start 2024-09-12T00:18:40.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb29f6e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb24111890 0x7feb24132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb29f6e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb24073a90 con 0x7feb24110da0 2024-09-12T00:18:40.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb29f6e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feb240696e0 con 0x7feb24111890 2024-09-12T00:18:40.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb237fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feb24110da0 0x7feb24111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37926/0 (socket says 172.21.15.31:37926) 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.405+0000 7feb237fe640 1 -- 172.21.15.31:0/3411459782 learned_addr learned my addr 172.21.15.31:0/3411459782 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb22ffd640 1 --2- 172.21.15.31:0/3411459782 >> v2:172.21.15.31:3300/0 conn(0x7feb24111890 0x7feb24132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb227fc640 1 -- 172.21.15.31:0/3411459782 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259506526 0 0) 0x7feb24073a90 con 0x7feb24110da0 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb227fc640 1 -- 172.21.15.31:0/3411459782 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb0c003530 con 0x7feb24110da0 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb22ffd640 1 -- 172.21.15.31:0/3411459782 >> v1:172.21.15.31:6789/0 conn(0x7feb24110da0 legacy=0x7feb24111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb22ffd640 1 -- 172.21.15.31:0/3411459782 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2406dd50 con 0x7feb24111890 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb22ffd640 1 --2- 172.21.15.31:0/3411459782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24111890 0x7feb24132450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb18009740 tx=0x7feb1801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1357e8cc138a0476 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb227fc640 1 -- 172.21.15.31:0/3411459782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb180b0070 con 0x7feb24111890 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb227fc640 1 -- 172.21.15.31:0/3411459782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb180ab530 con 0x7feb24111890 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb227fc640 1 -- 172.21.15.31:0/3411459782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb180ab810 con 0x7feb24111890 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- 172.21.15.31:0/3411459782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24111890 msgr2=0x7feb24132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3411459782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24111890 0x7feb24132450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb18009740 tx=0x7feb1801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- 172.21.15.31:0/3411459782 shutdown_connections 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3411459782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24111890 0x7feb24132450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- 172.21.15.31:0/3411459782 >> 172.21.15.31:0/3411459782 conn(0x7feb24070900 msgr2=0x7feb24072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- 172.21.15.31:0/3411459782 shutdown_connections 2024-09-12T00:18:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- 172.21.15.31:0/3411459782 wait complete. 2024-09-12T00:18:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 Processor -- start 2024-09-12T00:18:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.409+0000 7feb29f6e640 1 -- start start 2024-09-12T00:18:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb29f6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb29f6e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feb24135330 con 0x7feb24110da0 2024-09-12T00:18:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb237fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb237fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49280/0 (socket says 172.21.15.31:49280) 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb237fe640 1 -- 172.21.15.31:0/3149696763 learned_addr learned my addr 172.21.15.31:0/3149696763 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb237fe640 1 -- 172.21.15.31:0/3149696763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb241314c0 con 0x7feb24110da0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb237fe640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00cb40 tx=0x7feb1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c00ab50 con 0x7feb24110da0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c00acf0 con 0x7feb24110da0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb1c012530 con 0x7feb24110da0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb24131da0 con 0x7feb24110da0 2024-09-12T00:18:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb241221f0 con 0x7feb24110da0 2024-09-12T00:18:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb241320e0 con 0x7feb24110da0 2024-09-12T00:18:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feb1c0126d0 con 0x7feb24110da0 2024-09-12T00:18:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 0x7feb1003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7feb1c04f2f0 con 0x7feb24110da0 2024-09-12T00:18:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb22ffd640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 0x7feb1003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.413+0000 7feb22ffd640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 0x7feb1003d6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb180ad000 tx=0x7feb18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.417+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feb241320e0 con 0x7feb24110da0 2024-09-12T00:18:40.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.577+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb24115540 con 0x7feb1003b200 2024-09-12T00:18:40.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb0bfff640 1 -- 172.21.15.31:0/3149696763 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32184 (secure 0 0 0) 0x7feb24115540 con 0x7feb1003b200 2024-09-12T00:18:40.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:40.580 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:18:40.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 msgr2=0x7feb1003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 0x7feb1003d6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb180ad000 tx=0x7feb18008040 comp rx=0 tx=0).stop 2024-09-12T00:18:40.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 msgr2=0x7feb24121ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00cb40 tx=0x7feb1c00a060 comp rx=0 tx=0).stop 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 shutdown_connections 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feb1003b200 0x7feb1003d6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 --2- 172.21.15.31:0/3149696763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb24110da0 0x7feb24121ae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 >> 172.21.15.31:0/3149696763 conn(0x7feb24070900 msgr2=0x7feb24129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 shutdown_connections 2024-09-12T00:18:40.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.581+0000 7feb29f6e640 1 -- 172.21.15.31:0/3149696763 wait complete. 2024-09-12T00:18:40.596 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T00:18:40.502164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109844,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377516,"statfs":{"total":386547056640,"available":386434576384,"internally_reserved":0,"allocated":1753088,"data_stored":1361342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":110618393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.634922+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:18:36.634922+0000","last_peered":"2024-09-12T00:18:36.634922+0000","last_clean":"2024-09-12T00:18:36.634922+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:18:36.634922+0000","last_undegraded":"2024-09-12T00:18:36.634922+0000","last_fullsized":"2024-09-12T00:18:36.634922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.631250+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:18:36.631250+0000","last_peered":"2024-09-12T00:18:36.631250+0000","last_clean":"2024-09-12T00:18:36.631250+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:18:36.631250+0000","last_undegraded":"2024-09-12T00:18:36.631250+0000","last_fullsized":"2024-09-12T00:18:36.631250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.634772+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:18:36.634772+0000","last_peered":"2024-09-12T00:18:36.634772+0000","last_clean":"2024-09-12T00:18:36.634772+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:18:36.634772+0000","last_undegraded":"2024-09-12T00:18:36.634772+0000","last_fullsized":"2024-09-12T00:18:36.634772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.631349+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:18:36.631349+0000","last_peered":"2024-09-12T00:18:36.631349+0000","last_clean":"2024-09-12T00:18:36.631349+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:18:36.631349+0000","last_undegraded":"2024-09-12T00:18:36.631349+0000","last_fullsized":"2024-09-12T00:18:36.631349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.636399+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:18:36.636399+0000","last_peered":"2024-09-12T00:18:36.636399+0000","last_clean":"2024-09-12T00:18:36.636399+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:18:36.636399+0000","last_undegraded":"2024-09-12T00:18:36.636399+0000","last_fullsized":"2024-09-12T00:18:36.636399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.689595+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:18:36.689595+0000","last_peered":"2024-09-12T00:18:36.689595+0000","last_clean":"2024-09-12T00:18:36.689595+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:18:36.689595+0000","last_undegraded":"2024-09-12T00:18:36.689595+0000","last_fullsized":"2024-09-12T00:18:36.689595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.633162+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:18:36.633162+0000","last_peered":"2024-09-12T00:18:36.633162+0000","last_clean":"2024-09-12T00:18:36.633162+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:18:36.633162+0000","last_undegraded":"2024-09-12T00:18:36.633162+0000","last_fullsized":"2024-09-12T00:18:36.633162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.633083+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:18:36.633083+0000","last_peered":"2024-09-12T00:18:36.633083+0000","last_clean":"2024-09-12T00:18:36.633083+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:18:36.633083+0000","last_undegraded":"2024-09-12T00:18:36.633083+0000","last_fullsized":"2024-09-12T00:18:36.633083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":111,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T00:18:37.151049+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:18:37.151049+0000","last_peered":"2024-09-12T00:18:37.151049+0000","last_clean":"2024-09-12T00:18:37.151049+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:18:37.151049+0000","last_undegraded":"2024-09-12T00:18:37.151049+0000","last_fullsized":"2024-09-12T00:18:37.151049+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":635510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":45161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:40.597 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:18:40.597 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:18:40.598 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:18:40.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:18:40.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe86ddd5640 1 Processor -- start 2024-09-12T00:18:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe86ddd5640 1 -- start start 2024-09-12T00:18:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe86ddd5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe868110da0 0x7fe868111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe86ddd5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe868112730 con 0x7fe8681116c0 2024-09-12T00:18:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe86ddd5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe868073a90 con 0x7fe868110da0 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe866ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe8681116c0 0x7fe86812be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37932/0 (socket says 172.21.15.31:37932) 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe866ffd640 1 -- 172.21.15.31:0/1650796739 learned_addr learned my addr 172.21.15.31:0/1650796739 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe8677fe640 1 --2- 172.21.15.31:0/1650796739 >> v2:172.21.15.31:3300/0 conn(0x7fe868110da0 0x7fe868111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe8667fc640 1 -- 172.21.15.31:0/1650796739 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688618406 0 0) 0x7fe85c001120 con 0x7fe8681116c0 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe8667fc640 1 -- 172.21.15.31:0/1650796739 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003530 con 0x7fe8681116c0 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe8677fe640 1 -- 172.21.15.31:0/1650796739 >> v1:172.21.15.31:6789/0 conn(0x7fe8681116c0 legacy=0x7fe86812be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.713+0000 7fe8677fe640 1 -- 172.21.15.31:0/1650796739 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe868112b70 con 0x7fe868110da0 2024-09-12T00:18:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.717+0000 7fe8677fe640 1 --2- 172.21.15.31:0/1650796739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe868111180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe858009740 tx=0x7fe85801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8497a0aded508c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.717+0000 7fe8667fc640 1 -- 172.21.15.31:0/1650796739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8580b0070 con 0x7fe868110da0 2024-09-12T00:18:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.717+0000 7fe8667fc640 1 -- 172.21.15.31:0/1650796739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8580ab530 con 0x7fe868110da0 2024-09-12T00:18:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.717+0000 7fe8667fc640 1 -- 172.21.15.31:0/1650796739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8580ab810 con 0x7fe868110da0 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/1650796739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 msgr2=0x7fe868111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/1650796739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe868111180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe858009740 tx=0x7fe85801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/1650796739 shutdown_connections 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/1650796739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe868111180 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/1650796739 >> 172.21.15.31:0/1650796739 conn(0x7fe868070900 msgr2=0x7fe868072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/1650796739 shutdown_connections 2024-09-12T00:18:40.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/1650796739 wait complete. 2024-09-12T00:18:40.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 Processor -- start 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- start start 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe868138310 con 0x7fe868110da0 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe8677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe8677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49304/0 (socket says 172.21.15.31:49304) 2024-09-12T00:18:40.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe8677fe640 1 -- 172.21.15.31:0/3304862728 learned_addr learned my addr 172.21.15.31:0/3304862728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:18:40.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe8677fe640 1 -- 172.21.15.31:0/3304862728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86811cd60 con 0x7fe868110da0 2024-09-12T00:18:40.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe8677fe640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe858019fa0 tx=0x7fe85801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8580b0040 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86811b760 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe858004030 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe858006e20 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681c7d30 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe868111180 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.721+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe858004330 con 0x7fe868110da0 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.725+0000 7fe84ffff640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 0x7fe85403d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:40.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.725+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7fe8580e9c00 con 0x7fe868110da0 2024-09-12T00:18:40.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.725+0000 7fe866ffd640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 0x7fe85403d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:40.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.725+0000 7fe866ffd640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 0x7fe85403d640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe85c005890 tx=0x7fe85c001280 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:40.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.729+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe8580ef020 con 0x7fe868110da0 2024-09-12T00:18:40.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.929+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe868114400 con 0x7fe868110da0 2024-09-12T00:18:40.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.929+0000 7fe84ffff640 1 -- 172.21.15.31:0/3304862728 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe858015ff0 con 0x7fe868110da0 2024-09-12T00:18:40.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:18:40.928 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:18:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 msgr2=0x7fe85403d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 0x7fe85403d640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe85c005890 tx=0x7fe85c001280 comp rx=0 tx=0).stop 2024-09-12T00:18:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 msgr2=0x7fe8681c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe858019fa0 tx=0x7fe85801abb0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 shutdown_connections 2024-09-12T00:18:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe85403b180 0x7fe85403d640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 --2- 172.21.15.31:0/3304862728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe868110da0 0x7fe8681c7620 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 >> 172.21.15.31:0/3304862728 conn(0x7fe868070900 msgr2=0x7fe868070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 shutdown_connections 2024-09-12T00:18:40.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:18:40.933+0000 7fe86ddd5640 1 -- 172.21.15.31:0/3304862728 wait complete. 2024-09-12T00:18:40.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:18:40.946 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:18:40.961 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T00:18:40.961 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:18:40.961 INFO:tasks.rgw:Creating data pools 2024-09-12T00:18:40.961 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:18:40.962 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:18:41.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f236bc4f640 1 Processor -- start 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f236bc4f640 1 -- start start 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f236bc4f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2364074bf0 0x7f236410fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f236bc4f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2364110760 con 0x7f23641102d0 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f236bc4f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2364110930 con 0x7f2364074bf0 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23699eb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2364074bf0 0x7f236410fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23699eb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2364074bf0 0x7f236410fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48778/0 (socket says 172.21.15.66:48778) 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23691ea640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f23641102d0 0x7f236411b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:50042/0 (socket says 172.21.15.66:50042) 2024-09-12T00:18:41.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23699eb640 1 -- 172.21.15.66:0/1243951864 learned_addr learned my addr 172.21.15.66:0/1243951864 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:41.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23699eb640 1 -- 172.21.15.66:0/1243951864 >> v1:172.21.15.31:6789/0 conn(0x7f23641102d0 legacy=0x7f236411b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.093+0000 7f23699eb640 1 -- 172.21.15.66:0/1243951864 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2364110ae0 con 0x7f2364074bf0 2024-09-12T00:18:41.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23699eb640 1 --2- 172.21.15.66:0/1243951864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f236410fd90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23600097f0 tx=0x7f236001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865f67cd29b43da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23689e9640 1 -- 172.21.15.66:0/1243951864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23600b1070 con 0x7f2364074bf0 2024-09-12T00:18:41.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23689e9640 1 -- 172.21.15.66:0/1243951864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23600ac560 con 0x7f2364074bf0 2024-09-12T00:18:41.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23689e9640 1 -- 172.21.15.66:0/1243951864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23600a8050 con 0x7f2364074bf0 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- 172.21.15.66:0/1243951864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 msgr2=0x7f236410fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 --2- 172.21.15.66:0/1243951864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f236410fd90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f23600097f0 tx=0x7f236001c4c0 comp rx=0 tx=0).stop 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- 172.21.15.66:0/1243951864 shutdown_connections 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 --2- 172.21.15.66:0/1243951864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f236410fd90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- 172.21.15.66:0/1243951864 >> 172.21.15.66:0/1243951864 conn(0x7f236406fe70 msgr2=0x7f2364072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- 172.21.15.66:0/1243951864 shutdown_connections 2024-09-12T00:18:41.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- 172.21.15.66:0/1243951864 wait complete. 2024-09-12T00:18:41.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 Processor -- start 2024-09-12T00:18:41.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- start start 2024-09-12T00:18:41.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f236bc4f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23641112f0 con 0x7f2364074bf0 2024-09-12T00:18:41.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23699eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23699eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48784/0 (socket says 172.21.15.66:48784) 2024-09-12T00:18:41.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23699eb640 1 -- 172.21.15.66:0/3133608615 learned_addr learned my addr 172.21.15.66:0/3133608615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:41.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.097+0000 7f23699eb640 1 -- 172.21.15.66:0/3133608615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23641a6110 con 0x7f2364074bf0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f23699eb640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23600af040 tx=0x7f236001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23600bb020 con 0x7f2364074bf0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23600ab700 con 0x7f2364074bf0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23641a63a0 con 0x7f2364074bf0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23600b1040 con 0x7f2364074bf0 2024-09-12T00:18:41.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641ab380 con 0x7f2364074bf0 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236410fd90 con 0x7f2364074bf0 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f23600be020 con 0x7f2364074bf0 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 0x7f234803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3538+0+0 (secure 0 0 0) 0x7f23600e94c0 con 0x7f2364074bf0 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f23691ea640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 0x7f234803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.101+0000 7f23691ea640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 0x7f234803d6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2354001660 tx=0x7f2354007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.113+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f23600c5030 con 0x7f2364074bf0 2024-09-12T00:18:41.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.293+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7f23641102d0 con 0x7f2364074bf0 2024-09-12T00:18:41.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.633+0000 7f235a7fc640 1 -- 172.21.15.66:0/3133608615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v17) ==== 151+0+0 (secure 0 0 0) 0x7f23600160b0 con 0x7f2364074bf0 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 msgr2=0x7f234803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 0x7f234803d6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2354001660 tx=0x7f2354007a50 comp rx=0 tx=0).stop 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 msgr2=0x7f23641a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23600af040 tx=0x7f236001ad00 comp rx=0 tx=0).stop 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 shutdown_connections 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f234803b200 0x7f234803d6c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 --2- 172.21.15.66:0/3133608615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2364074bf0 0x7f23641a5b40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 >> 172.21.15.66:0/3133608615 conn(0x7f236406fe70 msgr2=0x7f2364116de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:41.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 shutdown_connections 2024-09-12T00:18:41.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.637+0000 7f236bc4f640 1 -- 172.21.15.66:0/3133608615 wait complete. 2024-09-12T00:18:41.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:18:41.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbcab4c7640 1 Processor -- start 2024-09-12T00:18:41.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbcab4c7640 1 -- start start 2024-09-12T00:18:41.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbcab4c7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbca4119740 0x7fbca411bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbcab4c7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca411c070 con 0x7fbca406d590 2024-09-12T00:18:41.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbcab4c7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbca411d250 con 0x7fbca4119740 2024-09-12T00:18:41.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca8a62640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbca4119740 0x7fbca411bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca8a62640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbca4119740 0x7fbca411bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48792/0 (socket says 172.21.15.66:48792) 2024-09-12T00:18:41.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca9263640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbca406d590 0x7fbca406d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:50056/0 (socket says 172.21.15.66:50056) 2024-09-12T00:18:41.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca8a62640 1 -- 172.21.15.66:0/982164665 learned_addr learned my addr 172.21.15.66:0/982164665 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:41.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca8a62640 1 -- 172.21.15.66:0/982164665 >> v1:172.21.15.31:6789/0 conn(0x7fbca406d590 legacy=0x7fbca406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.797+0000 7fbca8a62640 1 -- 172.21.15.66:0/982164665 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca411d3d0 con 0x7fbca4119740 2024-09-12T00:18:41.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbca8a62640 1 --2- 172.21.15.66:0/982164665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca4119740 0x7fbca411bb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097f0 tx=0x7fbc9401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c76bc935cd458c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbc9bfff640 1 -- 172.21.15.66:0/982164665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc940ab580 con 0x7fbca4119740 2024-09-12T00:18:41.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbc9bfff640 1 -- 172.21.15.66:0/982164665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc940b0070 con 0x7fbca4119740 2024-09-12T00:18:41.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbc9bfff640 1 -- 172.21.15.66:0/982164665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc940ab870 con 0x7fbca4119740 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 -- 172.21.15.66:0/982164665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca4119740 msgr2=0x7fbca411bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/982164665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca4119740 0x7fbca411bb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbc940097f0 tx=0x7fbc9401c430 comp rx=0 tx=0).stop 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 -- 172.21.15.66:0/982164665 shutdown_connections 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/982164665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca4119740 0x7fbca411bb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 -- 172.21.15.66:0/982164665 >> 172.21.15.66:0/982164665 conn(0x7fbca4070cb0 msgr2=0x7fbca40730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 -- 172.21.15.66:0/982164665 shutdown_connections 2024-09-12T00:18:41.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.801+0000 7fbcab4c7640 1 -- 172.21.15.66:0/982164665 wait complete. 2024-09-12T00:18:41.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 Processor -- start 2024-09-12T00:18:41.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 -- start start 2024-09-12T00:18:41.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbca411cf30 con 0x7fbca406d590 2024-09-12T00:18:41.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbca9263640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbca9263640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48800/0 (socket says 172.21.15.66:48800) 2024-09-12T00:18:41.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbca9263640 1 -- 172.21.15.66:0/2937489766 learned_addr learned my addr 172.21.15.66:0/2937489766 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:41.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbca9263640 1 -- 172.21.15.66:0/2937489766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca41a8320 con 0x7fbca406d590 2024-09-12T00:18:41.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbca9263640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c450 tx=0x7fbca000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0007410 con 0x7fbca406d590 2024-09-12T00:18:41.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca00075b0 con 0x7fbca406d590 2024-09-12T00:18:41.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0004960 con 0x7fbca406d590 2024-09-12T00:18:41.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca41a8610 con 0x7fbca406d590 2024-09-12T00:18:41.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca41ad760 con 0x7fbca406d590 2024-09-12T00:18:41.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca406d9f0 con 0x7fbca406d590 2024-09-12T00:18:41.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbca001a020 con 0x7fbca406d590 2024-09-12T00:18:41.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 0x7fbc8803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:41.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.805+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3802+0+0 (secure 0 0 0) 0x7fbca004e680 con 0x7fbca406d590 2024-09-12T00:18:41.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.809+0000 7fbca8a62640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 0x7fbc8803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:41.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.809+0000 7fbca8a62640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 0x7fbc8803d690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc940af000 tx=0x7fbc940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:41.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:41.821+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbca00113a0 con 0x7fbca406d590 2024-09-12T00:18:42.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:42.005+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fbca41a8950 con 0x7fbca406d590 2024-09-12T00:18:43.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.141+0000 7fbc99ffb640 1 -- 172.21.15.66:0/2937489766 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) ==== 227+0+0 (secure 0 0 0) 0x7fbca0004ce0 con 0x7fbca406d590 2024-09-12T00:18:43.146 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:18:43.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 msgr2=0x7fbc8803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:43.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 0x7fbc8803d690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbc940af000 tx=0x7fbc940a7000 comp rx=0 tx=0).stop 2024-09-12T00:18:43.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 msgr2=0x7fbca41a7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:43.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c450 tx=0x7fbca000c910 comp rx=0 tx=0).stop 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 shutdown_connections 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc8803b1d0 0x7fbc8803d690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 --2- 172.21.15.66:0/2937489766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbca406d590 0x7fbca41a7d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 >> 172.21.15.66:0/2937489766 conn(0x7fbca4070cb0 msgr2=0x7fbca4119b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 shutdown_connections 2024-09-12T00:18:43.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.145+0000 7fbcab4c7640 1 -- 172.21.15.66:0/2937489766 wait complete. 2024-09-12T00:18:43.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:18:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1ff5619640 1 Processor -- start 2024-09-12T00:18:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1ff5619640 1 -- start start 2024-09-12T00:18:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1ff5619640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ff01104a0 0x7f1ff011c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1ff5619640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff0110930 con 0x7f1ff0074bf0 2024-09-12T00:18:43.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1ff5619640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff0110b00 con 0x7f1ff01104a0 2024-09-12T00:18:43.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1fee7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ff01104a0 0x7f1ff011c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:43.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1feeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ff0074bf0 0x7f1ff010fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:50062/0 (socket says 172.21.15.66:50062) 2024-09-12T00:18:43.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1feeffd640 1 -- 172.21.15.66:0/2320303543 learned_addr learned my addr 172.21.15.66:0/2320303543 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:18:43.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1fee7fc640 1 -- 172.21.15.66:0/2320303543 >> v1:172.21.15.31:6789/0 conn(0x7f1ff0074bf0 legacy=0x7f1ff010fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:43.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.293+0000 7f1fee7fc640 1 -- 172.21.15.66:0/2320303543 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff011d670 con 0x7f1ff01104a0 2024-09-12T00:18:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1fee7fc640 1 --2- 172.21.15.66:0/2320303543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff01104a0 0x7f1ff011c120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009740 tx=0x7f1fd801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a22d3c8c0722419 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1fedffb640 1 -- 172.21.15.66:0/2320303543 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fd80b0070 con 0x7f1ff01104a0 2024-09-12T00:18:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1fedffb640 1 -- 172.21.15.66:0/2320303543 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd80ab530 con 0x7f1ff01104a0 2024-09-12T00:18:43.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1fedffb640 1 -- 172.21.15.66:0/2320303543 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fd80ab830 con 0x7f1ff01104a0 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- 172.21.15.66:0/2320303543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff01104a0 msgr2=0x7f1ff011c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 --2- 172.21.15.66:0/2320303543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff01104a0 0x7f1ff011c120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009740 tx=0x7f1fd801c370 comp rx=0 tx=0).stop 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- 172.21.15.66:0/2320303543 shutdown_connections 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 --2- 172.21.15.66:0/2320303543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff01104a0 0x7f1ff011c120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- 172.21.15.66:0/2320303543 >> 172.21.15.66:0/2320303543 conn(0x7f1ff006fe70 msgr2=0x7f1ff0072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- 172.21.15.66:0/2320303543 shutdown_connections 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- 172.21.15.66:0/2320303543 wait complete. 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 Processor -- start 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- start start 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:43.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1ff5619640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff011d320 con 0x7f1ff0074bf0 2024-09-12T00:18:43.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1feeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1feeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48814/0 (socket says 172.21.15.66:48814) 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.297+0000 7f1feeffd640 1 -- 172.21.15.66:0/1905104892 learned_addr learned my addr 172.21.15.66:0/1905104892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1feeffd640 1 -- 172.21.15.66:0/1905104892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff01a83f0 con 0x7f1ff0074bf0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1feeffd640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c480 tx=0x7f1fe000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe0017070 con 0x7f1ff0074bf0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0005c20 con 0x7f1ff0074bf0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff01a86e0 con 0x7f1ff0074bf0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe00070d0 con 0x7f1ff0074bf0 2024-09-12T00:18:43.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff01ad830 con 0x7f1ff0074bf0 2024-09-12T00:18:43.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff010fd90 con 0x7f1ff0074bf0 2024-09-12T00:18:43.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1fe001a070 con 0x7f1ff0074bf0 2024-09-12T00:18:43.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 0x7f1fd003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:43.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4249+0+0 (secure 0 0 0) 0x7f1fe004e730 con 0x7f1ff0074bf0 2024-09-12T00:18:43.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fee7fc640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 0x7f1fd003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:43.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.301+0000 7f1fee7fc640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 0x7f1fd003d6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ad000 tx=0x7f1fd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:43.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.313+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1fe0021020 con 0x7f1ff0074bf0 2024-09-12T00:18:43.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:43.481+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f1ff01a8a20 con 0x7f1ff0074bf0 2024-09-12T00:18:44.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.145+0000 7f1fe77fe640 1 -- 172.21.15.66:0/1905104892 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) ==== 185+0+0 (secure 0 0 0) 0x7f1fe001ada0 con 0x7f1ff0074bf0 2024-09-12T00:18:44.152 INFO:teuthology.orchestra.run.smithi066.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:18:44.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 msgr2=0x7f1fd003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:44.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 0x7f1fd003d6c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80ad000 tx=0x7f1fd8008040 comp rx=0 tx=0).stop 2024-09-12T00:18:44.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 msgr2=0x7f1ff01a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:44.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c480 tx=0x7f1fe000c940 comp rx=0 tx=0).stop 2024-09-12T00:18:44.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 shutdown_connections 2024-09-12T00:18:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1fd003b200 0x7f1fd003d6c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 --2- 172.21.15.66:0/1905104892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff0074bf0 0x7f1ff01a7e20 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c480 tx=0x7f1fe000c940 comp rx=0 tx=0).stop 2024-09-12T00:18:44.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.153+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 >> 172.21.15.66:0/1905104892 conn(0x7f1ff006fe70 msgr2=0x7f1ff0118470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:44.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.157+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 shutdown_connections 2024-09-12T00:18:44.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.161+0000 7f1ff5619640 1 -- 172.21.15.66:0/1905104892 wait complete. 2024-09-12T00:18:44.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:18:44.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b54466640 1 Processor -- start 2024-09-12T00:18:44.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b54466640 1 -- start start 2024-09-12T00:18:44.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b54466640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:44.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b54466640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4c11e200 con 0x7f6b4c113070 2024-09-12T00:18:44.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b54466640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c11f400 con 0x7f6b4c11b8d0 2024-09-12T00:18:44.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b51a01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:44.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b51a01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48822/0 (socket says 172.21.15.66:48822) 2024-09-12T00:18:44.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b51a01640 1 -- 172.21.15.66:0/278306879 learned_addr learned my addr 172.21.15.66:0/278306879 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:44.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b52202640 1 --1- 172.21.15.66:0/278306879 >> v1:172.21.15.31:6789/0 conn(0x7f6b4c113070 0x7f6b4c113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:50070/0 (socket says 172.21.15.66:50070) 2024-09-12T00:18:44.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.329+0000 7f6b51a01640 1 -- 172.21.15.66:0/278306879 >> v1:172.21.15.31:6789/0 conn(0x7f6b4c113070 legacy=0x7f6b4c113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:44.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b51a01640 1 -- 172.21.15.66:0/278306879 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c11f5b0 con 0x7f6b4c11b8d0 2024-09-12T00:18:44.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b51a01640 1 --2- 172.21.15.66:0/278306879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097f0 tx=0x7f6b4001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588374565a8945e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:44.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b51200640 1 -- 172.21.15.66:0/278306879 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400a6040 con 0x7f6b4c11b8d0 2024-09-12T00:18:44.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b51200640 1 -- 172.21.15.66:0/278306879 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b400af070 con 0x7f6b4c11b8d0 2024-09-12T00:18:44.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b51200640 1 -- 172.21.15.66:0/278306879 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b400aa6c0 con 0x7f6b4c11b8d0 2024-09-12T00:18:44.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 -- 172.21.15.66:0/278306879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c11b8d0 msgr2=0x7f6b4c11dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:44.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 --2- 172.21.15.66:0/278306879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097f0 tx=0x7f6b4001c4c0 comp rx=0 tx=0).stop 2024-09-12T00:18:44.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 -- 172.21.15.66:0/278306879 shutdown_connections 2024-09-12T00:18:44.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 --2- 172.21.15.66:0/278306879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c11b8d0 0x7f6b4c11dcc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:44.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 -- 172.21.15.66:0/278306879 >> 172.21.15.66:0/278306879 conn(0x7f6b4c06f370 msgr2=0x7f6b4c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:44.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 -- 172.21.15.66:0/278306879 shutdown_connections 2024-09-12T00:18:44.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.333+0000 7f6b54466640 1 -- 172.21.15.66:0/278306879 wait complete. 2024-09-12T00:18:44.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 Processor -- start 2024-09-12T00:18:44.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 -- start start 2024-09-12T00:18:44.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:44.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c11f0c0 con 0x7f6b4c113070 2024-09-12T00:18:44.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b52202640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:44.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b52202640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48834/0 (socket says 172.21.15.66:48834) 2024-09-12T00:18:44.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b52202640 1 -- 172.21.15.66:0/468832622 learned_addr learned my addr 172.21.15.66:0/468832622 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:44.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b52202640 1 -- 172.21.15.66:0/468832622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c1aa4e0 con 0x7f6b4c113070 2024-09-12T00:18:44.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b52202640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c7f0 tx=0x7f6b4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b44017070 con 0x7f6b4c113070 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c1aa7d0 con 0x7f6b4c113070 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4400a5b0 con 0x7f6b4c113070 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b4400a8d0 con 0x7f6b4c113070 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1af9a0 con 0x7f6b4c113070 2024-09-12T00:18:44.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c1134d0 con 0x7f6b4c113070 2024-09-12T00:18:44.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.337+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6b4401a070 con 0x7f6b4c113070 2024-09-12T00:18:44.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.341+0000 7f6b4affd640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 0x7f6b3803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:44.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.341+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4260+0+0 (secure 0 0 0) 0x7f6b4404e810 con 0x7f6b4c113070 2024-09-12T00:18:44.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.341+0000 7f6b51a01640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 0x7f6b3803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:44.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.341+0000 7f6b51a01640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 0x7f6b3803d640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ae000 tx=0x7f6b40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:44.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.353+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6b4401a360 con 0x7f6b4c113070 2024-09-12T00:18:44.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:44.529+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f6b4c1aab10 con 0x7f6b4c113070 2024-09-12T00:18:45.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.153+0000 7f6b4affd640 1 -- 172.21.15.66:0/468832622 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) ==== 169+0+0 (secure 0 0 0) 0x7f6b440210c0 con 0x7f6b4c113070 2024-09-12T00:18:45.159 INFO:teuthology.orchestra.run.smithi066.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 msgr2=0x7f6b3803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 0x7f6b3803d640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b400ae000 tx=0x7f6b40008040 comp rx=0 tx=0).stop 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 msgr2=0x7f6b4c1a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c7f0 tx=0x7f6b4400ccb0 comp rx=0 tx=0).stop 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 shutdown_connections 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6b3803b180 0x7f6b3803d640 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 --2- 172.21.15.66:0/468832622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b4c113070 0x7f6b4c1a9f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 >> 172.21.15.66:0/468832622 conn(0x7f6b4c06f370 msgr2=0x7f6b4c11a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 shutdown_connections 2024-09-12T00:18:45.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.157+0000 7f6b54466640 1 -- 172.21.15.66:0/468832622 wait complete. 2024-09-12T00:18:45.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:18:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa916aa9640 1 Processor -- start 2024-09-12T00:18:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa916aa9640 1 -- start start 2024-09-12T00:18:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa916aa9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa91011b8d0 0x7fa91011dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa916aa9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91011e200 con 0x7fa910113070 2024-09-12T00:18:45.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa916aa9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa91011f3e0 con 0x7fa91011b8d0 2024-09-12T00:18:45.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa90ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa91011b8d0 0x7fa91011dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:45.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa90ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa91011b8d0 0x7fa91011dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48848/0 (socket says 172.21.15.66:48848) 2024-09-12T00:18:45.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa90ffff640 1 -- 172.21.15.66:0/3306255370 learned_addr learned my addr 172.21.15.66:0/3306255370 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:45.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa90ffff640 1 -- 172.21.15.66:0/3306255370 >> v1:172.21.15.31:6789/0 conn(0x7fa910113070 legacy=0x7fa910113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:45.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.313+0000 7fa90ffff640 1 -- 172.21.15.66:0/3306255370 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91011f560 con 0x7fa91011b8d0 2024-09-12T00:18:45.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa90ffff640 1 --2- 172.21.15.66:0/3306255370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa91011b8d0 0x7fa91011dcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097f0 tx=0x7fa90401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75754062f3d90658 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa90f7fe640 1 -- 172.21.15.66:0/3306255370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9040ab580 con 0x7fa91011b8d0 2024-09-12T00:18:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa90f7fe640 1 -- 172.21.15.66:0/3306255370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9040b0070 con 0x7fa91011b8d0 2024-09-12T00:18:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa90f7fe640 1 -- 172.21.15.66:0/3306255370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9040ab870 con 0x7fa91011b8d0 2024-09-12T00:18:45.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 -- 172.21.15.66:0/3306255370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa91011b8d0 msgr2=0x7fa91011dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 --2- 172.21.15.66:0/3306255370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa91011b8d0 0x7fa91011dcc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097f0 tx=0x7fa90401c430 comp rx=0 tx=0).stop 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 -- 172.21.15.66:0/3306255370 shutdown_connections 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 --2- 172.21.15.66:0/3306255370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa91011b8d0 0x7fa91011dcc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 -- 172.21.15.66:0/3306255370 >> 172.21.15.66:0/3306255370 conn(0x7fa91006f3b0 msgr2=0x7fa91006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 -- 172.21.15.66:0/3306255370 shutdown_connections 2024-09-12T00:18:45.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.317+0000 7fa916aa9640 1 -- 172.21.15.66:0/3306255370 wait complete. 2024-09-12T00:18:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 Processor -- start 2024-09-12T00:18:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 -- start start 2024-09-12T00:18:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa91011f0c0 con 0x7fa910113070 2024-09-12T00:18:45.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa914845640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:45.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa914845640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:48862/0 (socket says 172.21.15.66:48862) 2024-09-12T00:18:45.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa914845640 1 -- 172.21.15.66:0/1233250175 learned_addr learned my addr 172.21.15.66:0/1233250175 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa914845640 1 -- 172.21.15.66:0/1233250175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9101aa490 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa914845640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c430 tx=0x7fa90000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900005200 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900003600 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9101aa780 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101af950 con 0x7fa910113070 2024-09-12T00:18:45.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.321+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9101134d0 con 0x7fa910113070 2024-09-12T00:18:45.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.325+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa90001a070 con 0x7fa910113070 2024-09-12T00:18:45.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.325+0000 7fa90d7fa640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 0x7fa8fc03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:18:45.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.325+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4624+0+0 (secure 0 0 0) 0x7fa90004e970 con 0x7fa910113070 2024-09-12T00:18:45.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.325+0000 7fa90ffff640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 0x7fa8fc03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:18:45.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.325+0000 7fa90ffff640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 0x7fa8fc03d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9040af000 tx=0x7fa9040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:18:45.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.337+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa900021020 con 0x7fa910113070 2024-09-12T00:18:45.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:45.509+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fa9101aaac0 con 0x7fa910113070 2024-09-12T00:18:46.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa90d7fa640 1 -- 172.21.15.66:0/1233250175 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) ==== 187+0+0 (secure 0 0 0) 0x7fa9000192c0 con 0x7fa910113070 2024-09-12T00:18:46.160 INFO:teuthology.orchestra.run.smithi066.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 msgr2=0x7fa8fc03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 0x7fa8fc03d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9040af000 tx=0x7fa9040a7000 comp rx=0 tx=0).stop 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 msgr2=0x7fa9101a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c430 tx=0x7fa90000c8f0 comp rx=0 tx=0).stop 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 shutdown_connections 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa8fc03b200 0x7fa8fc03d6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 --2- 172.21.15.66:0/1233250175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa910113070 0x7fa9101a9ec0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.157+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 >> 172.21.15.66:0/1233250175 conn(0x7fa91006f3b0 msgr2=0x7fa91011bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.161+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 shutdown_connections 2024-09-12T00:18:46.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:18:46.161+0000 7fa916aa9640 1 -- 172.21.15.66:0/1233250175 wait complete. 2024-09-12T00:18:46.200 DEBUG:tasks.rgw:Pools created 2024-09-12T00:18:46.200 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:18:46.200 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T00:18:46.200 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:18:46.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo echo -n http://smithi066.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:18:46.222 INFO:teuthology.orchestra.run.smithi066.stdout:http://smithi066.front.sepia.ceph.com:80 2024-09-12T00:18:46.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:18:46.275 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:18:46.275 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:18:46.317 INFO:tasks.rgw.client.0:Started 2024-09-12T00:18:46.317 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:18:46.317 DEBUG:teuthology.orchestra.run.smithi066:> curl http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:18:46.351 INFO:teuthology.orchestra.run.smithi066.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:46.351 INFO:teuthology.orchestra.run.smithi066.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:46.353 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:18:46.353 INFO:teuthology.orchestra.run.smithi066.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:18:46.353 INFO:teuthology.orchestra.run.smithi066.stderr:curl: (7) Failed to connect to smithi066.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:18:47.354 DEBUG:teuthology.orchestra.run.smithi066:> curl http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:18:47.367 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:18:47.368 INFO:teuthology.orchestra.run.smithi066.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:47.368 INFO:teuthology.orchestra.run.smithi066.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:47.368 INFO:teuthology.orchestra.run.smithi066.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:18:47.368 INFO:teuthology.orchestra.run.smithi066.stderr:curl: (7) Failed to connect to smithi066.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:18:49.369 DEBUG:teuthology.orchestra.run.smithi066:> curl http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:18:49.382 INFO:teuthology.orchestra.run.smithi066.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:49.382 INFO:teuthology.orchestra.run.smithi066.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:49.382 INFO:teuthology.orchestra.run.smithi066.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:18:49.382 INFO:teuthology.orchestra.run.smithi066.stderr:curl: (7) Failed to connect to smithi066.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:18:49.383 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:18:53.384 DEBUG:teuthology.orchestra.run.smithi066:> curl http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:18:53.396 INFO:teuthology.orchestra.run.smithi066.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:53.397 INFO:teuthology.orchestra.run.smithi066.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:53.397 INFO:teuthology.orchestra.run.smithi066.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:18:53.397 INFO:teuthology.orchestra.run.smithi066.stderr:curl: (7) Failed to connect to smithi066.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:18:53.397 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:19:01.399 DEBUG:teuthology.orchestra.run.smithi066:> curl http://smithi066.front.sepia.ceph.com:80/ 2024-09-12T00:19:01.411 INFO:teuthology.orchestra.run.smithi066.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:19:01.412 INFO:teuthology.orchestra.run.smithi066.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:19:01.414 INFO:teuthology.orchestra.run.smithi066.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 57876 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T00:19:01.415 INFO:teuthology.orchestra.run.smithi066.stdout:anonymous 2024-09-12T00:19:01.415 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-12T00:19:03.042 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-12T00:19:03.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T00:19:03.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T00:19:03.043 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T00:19:03.083 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:03.083 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.077+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f6bab9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5564503678a0 0x556450369c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f6bab9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5564502159c0 con 0x556450363750 2024-09-12T00:19:03.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f6bab9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5564502656d0 con 0x5564503678a0 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5564503678a0 0x556450369c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5564503678a0 0x556450369c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53322/0 (socket says 172.21.15.66:53322) 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/1246453054 learned_addr learned my addr 172.21.15.66:0/1246453054 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f46b1640 1 --1- 172.21.15.66:0/1246453054 >> v1:172.21.15.31:6789/0 conn(0x556450363750 0x556450363b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36066/0 (socket says 172.21.15.66:36066) 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/1246453054 >> v1:172.21.15.31:6789/0 conn(0x556450363750 legacy=0x556450363b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/1246453054 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556450209ca0 con 0x5564503678a0 2024-09-12T00:19:03.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.081+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/1246453054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564503678a0 0x556450369c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a5c0 tx=0x7ff1e801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8529fe16fb65c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f36af640 1 -- 172.21.15.66:0/1246453054 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80a9590 con 0x5564503678a0 2024-09-12T00:19:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f36af640 1 -- 172.21.15.66:0/1246453054 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80ae070 con 0x5564503678a0 2024-09-12T00:19:03.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f36af640 1 -- 172.21.15.66:0/1246453054 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80a9880 con 0x5564503678a0 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1246453054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564503678a0 msgr2=0x556450369c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/1246453054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564503678a0 0x556450369c90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a5c0 tx=0x7ff1e801b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1246453054 shutdown_connections 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/1246453054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564503678a0 0x556450369c90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1246453054 >> 172.21.15.66:0/1246453054 conn(0x5564502d7060 msgr2=0x5564502d7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1246453054 shutdown_connections 2024-09-12T00:19:03.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.085+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1246453054 wait complete. 2024-09-12T00:19:03.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f6bab9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f6bab9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556450269680 con 0x556450363750 2024-09-12T00:19:03.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f46b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f46b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53330/0 (socket says 172.21.15.66:53330) 2024-09-12T00:19:03.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f46b1640 1 -- 172.21.15.66:0/2580925712 learned_addr learned my addr 172.21.15.66:0/2580925712 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f46b1640 1 -- 172.21.15.66:0/2580925712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564501e4da0 con 0x556450363750 2024-09-12T00:19:03.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/2580925712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b270 tx=0x7ff1ec00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9f8ee6826c703 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff0e260c640 1 -- 172.21.15.66:0/2580925712 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec00e5d0 con 0x556450363750 2024-09-12T00:19:03.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff0e260c640 1 -- 172.21.15.66:0/2580925712 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00e770 con 0x556450363750 2024-09-12T00:19:03.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.101+0000 7ff0e260c640 1 -- 172.21.15.66:0/2580925712 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec00ea70 con 0x556450363750 2024-09-12T00:19:03.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/2580925712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 msgr2=0x55645044e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/2580925712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b270 tx=0x7ff1ec00b670 comp rx=0 tx=0).stop 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/2580925712 shutdown_connections 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/2580925712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x55645044e990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/2580925712 >> 172.21.15.66:0/2580925712 conn(0x5564502d7060 msgr2=0x55645044a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/2580925712 shutdown_connections 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/2580925712 wait complete. 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55645020ba50 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f46b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f46b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53336/0 (socket says 172.21.15.66:53336) 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3958082308 learned_addr learned my addr 172.21.15.66:0/3958082308 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556450456590 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55645044f980 tx=0x7ff1ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff0e0e09640 1 -- 172.21.15.66:0/3958082308 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec00ee20 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff0e0e09640 1 -- 172.21.15.66:0/3958082308 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00fa40 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556450456820 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff0e0e09640 1 -- 172.21.15.66:0/3958082308 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec00fd60 con 0x556450363750 2024-09-12T00:19:03.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.105+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564504571d0 con 0x556450363750 2024-09-12T00:19:03.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff0e0e09640 1 -- 172.21.15.66:0/3958082308 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1ec017070 con 0x556450363750 2024-09-12T00:19:03.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff0e0e09640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 0x7ff0dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff0e0e09640 1 -- 172.21.15.66:0/3958082308 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff1ec015020 con 0x556450363750 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 0x7ff0dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 0x55645045d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645045d6e0 con 0x5564503678a0 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 0x55645045d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 0x7ff0dc03bf30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ad000 tx=0x7ff1e80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 0x55645045d1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3958082308 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564503678a0 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645045db30 con 0x5564503678a0 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3958082308 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564503678a0 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 0x556450461d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450462400 con 0x55645045f940 2024-09-12T00:19:03.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 0x556450461d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 0x556450461d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3958082308 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1ec02e070 con 0x55645045f940 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645045e7e0 con 0x5564503678a0 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3958082308 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564503678a0 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645045ecc0 con 0x55645045f940 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.109+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3958082308 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1ec02e070 con 0x55645045f940 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556450276450 con 0x556450470b70 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53342/0 (socket says 172.21.15.66:53342) 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3411018913 learned_addr learned my addr 172.21.15.66:0/3411018913 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3411018913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564504715d0 con 0x556450470b70 2024-09-12T00:19:03.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55645045da80 tx=0x7ff1e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff0d9ffb640 1 -- 172.21.15.66:0/3411018913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4013640 con 0x556450470b70 2024-09-12T00:19:03.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff0d9ffb640 1 -- 172.21.15.66:0/3411018913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e40137e0 con 0x556450470b70 2024-09-12T00:19:03.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff0d9ffb640 1 -- 172.21.15.66:0/3411018913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4013ac0 con 0x556450470b70 2024-09-12T00:19:03.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556450471e30 con 0x556450470b70 2024-09-12T00:19:03.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564504723a0 con 0x556450470b70 2024-09-12T00:19:03.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.113+0000 7ff0d9ffb640 1 -- 172.21.15.66:0/3411018913 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1e4011040 con 0x556450470b70 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff0d9ffb640 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 0x7ff0cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff0d9ffb640 1 -- 172.21.15.66:0/3411018913 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff1e400e040 con 0x556450470b70 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 0x7ff0cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 0x7ff0cc03bf80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c10 tx=0x7ff1ec017820 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55645044f1e0 con 0x55645047e4a0 2024-09-12T00:19:03.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53348/0 (socket says 172.21.15.66:53348) 2024-09-12T00:19:03.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/1388269892 learned_addr learned my addr 172.21.15.66:0/1388269892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/1388269892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55645047ee90 con 0x55645047e4a0 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/1388269892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40508d0 tx=0x7ff1e4013f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e431725043cdb754 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff0cb7fe640 1 -- 172.21.15.66:0/1388269892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4012d90 con 0x55645047e4a0 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff0cb7fe640 1 -- 172.21.15.66:0/1388269892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e402a910 con 0x55645047e4a0 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff0cb7fe640 1 -- 172.21.15.66:0/1388269892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e402a3f0 con 0x55645047e4a0 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1388269892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 msgr2=0x55645047e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/1388269892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40508d0 tx=0x7ff1e4013f80 comp rx=0 tx=0).stop 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1388269892 shutdown_connections 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/1388269892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x55645047e8a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1388269892 >> 172.21.15.66:0/1388269892 conn(0x5564504798c0 msgr2=0x556450477b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1388269892 shutdown_connections 2024-09-12T00:19:03.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/1388269892 wait complete. 2024-09-12T00:19:03.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 Processor -- start 2024-09-12T00:19:03.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- start start 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.117+0000 7ff1f6bab9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55645047d3f0 con 0x55645047e4a0 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f4eb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53356/0 (socket says 172.21.15.66:53356) 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 learned_addr learned my addr 172.21.15.66:0/3135002868 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556450484f00 con 0x55645047e4a0 2024-09-12T00:19:03.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff1e404f7a0 tx=0x7ff1e4050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 -- 172.21.15.66:0/3135002868 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e402e070 con 0x55645047e4a0 2024-09-12T00:19:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 -- 172.21.15.66:0/3135002868 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e4045030 con 0x55645047e4a0 2024-09-12T00:19:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556450484f00 con 0x55645047e4a0 2024-09-12T00:19:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 -- 172.21.15.66:0/3135002868 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e402a560 con 0x55645047e4a0 2024-09-12T00:19:03.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556450484f00 con 0x55645047e4a0 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 -- 172.21.15.66:0/3135002868 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff1e40520d0 con 0x55645047e4a0 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0bc039a70 0x7ff0bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff0c9ffb640 1 -- 172.21.15.66:0/3135002868 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7ff1e4022030 con 0x55645047e4a0 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0bc039a70 0x7ff0bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55645048faf0 0x556450491f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564504926d0 con 0x55645048faf0 2024-09-12T00:19:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55645048faf0 0x556450491f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0bc039a70 0x7ff0bc03bf30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00f6b0 tx=0x7ff1ec033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55645048faf0 0x556450491f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.121+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 realm 2024-09-12T00:19:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450492b00 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564504933d0 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450493770 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5564504944d0 0x5564504968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450496e00 con 0x5564504944d0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5564504944d0 0x5564504968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5564504944d0 0x5564504968c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 20 searching for the correct realm 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff1e4033460 0x7ff1e40338e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff1e4033460 0x7ff1e40338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff1e4033460 0x7ff1e40338e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f46b1640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff1ec042100 0x7ff1ec01d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.125+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff1ec042100 0x7ff1ec01d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff1ec042100 0x7ff1ec01d7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.129+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.133+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.137+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x5564504944d0 2024-09-12T00:19:03.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1ec042100 2024-09-12T00:19:03.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x55645048faf0 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450498660 con 0x7ff1e4033460 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:03.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450497750 con 0x55645048faf0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x55645048faf0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450497390 con 0x5564504944d0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 zone default found 2024-09-12T00:19:03.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 4 Realm: () 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 zonegroup default 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.141+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556450497c20 con 0x7ff1ec042100 2024-09-12T00:19:03.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645049aa30 con 0x5564504944d0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55645049af70 con 0x5564504944d0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 started sync module instance, tier type = 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556450499ea0 con 0x7ff1e4033460 2024-09-12T00:19:03.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93889332091376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049b400 con 0x7ff1e4033460 2024-09-12T00:19:03.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049bdc0 con 0x55645048faf0 2024-09-12T00:19:03.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.145+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93889332091376] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93889332099344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049bd30 con 0x55645048faf0 2024-09-12T00:19:03.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049cb50 con 0x5564504944d0 2024-09-12T00:19:03.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93889332102752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049ca80 con 0x5564504944d0 2024-09-12T00:19:03.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049da10 con 0x7ff1e4033460 2024-09-12T00:19:03.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.149+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93889332099344] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93889332106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049e7f0 con 0x55645048faf0 2024-09-12T00:19:03.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93889332102752] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93889332110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049e760 con 0x55645048faf0 2024-09-12T00:19:03.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.153+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049f570 con 0x7ff1ec042100 2024-09-12T00:19:03.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.157+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93889332106592] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.157+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93889332110144] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.157+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.157+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93889332101552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049f070 con 0x7ff1ec042100 2024-09-12T00:19:03.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.157+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049fe10 con 0x7ff1ec042100 2024-09-12T00:19:03.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93889332101552] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93889332112320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049efe0 con 0x7ff1ec042100 2024-09-12T00:19:03.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564504a0430 con 0x7ff1ec042100 2024-09-12T00:19:03.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93889332112320] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93889332115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564504a0430 con 0x7ff1ec042100 2024-09-12T00:19:03.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=0 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=1 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=2 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=3 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=4 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=5 2024-09-12T00:19:03.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.161+0000 7ff1f6bab9c0 20 add_watcher() i=6 2024-09-12T00:19:03.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93889332115472] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 20 add_watcher() i=7 2024-09-12T00:19:03.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:03.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564504a3730 con 0x55645048faf0 2024-09-12T00:19:03.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93889332117744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564504a09c0 con 0x55645048faf0 2024-09-12T00:19:03.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93889332117744] v31'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff0aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:03.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:03.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.165+0000 7ff1f6bab9c0 5 note: GC not initialized 2024-09-12T00:19:03.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff0a97e2640 20 reqs_thread_entry: start 2024-09-12T00:19:03.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f6bab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f6bab9c0 20 Filter name: none 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff01affd640 20 reqs_thread_entry: start 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5564504c6540 con 0x5564504944d0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049af70 con 0x5564504944d0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049af70 con 0x55645048faf0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x55645048faf0 2024-09-12T00:19:03.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x7ff1e4033460 2024-09-12T00:19:03.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.169+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.173+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.177+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1ec042100 2024-09-12T00:19:03.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x55645048faf0 2024-09-12T00:19:03.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x5564504944d0 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55645049de30 con 0x7ff1e4033460 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff0aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.181+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93889332117744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049af70 con 0x55645048faf0 2024-09-12T00:19:03.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93889332117744] v31'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93889332091376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x7ff1e4033460 2024-09-12T00:19:03.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93889332091376] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f6bab9c0 20 remove_watcher() i=0 2024-09-12T00:19:03.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f6bab9c0 2 removed watcher, disabling cache 2024-09-12T00:19:03.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.185+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93889332099344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x55645048faf0 2024-09-12T00:19:03.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93889332099344] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f6bab9c0 20 remove_watcher() i=1 2024-09-12T00:19:03.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93889332102752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556450497ff0 con 0x5564504944d0 2024-09-12T00:19:03.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f4eb2640 1 -- 172.21.15.66:0/3135002868 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93889332102752] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e400a4d0 con 0x5564504944d0 2024-09-12T00:19:03.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f6bab9c0 20 remove_watcher() i=2 2024-09-12T00:19:03.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.189+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93889332106592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049b910 con 0x7ff1e4033460 2024-09-12T00:19:03.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f46b1640 1 -- 172.21.15.66:0/3135002868 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93889332106592] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec02e070 con 0x7ff1e4033460 2024-09-12T00:19:03.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f6bab9c0 20 remove_watcher() i=3 2024-09-12T00:19:03.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93889332110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049c660 con 0x55645048faf0 2024-09-12T00:19:03.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93889332110144] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x55645048faf0 2024-09-12T00:19:03.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f6bab9c0 20 remove_watcher() i=4 2024-09-12T00:19:03.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.193+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93889332101552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049d560 con 0x7ff1ec042100 2024-09-12T00:19:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93889332101552] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f6bab9c0 20 remove_watcher() i=5 2024-09-12T00:19:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93889332112320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049b910 con 0x7ff1ec042100 2024-09-12T00:19:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93889332112320] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f6bab9c0 20 remove_watcher() i=6 2024-09-12T00:19:03.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.197+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93889332115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55645049e340 con 0x7ff1ec042100 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93889332115472] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e80a99e0 con 0x7ff1ec042100 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 20 remove_watcher() i=7 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff1ec042100 msgr2=0x7ff1ec01d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff1ec042100 0x7ff1ec01d7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55645048faf0 msgr2=0x556450491f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55645048faf0 0x556450491f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff1e4033460 msgr2=0x7ff1e40338e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff1e4033460 0x7ff1e40338e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5564504944d0 msgr2=0x5564504968c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5564504944d0 0x5564504968c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0bc039a70 msgr2=0x7ff0bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0bc039a70 0x7ff0bc03bf30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00f6b0 tx=0x7ff1ec033000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 msgr2=0x5564504849a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff1e404f7a0 tx=0x7ff1e4050860 comp rx=0 tx=0).stop 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f3eb0640 1 -- 172.21.15.66:0/3135002868 reap_dead start 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 shutdown_connections 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3135002868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55645047e4a0 0x5564504849a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 >> 172.21.15.66:0/3135002868 conn(0x5564504798c0 msgr2=0x556450477ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 shutdown_connections 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3135002868 wait complete. 2024-09-12T00:19:03.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 msgr2=0x7ff0cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 0x7ff0cc03bf80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c10 tx=0x7ff1ec017820 comp rx=0 tx=0).stop 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 msgr2=0x556450470f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55645045da80 tx=0x7ff1e40167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 shutdown_connections 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0cc039ac0 0x7ff0cc03bf80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3411018913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450470b70 0x556450470f90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 >> 172.21.15.66:0/3411018913 conn(0x556450466520 msgr2=0x556450466900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 shutdown_connections 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3411018913 wait complete. 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 msgr2=0x55645045d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 0x55645045d1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 msgr2=0x556450461d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 0x556450461d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 msgr2=0x7ff0dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 0x7ff0dc03bf30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ad000 tx=0x7ff1e80a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 msgr2=0x556450456030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55645044f980 tx=0x7ff1ec000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 shutdown_connections 2024-09-12T00:19:03.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55645045f940 0x556450461d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564503678a0 0x55645045d1a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff0dc039a70 0x7ff0dc03bf30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 --2- 172.21.15.66:0/3958082308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556450363750 0x556450456030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 >> 172.21.15.66:0/3958082308 conn(0x5564502d7060 msgr2=0x5564504490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 shutdown_connections 2024-09-12T00:19:03.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.201+0000 7ff1f6bab9c0 1 -- 172.21.15.66:0/3958082308 wait complete. 2024-09-12T00:19:03.221 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-12T00:19:03.221 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:19:03.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-12T00:19:03.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-12T00:19:03.222 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-12T00:19:03.302 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:03.303 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:03.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.297+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.297+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e93159c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c2217f28c0 0x55c2217f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e93159c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2216a09c0 con 0x55c2217ee770 2024-09-12T00:19:03.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e93159c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c2216f06d0 con 0x55c2217f28c0 2024-09-12T00:19:03.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c2217f28c0 0x55c2217f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c2217f28c0 0x55c2217f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53362/0 (socket says 172.21.15.66:53362) 2024-09-12T00:19:03.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 -- 172.21.15.66:0/2590683639 learned_addr learned my addr 172.21.15.66:0/2590683639 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 -- 172.21.15.66:0/2590683639 >> v1:172.21.15.31:6789/0 conn(0x55c2217ee770 legacy=0x55c2217eeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 -- 172.21.15.66:0/2590683639 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c221694ca0 con 0x55c2217f28c0 2024-09-12T00:19:03.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e661a640 1 --2- 172.21.15.66:0/2590683639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217f28c0 0x55c2217f4cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a4e0 tx=0x7f21d001b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e72244c75936d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e5e19640 1 -- 172.21.15.66:0/2590683639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00aa540 con 0x55c2217f28c0 2024-09-12T00:19:03.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e5e19640 1 -- 172.21.15.66:0/2590683639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00aa6e0 con 0x55c2217f28c0 2024-09-12T00:19:03.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.301+0000 7f21e5e19640 1 -- 172.21.15.66:0/2590683639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00aaa40 con 0x55c2217f28c0 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 -- 172.21.15.66:0/2590683639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217f28c0 msgr2=0x55c2217f4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2590683639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217f28c0 0x55c2217f4cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a4e0 tx=0x7f21d001b120 comp rx=0 tx=0).stop 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 -- 172.21.15.66:0/2590683639 shutdown_connections 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2590683639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217f28c0 0x55c2217f4cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 -- 172.21.15.66:0/2590683639 >> 172.21.15.66:0/2590683639 conn(0x55c221762080 msgr2=0x55c221762490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 -- 172.21.15.66:0/2590683639 shutdown_connections 2024-09-12T00:19:03.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.305+0000 7f21e93159c0 1 -- 172.21.15.66:0/2590683639 wait complete. 2024-09-12T00:19:03.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c2216f4680 con 0x55c2217ee770 2024-09-12T00:19:03.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e6e1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e6e1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53374/0 (socket says 172.21.15.66:53374) 2024-09-12T00:19:03.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e6e1b640 1 -- 172.21.15.66:0/945617814 learned_addr learned my addr 172.21.15.66:0/945617814 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e6e1b640 1 -- 172.21.15.66:0/945617814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22166fda0 con 0x55c2217ee770 2024-09-12T00:19:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/945617814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21e000b220 tx=0x7f21e000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfb1b1995768f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f20d3e17640 1 -- 172.21.15.66:0/945617814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e000a040 con 0x55c2217ee770 2024-09-12T00:19:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f20d3e17640 1 -- 172.21.15.66:0/945617814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e000f750 con 0x55c2217ee770 2024-09-12T00:19:03.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f20d3e17640 1 -- 172.21.15.66:0/945617814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e000fa70 con 0x55c2217ee770 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- 172.21.15.66:0/945617814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 msgr2=0x55c2218d99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 --2- 172.21.15.66:0/945617814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21e000b220 tx=0x7f21e000b6e0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- 172.21.15.66:0/945617814 shutdown_connections 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 --2- 172.21.15.66:0/945617814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218d99b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- 172.21.15.66:0/945617814 >> 172.21.15.66:0/945617814 conn(0x55c221762080 msgr2=0x55c2218d5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- 172.21.15.66:0/945617814 shutdown_connections 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.321+0000 7f21e93159c0 1 -- 172.21.15.66:0/945617814 wait complete. 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c221696a50 con 0x55c2217ee770 2024-09-12T00:19:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e6e1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e6e1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53386/0 (socket says 172.21.15.66:53386) 2024-09-12T00:19:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e6e1b640 1 -- 172.21.15.66:0/473273413 learned_addr learned my addr 172.21.15.66:0/473273413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e6e1b640 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2218e1600 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55c2218da9a0 tx=0x7f21e0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 -- 172.21.15.66:0/473273413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e001a7c0 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 -- 172.21.15.66:0/473273413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e001a960 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 -- 172.21.15.66:0/473273413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e001ac60 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2218e1890 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2218e22c0 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 -- 172.21.15.66:0/473273413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f21e0017070 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 0x7f20cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.325+0000 7f20d2614640 1 -- 172.21.15.66:0/473273413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f21e0015020 con 0x55c2217ee770 2024-09-12T00:19:03.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e661a640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 0x7f20cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 0x55c2218e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2218e8750 con 0x55c2217f28c0 2024-09-12T00:19:03.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e761c640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 0x55c2218e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e661a640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 0x7f20cc03bf80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ab000 tx=0x7f21d00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e761c640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 0x55c2218e8210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e761c640 1 -- 172.21.15.66:0/473273413 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d80083f0 con 0x55c2217f28c0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2218e26c0 con 0x55c2217f28c0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e761c640 1 -- 172.21.15.66:0/473273413 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d80083f0 con 0x55c2217f28c0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 0x55c2218ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2218ed520 con 0x55c2218eaa40 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 0x55c2218ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 0x55c2218ece30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e6e1b640 1 -- 172.21.15.66:0/473273413 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21e002e070 con 0x55c2218eaa40 2024-09-12T00:19:03.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2218e9910 con 0x55c2217f28c0 2024-09-12T00:19:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e761c640 1 -- 172.21.15.66:0/473273413 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d80083f0 con 0x55c2217f28c0 2024-09-12T00:19:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2218e9d60 con 0x55c2218eaa40 2024-09-12T00:19:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e6e1b640 1 -- 172.21.15.66:0/473273413 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21e002e070 con 0x55c2218eaa40 2024-09-12T00:19:03.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.329+0000 7f21e93159c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c221701450 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53392/0 (socket says 172.21.15.66:53392) 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e761c640 1 -- 172.21.15.66:0/343929828 learned_addr learned my addr 172.21.15.66:0/343929828 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e761c640 1 -- 172.21.15.66:0/343929828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2218fc670 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e761c640 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55c2218e20d0 tx=0x7f21d800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 -- 172.21.15.66:0/343929828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d8007cb0 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 -- 172.21.15.66:0/343929828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d8007e50 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2218fced0 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 -- 172.21.15.66:0/343929828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d80195c0 con 0x55c2218fbc10 2024-09-12T00:19:03.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2218fd440 con 0x55c2218fbc10 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 -- 172.21.15.66:0/343929828 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f21d8016050 con 0x55c2218fbc10 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 0x7f20c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f20cb7fe640 1 -- 172.21.15.66:0/343929828 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f21d8051dc0 con 0x55c2218fbc10 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 0x7f20c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 0x7f20c003bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21e0017b20 tx=0x7f21e001ae00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.333+0000 7f21e93159c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c2218da200 con 0x55c221909580 2024-09-12T00:19:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53406/0 (socket says 172.21.15.66:53406) 2024-09-12T00:19:03.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 -- 172.21.15.66:0/1565302582 learned_addr learned my addr 172.21.15.66:0/1565302582 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 -- 172.21.15.66:0/1565302582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c221909f50 con 0x55c221909580 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 --2- 172.21.15.66:0/1565302582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d8017fd0 tx=0x7f21d8017a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcad016111d713b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f20c97fa640 1 -- 172.21.15.66:0/1565302582 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d8043070 con 0x55c221909580 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f20c97fa640 1 -- 172.21.15.66:0/1565302582 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d8022370 con 0x55c221909580 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f20c97fa640 1 -- 172.21.15.66:0/1565302582 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d8024470 con 0x55c221909580 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- 172.21.15.66:0/1565302582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 msgr2=0x55c221909960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 --2- 172.21.15.66:0/1565302582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21d8017fd0 tx=0x7f21d8017a90 comp rx=0 tx=0).stop 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- 172.21.15.66:0/1565302582 shutdown_connections 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 --2- 172.21.15.66:0/1565302582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c221909960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- 172.21.15.66:0/1565302582 >> 172.21.15.66:0/1565302582 conn(0x55c221904940 msgr2=0x55c221902b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- 172.21.15.66:0/1565302582 shutdown_connections 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- 172.21.15.66:0/1565302582 wait complete. 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 Processor -- start 2024-09-12T00:19:03.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- start start 2024-09-12T00:19:03.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e93159c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c221908470 con 0x55c221909580 2024-09-12T00:19:03.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53410/0 (socket says 172.21.15.66:53410) 2024-09-12T00:19:03.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 learned_addr learned my addr 172.21.15.66:0/2729871531 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.337+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22190feb0 con 0x55c221909580 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e761c640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21d8014710 tx=0x7f21d80500a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 -- 172.21.15.66:0/2729871531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d8017bd0 con 0x55c221909580 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c221910140 con 0x55c221909580 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 -- 172.21.15.66:0/2729871531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d8043030 con 0x55c221909580 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 -- 172.21.15.66:0/2729871531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d8022370 con 0x55c221909580 2024-09-12T00:19:03.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c221910af0 con 0x55c221909580 2024-09-12T00:19:03.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 -- 172.21.15.66:0/2729871531 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f21d803f050 con 0x55c221909580 2024-09-12T00:19:03.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20b0039a70 0x7f20b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f20b77fe640 1 -- 172.21.15.66:0/2729871531 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f21d8036c30 con 0x55c221909580 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20b0039a70 0x7f20b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c22191af30 0x55c22191d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c22191db10 con 0x55c22191af30 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e661a640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c22191af30 0x55c22191d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20b0039a70 0x7f20b003bf30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21e001b7c0 tx=0x7f21e0022000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e661a640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c22191af30 0x55c22191d3c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 realm 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c22191df40 con 0x55c22191af30 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c22191e810 con 0x55c22191af30 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.341+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c22191ebb0 con 0x55c22191af30 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c22191f910 0x55c221921d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221922310 con 0x55c22191f910 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c22191f910 0x55c221921d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c22191f910 0x55c221921d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:03.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 20 searching for the correct realm 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c221923b70 con 0x55c22191f910 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f21d8019070 0x7f21d8048890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c221923b70 con 0x7f21d8019070 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f21d8019070 0x7f21d8048890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f21d8019070 0x7f21d8048890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e6e1b640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21e003f050 0x7f21e0050100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c221923b70 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e661a640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21e003f050 0x7f21e0050100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.345+0000 7f21e661a640 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21e003f050 0x7f21e0050100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c221923b70 con 0x55c22191af30 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c221923b70 con 0x55c22191af30 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21d8019070 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.349+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21d8019070 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.353+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21d8019070 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21d8019070 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191f910 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21e003f050 2024-09-12T00:19:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.357+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x55c22191af30 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f21d00cc040 con 0x7f21d8019070 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221922c60 con 0x55c22191af30 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c2219234b0 con 0x55c22191af30 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221923fa0 con 0x55c22191f910 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:03.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 zone default found 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 4 Realm: () 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 zonegroup default 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221924340 con 0x7f21e003f050 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221926120 con 0x55c22191f910 2024-09-12T00:19:03.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221926600 con 0x55c22191f910 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 started sync module instance, tier type = 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.361+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219255c0 con 0x7f21d8019070 2024-09-12T00:19:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292275253520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221926a60 con 0x7f21d8019070 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219272b0 con 0x55c22191af30 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292275253520] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292275255728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221927310 con 0x55c22191af30 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.365+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221927e20 con 0x55c22191f910 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292275263696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221928290 con 0x55c22191f910 2024-09-12T00:19:03.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221928d30 con 0x7f21d8019070 2024-09-12T00:19:03.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292275255728] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292275263696] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292275260928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221928290 con 0x7f21d8019070 2024-09-12T00:19:03.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.369+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219295d0 con 0x55c22191af30 2024-09-12T00:19:03.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.373+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.373+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292275269920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219299f0 con 0x55c22191af30 2024-09-12T00:19:03.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.373+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192a3f0 con 0x7f21e003f050 2024-09-12T00:19:03.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.373+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292275260928] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292275264992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192a3b0 con 0x7f21e003f050 2024-09-12T00:19:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192adb0 con 0x7f21e003f050 2024-09-12T00:19:03.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292275269920] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292275270976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad70 con 0x7f21e003f050 2024-09-12T00:19:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292275264992] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.377+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192b7f0 con 0x7f21e003f050 2024-09-12T00:19:03.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292275270976] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292275278560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192a8c0 con 0x7f21e003f050 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=0 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=1 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=2 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=3 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=4 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=5 2024-09-12T00:19:03.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.381+0000 7f21e93159c0 20 add_watcher() i=6 2024-09-12T00:19:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292275278560] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 20 add_watcher() i=7 2024-09-12T00:19:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad20 con 0x55c22191af30 2024-09-12T00:19:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292275277088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192bc10 con 0x55c22191af30 2024-09-12T00:19:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292275277088] v31'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f20977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:03.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.385+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221937090 con 0x55c22191af30 2024-09-12T00:19:03.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.389+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.389+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221937650 con 0x7f21e003f050 2024-09-12T00:19:03.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.393+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.393+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221937bc0 con 0x55c22191f910 2024-09-12T00:19:03.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.393+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.393+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221937bc0 con 0x55c22191af30 2024-09-12T00:19:03.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938070 con 0x7f21d8019070 2024-09-12T00:19:03.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936600 con 0x55c22191f910 2024-09-12T00:19:03.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.397+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936600 con 0x55c22191af30 2024-09-12T00:19:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.401+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.401+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936600 con 0x7f21e003f050 2024-09-12T00:19:03.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.401+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.401+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936600 con 0x7f21d8019070 2024-09-12T00:19:03.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.405+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.405+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936600 con 0x55c22191f910 2024-09-12T00:19:03.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.405+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.405+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219366f0 con 0x7f21d8019070 2024-09-12T00:19:03.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.409+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.409+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219366f0 con 0x7f21e003f050 2024-09-12T00:19:03.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.409+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.409+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221936690 con 0x7f21d8019070 2024-09-12T00:19:03.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.413+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.413+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938c50 con 0x7f21e003f050 2024-09-12T00:19:03.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.413+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.413+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938bd0 con 0x55c22191af30 2024-09-12T00:19:03.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'34 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938bd0 con 0x55c22191f910 2024-09-12T00:19:03.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938bd0 con 0x7f21d8019070 2024-09-12T00:19:03.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.417+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938bd0 con 0x55c22191f910 2024-09-12T00:19:03.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.421+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.421+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938c60 con 0x55c22191af30 2024-09-12T00:19:03.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.421+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.421+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938c60 con 0x55c22191af30 2024-09-12T00:19:03.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.425+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'35 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.425+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938e30 con 0x55c22191f910 2024-09-12T00:19:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.425+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.425+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938e30 con 0x7f21d8019070 2024-09-12T00:19:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938e30 con 0x55c22191f910 2024-09-12T00:19:03.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938e30 con 0x55c22191f910 2024-09-12T00:19:03.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.429+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938e30 con 0x55c22191f910 2024-09-12T00:19:03.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.433+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.433+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938c60 con 0x55c22191f910 2024-09-12T00:19:03.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.433+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.433+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938c60 con 0x7f21e003f050 2024-09-12T00:19:03.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.437+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.437+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938d00 con 0x55c22191f910 2024-09-12T00:19:03.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.437+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'22 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.437+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938d00 con 0x7f21e003f050 2024-09-12T00:19:03.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.441+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.441+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938d00 con 0x55c22191f910 2024-09-12T00:19:03.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.441+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.441+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938d00 con 0x7f21e003f050 2024-09-12T00:19:03.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.445+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.445+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221938d20 con 0x7f21d8019070 2024-09-12T00:19:03.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f20967fc640 20 reqs_thread_entry: start 2024-09-12T00:19:03.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:03.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 20 Filter name: none 2024-09-12T00:19:03.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f2007fff640 20 reqs_thread_entry: start 2024-09-12T00:19:03.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T00:19:03.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c221935e50 con 0x7f21d8019070 2024-09-12T00:19:03.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f20977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292275277088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221935830 con 0x55c22191af30 2024-09-12T00:19:03.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94292275277088] v31'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.449+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292275253520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad20 con 0x7f21d8019070 2024-09-12T00:19:03.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94292275253520] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e93159c0 20 remove_watcher() i=0 2024-09-12T00:19:03.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e93159c0 2 removed watcher, disabling cache 2024-09-12T00:19:03.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292275255728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad20 con 0x55c22191af30 2024-09-12T00:19:03.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94292275255728] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e93159c0 20 remove_watcher() i=1 2024-09-12T00:19:03.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.453+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292275263696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219259b0 con 0x55c22191f910 2024-09-12T00:19:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e761c640 1 -- 172.21.15.66:0/2729871531 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94292275263696] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d803c070 con 0x55c22191f910 2024-09-12T00:19:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e93159c0 20 remove_watcher() i=2 2024-09-12T00:19:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292275260928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad20 con 0x7f21d8019070 2024-09-12T00:19:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e6e1b640 1 -- 172.21.15.66:0/2729871531 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94292275260928] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e002e070 con 0x7f21d8019070 2024-09-12T00:19:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e93159c0 20 remove_watcher() i=3 2024-09-12T00:19:03.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.457+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292275269920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219259b0 con 0x55c22191af30 2024-09-12T00:19:03.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94292275269920] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x55c22191af30 2024-09-12T00:19:03.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e93159c0 20 remove_watcher() i=4 2024-09-12T00:19:03.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292275264992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c221926e00 con 0x7f21e003f050 2024-09-12T00:19:03.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94292275264992] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e93159c0 20 remove_watcher() i=5 2024-09-12T00:19:03.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.461+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292275270976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c22192ad20 con 0x7f21e003f050 2024-09-12T00:19:03.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94292275270976] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 20 remove_watcher() i=6 2024-09-12T00:19:03.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292275278560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c2219259b0 con 0x7f21e003f050 2024-09-12T00:19:03.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94292275278560] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d00bc040 con 0x7f21e003f050 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 20 remove_watcher() i=7 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21e003f050 msgr2=0x7f21e0050100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21e003f050 0x7f21e0050100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c22191af30 msgr2=0x55c22191d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c22191af30 0x55c22191d3c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f21d8019070 msgr2=0x7f21d8048890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f21d8019070 0x7f21d8048890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c22191f910 msgr2=0x55c221921d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c22191f910 0x55c221921d00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20b0039a70 msgr2=0x7f20b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20b0039a70 0x7f20b003bf30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21e001b7c0 tx=0x7f21e0022000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 msgr2=0x55c22190f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e661a640 1 -- 172.21.15.66:0/2729871531 reap_dead start 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.465+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21d8014710 tx=0x7f21d80500a0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 shutdown_connections 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/2729871531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c221909580 0x55c22190f950 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 >> 172.21.15.66:0/2729871531 conn(0x55c221904940 msgr2=0x55c221902b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 shutdown_connections 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/2729871531 wait complete. 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 msgr2=0x7f20c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 0x7f20c003bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21e0017b20 tx=0x7f21e001ae00 comp rx=0 tx=0).stop 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 msgr2=0x55c2218fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55c2218e20d0 tx=0x7f21d800af40 comp rx=0 tx=0).stop 2024-09-12T00:19:03.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 shutdown_connections 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20c0039a70 0x7f20c003bf30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/343929828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2218fbc10 0x55c2218fc030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 >> 172.21.15.66:0/343929828 conn(0x55c2218f15c0 msgr2=0x55c2218f19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 shutdown_connections 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/343929828 wait complete. 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 msgr2=0x55c2218e8210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 0x55c2218e8210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 msgr2=0x55c2218ece30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 0x55c2218ece30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 msgr2=0x7f20cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 0x7f20cc03bf80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21d00ab000 tx=0x7f21d00a5000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 msgr2=0x55c2218e10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55c2218da9a0 tx=0x7f21e0000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 shutdown_connections 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c2218eaa40 0x55c2218ece30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c2217f28c0 0x55c2218e8210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f20cc039ac0 0x7f20cc03bf80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 --2- 172.21.15.66:0/473273413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c2217ee770 0x55c2218e10a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 >> 172.21.15.66:0/473273413 conn(0x55c221762080 msgr2=0x55c2218d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 shutdown_connections 2024-09-12T00:19:03.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.469+0000 7f21e93159c0 1 -- 172.21.15.66:0/473273413 wait complete. 2024-09-12T00:19:03.485 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T00:19:03.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-12T00:19:03.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-12T00:19:03.486 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-12T00:19:03.566 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:03.567 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ae066b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562534a63790 0x562534a65b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ae066b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625349119c0 con 0x562534a5fc80 2024-09-12T00:19:03.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ae066b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5625349616d0 con 0x562534a63790 2024-09-12T00:19:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562534a63790 0x562534a65b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562534a63790 0x562534a65b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53418/0 (socket says 172.21.15.66:53418) 2024-09-12T00:19:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 -- 172.21.15.66:0/1400556954 learned_addr learned my addr 172.21.15.66:0/1400556954 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8ade171640 1 --1- 172.21.15.66:0/1400556954 >> v1:172.21.15.31:6789/0 conn(0x562534a5fc80 0x562534a62070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36074/0 (socket says 172.21.15.66:36074) 2024-09-12T00:19:03.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 -- 172.21.15.66:0/1400556954 >> v1:172.21.15.31:6789/0 conn(0x562534a5fc80 legacy=0x562534a62070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 -- 172.21.15.66:0/1400556954 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562534905ca0 con 0x562534a63790 2024-09-12T00:19:03.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.565+0000 7f8add970640 1 --2- 172.21.15.66:0/1400556954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a63790 0x562534a65b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400a5c0 tx=0x7f8ad401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236eb3b863f7c2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8add16f640 1 -- 172.21.15.66:0/1400556954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad40a6070 con 0x562534a63790 2024-09-12T00:19:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8add16f640 1 -- 172.21.15.66:0/1400556954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad40af070 con 0x562534a63790 2024-09-12T00:19:03.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8add16f640 1 -- 172.21.15.66:0/1400556954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad40aa5c0 con 0x562534a63790 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1400556954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a63790 msgr2=0x562534a65b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1400556954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a63790 0x562534a65b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400a5c0 tx=0x7f8ad401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1400556954 shutdown_connections 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1400556954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a63790 0x562534a65b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1400556954 >> 172.21.15.66:0/1400556954 conn(0x5625349d3010 msgr2=0x5625349d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1400556954 shutdown_connections 2024-09-12T00:19:03.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.569+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1400556954 wait complete. 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562534965680 con 0x562534a5fc80 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ade171640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ade171640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53434/0 (socket says 172.21.15.66:53434) 2024-09-12T00:19:03.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ade171640 1 -- 172.21.15.66:0/333822239 learned_addr learned my addr 172.21.15.66:0/333822239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ade171640 1 -- 172.21.15.66:0/333822239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625348e0da0 con 0x562534a5fc80 2024-09-12T00:19:03.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ade171640 1 --2- 172.21.15.66:0/333822239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000b270 tx=0x7f8ad000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac8a17c28a329ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f89cc608640 1 -- 172.21.15.66:0/333822239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad000e5d0 con 0x562534a5fc80 2024-09-12T00:19:03.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f89cc608640 1 -- 172.21.15.66:0/333822239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad000e770 con 0x562534a5fc80 2024-09-12T00:19:03.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f89cc608640 1 -- 172.21.15.66:0/333822239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad000ea70 con 0x562534a5fc80 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/333822239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 msgr2=0x562534b4a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/333822239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000b270 tx=0x7f8ad000b670 comp rx=0 tx=0).stop 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/333822239 shutdown_connections 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/333822239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b4a9e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/333822239 >> 172.21.15.66:0/333822239 conn(0x5625349d3010 msgr2=0x562534b46680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/333822239 shutdown_connections 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/333822239 wait complete. 2024-09-12T00:19:03.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.585+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562534907a50 con 0x562534a5fc80 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade171640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade171640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53446/0 (socket says 172.21.15.66:53446) 2024-09-12T00:19:03.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade171640 1 -- 172.21.15.66:0/1454782252 learned_addr learned my addr 172.21.15.66:0/1454782252 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade171640 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562534b525c0 con 0x562534a5fc80 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade171640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x562534b4b9d0 tx=0x7f8ad0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 -- 172.21.15.66:0/1454782252 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad000be70 con 0x562534a5fc80 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 -- 172.21.15.66:0/1454782252 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad000f9f0 con 0x562534a5fc80 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562534b52850 con 0x562534a5fc80 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 -- 172.21.15.66:0/1454782252 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad000fd10 con 0x562534a5fc80 2024-09-12T00:19:03.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562534b53200 con 0x562534a5fc80 2024-09-12T00:19:03.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 -- 172.21.15.66:0/1454782252 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad0017070 con 0x562534a5fc80 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 0x7f89c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f89cae05640 1 -- 172.21.15.66:0/1454782252 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ad0015020 con 0x562534a5fc80 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8add970640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 0x7f89c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 0x562534b591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b59710 con 0x562534a63790 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.589+0000 7f8ade972640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 0x562534b591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8add970640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 0x7f89c403bf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ae000 tx=0x7f8ad40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade972640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 0x562534b591d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade972640 1 -- 172.21.15.66:0/1454782252 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534a63790 2024-09-12T00:19:03.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b59b60 con 0x562534a63790 2024-09-12T00:19:03.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade972640 1 -- 172.21.15.66:0/1454782252 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534a63790 2024-09-12T00:19:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 0x562534b5dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b5e430 con 0x562534b5b970 2024-09-12T00:19:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade171640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 0x562534b5dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade171640 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 0x562534b5dd60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade171640 1 -- 172.21.15.66:0/1454782252 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ad002e070 con 0x562534b5b970 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b5a810 con 0x562534a63790 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade972640 1 -- 172.21.15.66:0/1454782252 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534a63790 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b5acb0 con 0x562534b5b970 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ade171640 1 -- 172.21.15.66:0/1454782252 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ad002e070 con 0x562534b5b970 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.593+0000 7f8ae066b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562534972450 con 0x562534b6cb60 2024-09-12T00:19:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53452/0 (socket says 172.21.15.66:53452) 2024-09-12T00:19:03.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade972640 1 -- 172.21.15.66:0/1578111390 learned_addr learned my addr 172.21.15.66:0/1578111390 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade972640 1 -- 172.21.15.66:0/1578111390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562534b6d5c0 con 0x562534b6cb60 2024-09-12T00:19:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade972640 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x562534b59ab0 tx=0x7f8ad80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 -- 172.21.15.66:0/1578111390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8013640 con 0x562534b6cb60 2024-09-12T00:19:03.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 -- 172.21.15.66:0/1578111390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad80137e0 con 0x562534b6cb60 2024-09-12T00:19:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562534b6de20 con 0x562534b6cb60 2024-09-12T00:19:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 -- 172.21.15.66:0/1578111390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8013ac0 con 0x562534b6cb60 2024-09-12T00:19:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562534b6e390 con 0x562534b6cb60 2024-09-12T00:19:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 -- 172.21.15.66:0/1578111390 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad8011040 con 0x562534b6cb60 2024-09-12T00:19:03.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 0x7f89b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f89c3fff640 1 -- 172.21.15.66:0/1578111390 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ad800e040 con 0x562534b6cb60 2024-09-12T00:19:03.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade171640 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 0x7f89b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ade171640 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 0x7f89b803bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ad004e1b0 tx=0x7f8ad0019e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.597+0000 7f8ae066b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562534b4b210 con 0x562534b7a470 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53456/0 (socket says 172.21.15.66:53456) 2024-09-12T00:19:03.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 -- 172.21.15.66:0/3746389419 learned_addr learned my addr 172.21.15.66:0/3746389419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 -- 172.21.15.66:0/3746389419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562534b7ae60 con 0x562534b7a470 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- 172.21.15.66:0/3746389419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ad801fc20 tx=0x7f8ad801fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee616554bf1ada server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f89c1ffb640 1 -- 172.21.15.66:0/3746389419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad80293a0 con 0x562534b7a470 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f89c1ffb640 1 -- 172.21.15.66:0/3746389419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad802a3f0 con 0x562534b7a470 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f89c1ffb640 1 -- 172.21.15.66:0/3746389419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad80520d0 con 0x562534b7a470 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/3746389419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 msgr2=0x562534b7a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/3746389419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ad801fc20 tx=0x7f8ad801fc50 comp rx=0 tx=0).stop 2024-09-12T00:19:03.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/3746389419 shutdown_connections 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/3746389419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b7a870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/3746389419 >> 172.21.15.66:0/3746389419 conn(0x562534b75890 msgr2=0x562534b73ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/3746389419 shutdown_connections 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/3746389419 wait complete. 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 Processor -- start 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- start start 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b80910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ae066b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562534b793c0 con 0x562534b7a470 2024-09-12T00:19:03.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b80910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b80910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53460/0 (socket says 172.21.15.66:53460) 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 learned_addr learned my addr 172.21.15.66:0/1503023374 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562534b80e70 con 0x562534b7a470 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.601+0000 7f8ade972640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b80910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ad804b010 tx=0x7f8ad80508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 -- 172.21.15.66:0/1503023374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad8013e40 con 0x562534b7a470 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562534b81100 con 0x562534b7a470 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 -- 172.21.15.66:0/1503023374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad80293a0 con 0x562534b7a470 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 -- 172.21.15.66:0/1503023374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad803ece0 con 0x562534b7a470 2024-09-12T00:19:03.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562534b81100 con 0x562534b7a470 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 -- 172.21.15.66:0/1503023374 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ad8050a60 con 0x562534b7a470 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89a8039a70 0x7f89a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f89affff640 1 -- 172.21.15.66:0/1503023374 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ad80344b0 con 0x562534b7a470 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ade171640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89a8039a70 0x7f89a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534b8bd10 0x562534b8e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b8e8f0 con 0x562534b8bd10 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534b8bd10 0x562534b8e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ade171640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89a8039a70 0x7f89a803bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0049010 tx=0x7f8ad0036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534b8bd10 0x562534b8e1a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 realm 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b8ed20 con 0x562534b8bd10 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b8f5f0 con 0x562534b8bd10 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b8f990 con 0x562534b8bd10 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.605+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b906f0 0x562534b92ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b930f0 con 0x562534b906f0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b906f0 0x562534b92ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b906f0 0x562534b92ae0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ae066b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ae066b9c0 20 searching for the correct realm 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ad803cbe0 0x7f8ad8008a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade171640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ad803cbe0 0x7f8ad8008a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade171640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ad803cbe0 0x7f8ad8008a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade171640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ad0042100 0x7f8ad001b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8add970640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ad0042100 0x7f8ad001b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8add970640 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ad0042100 0x7f8ad001b730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.609+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.613+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.617+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b906f0 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad0042100 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.621+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x562534b8bd10 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562534b94950 con 0x7f8ad803cbe0 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b93a40 con 0x562534b8bd10 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b94290 con 0x562534b8bd10 2024-09-12T00:19:03.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b94d80 con 0x562534b906f0 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 zone default found 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 4 Realm: () 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 zonegroup default 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b95120 con 0x7f8ad0042100 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b96f00 con 0x562534b906f0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b973c0 con 0x562534b906f0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:03.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.625+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b963a0 con 0x7f8ad803cbe0 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94717798344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96000 con 0x7f8ad803cbe0 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b98200 con 0x562534b8bd10 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94717798344592] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94717798348832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b985f0 con 0x562534b8bd10 2024-09-12T00:19:03.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.629+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b98fb0 con 0x562534b906f0 2024-09-12T00:19:03.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94717798348832] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94717798349888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b98fb0 con 0x562534b906f0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b999c0 con 0x7f8ad803cbe0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94717798356240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9a210 con 0x7f8ad803cbe0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9ac10 con 0x562534b8bd10 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.633+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94717798349888] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94717798356240] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94717798358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9a720 con 0x562534b8bd10 2024-09-12T00:19:03.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9b4b0 con 0x7f8ad0042100 2024-09-12T00:19:03.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94717798358368] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94717798353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9b420 con 0x7f8ad0042100 2024-09-12T00:19:03.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.637+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9bde0 con 0x7f8ad0042100 2024-09-12T00:19:03.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.641+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94717798353664] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.641+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94717798363264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9bde0 con 0x7f8ad0042100 2024-09-12T00:19:03.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9c7a0 con 0x7f8ad0042100 2024-09-12T00:19:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94717798363264] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94717798365488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9c980 con 0x7f8ad0042100 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=0 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=1 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=2 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=3 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=4 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=5 2024-09-12T00:19:03.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=6 2024-09-12T00:19:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94717798365488] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x7f8ad0042100 2024-09-12T00:19:03.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 20 add_watcher() i=7 2024-09-12T00:19:03.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:03.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.645+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534b9fb60 con 0x562534b8bd10 2024-09-12T00:19:03.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94717798380816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9c920 con 0x562534b8bd10 2024-09-12T00:19:03.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94717798380816] v31'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f89957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8ae066b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:03.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8ae066b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:03.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.649+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba8580 con 0x562534b8bd10 2024-09-12T00:19:03.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad40aa9f0 con 0x562534b8bd10 2024-09-12T00:19:03.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba8c50 con 0x7f8ad0042100 2024-09-12T00:19:03.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba9070 con 0x562534b906f0 2024-09-12T00:19:03.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.653+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba8fa0 con 0x562534b8bd10 2024-09-12T00:19:03.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.657+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.657+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba9530 con 0x7f8ad803cbe0 2024-09-12T00:19:03.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.657+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.657+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba99c0 con 0x562534b906f0 2024-09-12T00:19:03.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.661+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.661+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba99c0 con 0x562534b8bd10 2024-09-12T00:19:03.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.661+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.661+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad0042100 2024-09-12T00:19:03.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.665+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.665+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad803cbe0 2024-09-12T00:19:03.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.665+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.665+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x562534b906f0 2024-09-12T00:19:03.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad803cbe0 2024-09-12T00:19:03.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad0042100 2024-09-12T00:19:03.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.669+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad803cbe0 2024-09-12T00:19:03.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.673+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.673+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x7f8ad0042100 2024-09-12T00:19:03.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'35 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6270 con 0x562534b8bd10 2024-09-12T00:19:03.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'39 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba62b0 con 0x562534b906f0 2024-09-12T00:19:03.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.677+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6360 con 0x7f8ad803cbe0 2024-09-12T00:19:03.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.681+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.681+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534baa2f0 con 0x562534b906f0 2024-09-12T00:19:03.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.681+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.681+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534baa2f0 con 0x562534b8bd10 2024-09-12T00:19:03.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.685+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.685+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534baa2f0 con 0x562534b8bd10 2024-09-12T00:19:03.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.685+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'40 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.685+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534baa2f0 con 0x562534b906f0 2024-09-12T00:19:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.689+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.689+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60a0 con 0x7f8ad803cbe0 2024-09-12T00:19:03.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.689+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.689+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x562534b906f0 2024-09-12T00:19:03.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.693+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.693+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6140 con 0x562534b906f0 2024-09-12T00:19:03.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.693+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.693+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba6140 con 0x562534b906f0 2024-09-12T00:19:03.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.697+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.697+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x562534b906f0 2024-09-12T00:19:03.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.697+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.697+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x7f8ad0042100 2024-09-12T00:19:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.701+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.701+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x562534b906f0 2024-09-12T00:19:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.701+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'23 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.701+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x7f8ad0042100 2024-09-12T00:19:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.705+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.705+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x562534b906f0 2024-09-12T00:19:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.705+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.705+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x7f8ad0042100 2024-09-12T00:19:03.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.709+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.709+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba60e0 con 0x7f8ad803cbe0 2024-09-12T00:19:03.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f898f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:03.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:03.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 20 Filter name: none 2024-09-12T00:19:03.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f898d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:03.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T00:19:03.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562534ba5c90 con 0x7f8ad0042100 2024-09-12T00:19:03.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T00:19:03.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.713+0000 7f8ae066b9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T00:19:03.719 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T00:19:03.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f89957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94717798380816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba5920 con 0x562534b8bd10 2024-09-12T00:19:03.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94717798380816] v31'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94717798344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534ba7920 con 0x7f8ad803cbe0 2024-09-12T00:19:03.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94717798344592] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ae066b9c0 20 remove_watcher() i=0 2024-09-12T00:19:03.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ae066b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:03.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.717+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94717798348832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96790 con 0x562534b8bd10 2024-09-12T00:19:03.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94717798348832] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8ae066b9c0 20 remove_watcher() i=1 2024-09-12T00:19:03.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94717798349888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96790 con 0x562534b906f0 2024-09-12T00:19:03.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8ade972640 1 -- 172.21.15.66:0/1503023374 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94717798349888] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad800a4d0 con 0x562534b906f0 2024-09-12T00:19:03.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8ae066b9c0 20 remove_watcher() i=2 2024-09-12T00:19:03.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.721+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94717798356240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96790 con 0x7f8ad803cbe0 2024-09-12T00:19:03.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.725+0000 7f8ade171640 1 -- 172.21.15.66:0/1503023374 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94717798356240] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad002e070 con 0x7f8ad803cbe0 2024-09-12T00:19:03.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.725+0000 7f8ae066b9c0 20 remove_watcher() i=3 2024-09-12T00:19:03.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.725+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94717798358368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96790 con 0x562534b8bd10 2024-09-12T00:19:03.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94717798358368] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x562534b8bd10 2024-09-12T00:19:03.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8ae066b9c0 20 remove_watcher() i=4 2024-09-12T00:19:03.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94717798353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b99d60 con 0x7f8ad0042100 2024-09-12T00:19:03.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94717798353664] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8ae066b9c0 20 remove_watcher() i=5 2024-09-12T00:19:03.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.729+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94717798363264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b96790 con 0x7f8ad0042100 2024-09-12T00:19:03.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94717798363264] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 20 remove_watcher() i=6 2024-09-12T00:19:03.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94717798365488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562534b9b080 con 0x7f8ad0042100 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94717798365488] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ad40d5040 con 0x7f8ad0042100 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 20 remove_watcher() i=7 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ad0042100 msgr2=0x7f8ad001b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ad0042100 0x7f8ad001b730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534b8bd10 msgr2=0x562534b8e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534b8bd10 0x562534b8e1a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ad803cbe0 msgr2=0x7f8ad8008a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ad803cbe0 0x7f8ad8008a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b906f0 msgr2=0x562534b92ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b906f0 0x562534b92ae0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89a8039a70 msgr2=0x7f89a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89a8039a70 0x7f89a803bf30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0049010 tx=0x7f8ad0036000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 msgr2=0x562534b80910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1503023374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b7a470 0x562534b80910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ad804b010 tx=0x7f8ad80508b0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 reap_dead start 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8add970640 1 -- 172.21.15.66:0/1503023374 reap_dead start 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 shutdown_connections 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 >> 172.21.15.66:0/1503023374 conn(0x562534b75890 msgr2=0x562534b73aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 shutdown_connections 2024-09-12T00:19:03.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1503023374 wait complete. 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 msgr2=0x7f89b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 0x7f89b803bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ad004e1b0 tx=0x7f8ad0019e70 comp rx=0 tx=0).stop 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 msgr2=0x562534b6cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x562534b59ab0 tx=0x7f8ad80167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 shutdown_connections 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89b8039a70 0x7f89b803bf30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1578111390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534b6cb60 0x562534b6cf80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 >> 172.21.15.66:0/1578111390 conn(0x562534b62510 msgr2=0x562534b628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 shutdown_connections 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.733+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1578111390 wait complete. 2024-09-12T00:19:03.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 msgr2=0x562534b591d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 0x562534b591d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 msgr2=0x562534b5dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 0x562534b5dd60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 msgr2=0x7f89c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 0x7f89c403bf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ae000 tx=0x7f8ad40a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 msgr2=0x562534b52060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x562534b4b9d0 tx=0x7f8ad0000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 shutdown_connections 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562534b5b970 0x562534b5dd60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562534a63790 0x562534b591d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89c4039a70 0x7f89c403bf30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 --2- 172.21.15.66:0/1454782252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562534a5fc80 0x562534b52060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 >> 172.21.15.66:0/1454782252 conn(0x5625349d3010 msgr2=0x562534b45110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 shutdown_connections 2024-09-12T00:19:03.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.737+0000 7f8ae066b9c0 1 -- 172.21.15.66:0/1454782252 wait complete. 2024-09-12T00:19:03.752 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T00:19:03.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:03.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:03.753 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T00:19:03.835 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:03.836 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:03.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc2728239c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564468eba770 0x564468ebab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc2728239c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564468d6c9c0 con 0x564468ebd8b0 2024-09-12T00:19:03.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc2728239c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564468dbc6d0 con 0x564468eba770 2024-09-12T00:19:03.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc270329640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564468eba770 0x564468ebab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc270329640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564468eba770 0x564468ebab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53474/0 (socket says 172.21.15.66:53474) 2024-09-12T00:19:03.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc270329640 1 -- 172.21.15.66:0/1365511871 learned_addr learned my addr 172.21.15.66:0/1365511871 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc270329640 1 -- 172.21.15.66:0/1365511871 >> v1:172.21.15.31:6789/0 conn(0x564468ebd8b0 legacy=0x564468ebfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.833+0000 7fc270329640 1 -- 172.21.15.66:0/1365511871 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468d60ca0 con 0x564468eba770 2024-09-12T00:19:03.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc270329640 1 --2- 172.21.15.66:0/1365511871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468ebab50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc26800a4e0 tx=0x7fc26801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ee9fd048c6a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc26f327640 1 -- 172.21.15.66:0/1365511871 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680aa540 con 0x564468eba770 2024-09-12T00:19:03.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc26f327640 1 -- 172.21.15.66:0/1365511871 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2680aa6e0 con 0x564468eba770 2024-09-12T00:19:03.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc26f327640 1 -- 172.21.15.66:0/1365511871 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680aaa40 con 0x564468eba770 2024-09-12T00:19:03.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 -- 172.21.15.66:0/1365511871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 msgr2=0x564468ebab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1365511871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468ebab50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc26800a4e0 tx=0x7fc26801b090 comp rx=0 tx=0).stop 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 -- 172.21.15.66:0/1365511871 shutdown_connections 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1365511871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468ebab50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 -- 172.21.15.66:0/1365511871 >> 172.21.15.66:0/1365511871 conn(0x564468e2e080 msgr2=0x564468e2e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 -- 172.21.15.66:0/1365511871 shutdown_connections 2024-09-12T00:19:03.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.837+0000 7fc2728239c0 1 -- 172.21.15.66:0/1365511871 wait complete. 2024-09-12T00:19:03.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc2728239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc2728239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564468dc0680 con 0x564468eba770 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc270329640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc270329640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53488/0 (socket says 172.21.15.66:53488) 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc270329640 1 -- 172.21.15.66:0/1645801491 learned_addr learned my addr 172.21.15.66:0/1645801491 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc270329640 1 -- 172.21.15.66:0/1645801491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468d3bda0 con 0x564468eba770 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.853+0000 7fc270329640 1 --2- 172.21.15.66:0/1645801491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc268019740 tx=0x7fc2680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fbb4605010e84b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15d61a640 1 -- 172.21.15.66:0/1645801491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680b9070 con 0x564468eba770 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15d61a640 1 -- 172.21.15.66:0/1645801491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2680aaa90 con 0x564468eba770 2024-09-12T00:19:03.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15d61a640 1 -- 172.21.15.66:0/1645801491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680aad70 con 0x564468eba770 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/1645801491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 msgr2=0x564468fa59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1645801491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc268019740 tx=0x7fc2680033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/1645801491 shutdown_connections 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1645801491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468fa59e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/1645801491 >> 172.21.15.66:0/1645801491 conn(0x564468e2e080 msgr2=0x564468fa1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/1645801491 shutdown_connections 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/1645801491 wait complete. 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564468d62a50 con 0x564468eba770 2024-09-12T00:19:03.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc270329640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc270329640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53502/0 (socket says 172.21.15.66:53502) 2024-09-12T00:19:03.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc270329640 1 -- 172.21.15.66:0/735489844 learned_addr learned my addr 172.21.15.66:0/735489844 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc270329640 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468fad4c0 con 0x564468eba770 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc270329640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f90 tx=0x7fc268017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15be17640 1 -- 172.21.15.66:0/735489844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680b9030 con 0x564468eba770 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564468fad750 con 0x564468eba770 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15be17640 1 -- 172.21.15.66:0/735489844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2680b5ad0 con 0x564468eba770 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc15be17640 1 -- 172.21.15.66:0/735489844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2680b5db0 con 0x564468eba770 2024-09-12T00:19:03.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.857+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564468fae180 con 0x564468eba770 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc15be17640 1 -- 172.21.15.66:0/735489844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc2680b3040 con 0x564468eba770 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc15be17640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 0x7fc15403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc15be17640 1 -- 172.21.15.66:0/735489844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc2680c4030 con 0x564468eba770 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc26fb28640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 0x7fc15403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 0x564468fb40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fb4610 con 0x564468ebd8b0 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270b2a640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 0x564468fb40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc26fb28640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 0x7fc15403bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc258001e60 tx=0x7fc2580013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270b2a640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 0x564468fb40d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270b2a640 1 -- 172.21.15.66:0/735489844 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2600083f0 con 0x564468ebd8b0 2024-09-12T00:19:03.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fae430 con 0x564468ebd8b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270b2a640 1 -- 172.21.15.66:0/735489844 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2600083f0 con 0x564468ebd8b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 0x564468fb8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fb93e0 con 0x564468fb68b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270329640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 0x564468fb8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270329640 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 0x564468fb8ca0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.861+0000 7fc270329640 1 -- 172.21.15.66:0/735489844 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2680a93c0 con 0x564468fb68b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fb5720 con 0x564468ebd8b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 -- 172.21.15.66:0/735489844 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2600083f0 con 0x564468ebd8b0 2024-09-12T00:19:03.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fb5b90 con 0x564468fb68b0 2024-09-12T00:19:03.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270329640 1 -- 172.21.15.66:0/735489844 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2680a93c0 con 0x564468fb68b0 2024-09-12T00:19:03.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564468dcd450 con 0x564468fc7af0 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53514/0 (socket says 172.21.15.66:53514) 2024-09-12T00:19:03.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 -- 172.21.15.66:0/28266887 learned_addr learned my addr 172.21.15.66:0/28266887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 -- 172.21.15.66:0/28266887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468fc8550 con 0x564468fc7af0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc270b2a640 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564468fad9a0 tx=0x7fc26000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc159612640 1 -- 172.21.15.66:0/28266887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc26001c020 con 0x564468fc7af0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc159612640 1 -- 172.21.15.66:0/28266887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260007d00 con 0x564468fc7af0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564468fc8db0 con 0x564468fc7af0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc159612640 1 -- 172.21.15.66:0/28266887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc260018440 con 0x564468fc7af0 2024-09-12T00:19:03.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.865+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564468fc9320 con 0x564468fc7af0 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc159612640 1 -- 172.21.15.66:0/28266887 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc26001f020 con 0x564468fc7af0 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc159612640 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 0x7fc14803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc159612640 1 -- 172.21.15.66:0/28266887 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc260051cf0 con 0x564468fc7af0 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270329640 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 0x7fc14803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270329640 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 0x7fc14803bf30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564468fae7d0 tx=0x7fc2680bde80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564468fa6150 con 0x564468fd5460 2024-09-12T00:19:03.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53518/0 (socket says 172.21.15.66:53518) 2024-09-12T00:19:03.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270b2a640 1 -- 172.21.15.66:0/1360207071 learned_addr learned my addr 172.21.15.66:0/1360207071 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270b2a640 1 -- 172.21.15.66:0/1360207071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468fd5e30 con 0x564468fd5460 2024-09-12T00:19:03.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc270b2a640 1 --2- 172.21.15.66:0/1360207071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc260050100 tx=0x7fc260043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6b954cfa7fed09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc152ffd640 1 -- 172.21.15.66:0/1360207071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc260021530 con 0x564468fd5460 2024-09-12T00:19:03.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc152ffd640 1 -- 172.21.15.66:0/1360207071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260029c50 con 0x564468fd5460 2024-09-12T00:19:03.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc152ffd640 1 -- 172.21.15.66:0/1360207071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc260028300 con 0x564468fd5460 2024-09-12T00:19:03.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- 172.21.15.66:0/1360207071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 msgr2=0x564468fd5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:03.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1360207071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc260050100 tx=0x7fc260043110 comp rx=0 tx=0).stop 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- 172.21.15.66:0/1360207071 shutdown_connections 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 --2- 172.21.15.66:0/1360207071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fd5840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- 172.21.15.66:0/1360207071 >> 172.21.15.66:0/1360207071 conn(0x564468fd0820 msgr2=0x564468fcea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- 172.21.15.66:0/1360207071 shutdown_connections 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.869+0000 7fc2728239c0 1 -- 172.21.15.66:0/1360207071 wait complete. 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 Processor -- start 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 -- start start 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564468fd4350 con 0x564468fd5460 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270b2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53528/0 (socket says 172.21.15.66:53528) 2024-09-12T00:19:03.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 learned_addr learned my addr 172.21.15.66:0/3963568011 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:03.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564468fdbe30 con 0x564468fd5460 2024-09-12T00:19:03.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270b2a640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc260021fd0 tx=0x7fc260050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 -- 172.21.15.66:0/3963568011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc260028af0 con 0x564468fd5460 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564468fdc0c0 con 0x564468fd5460 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 -- 172.21.15.66:0/3963568011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260028c90 con 0x564468fd5460 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 -- 172.21.15.66:0/3963568011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2600203b0 con 0x564468fd5460 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564468fdca70 con 0x564468fd5460 2024-09-12T00:19:03.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 -- 172.21.15.66:0/3963568011 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc260016040 con 0x564468fd5460 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc138039a70 0x7fc13803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc1517fa640 1 -- 172.21.15.66:0/3963568011 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc260032070 con 0x564468fd5460 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc270329640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc138039a70 0x7fc13803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468fe6e00 0x564468fe92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.873+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fe9a10 con 0x564468fe6e00 2024-09-12T00:19:03.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468fe6e00 0x564468fe92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270329640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc138039a70 0x7fc13803bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2680d73f0 tx=0x7fc2680e3000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468fe6e00 0x564468fe92c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25800d040 con 0x564468fe6e00 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 realm 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fe6150 con 0x564468fe6e00 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25800d040 con 0x564468fe6e00 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:03.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fea510 con 0x564468fe6e00 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25800d040 con 0x564468fe6e00 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468feade0 con 0x564468fe6e00 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc25800d040 con 0x564468fe6e00 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468feb800 0x564468fedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fee330 con 0x564468feb800 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468feb800 0x564468fedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468feb800 0x564468fedbf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 20 searching for the correct realm 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc260021020 0x7fc26002b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270329640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc260021020 0x7fc26002b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.877+0000 7fc270329640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc260021020 0x7fc26002b870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc270329640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc2680e96c0 0x7fc2680d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc2680e96c0 0x7fc2680d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc2680e96c0 0x7fc2680d7570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:03.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25800d040 con 0x7fc2680e96c0 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25800d040 con 0x564468fe6e00 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.881+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.885+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.889+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468feb800 2024-09-12T00:19:03.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc2680e96c0 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x564468fe6e00 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564468fefc00 con 0x7fc260021020 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:03.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468feecb0 con 0x564468fe6e00 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fef550 con 0x564468fe6e00 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:03.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468fef550 con 0x564468feb800 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 zone default found 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 4 Realm: () 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 zonegroup default 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468ff0030 con 0x7fc2680e96c0 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.893+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468ff1ed0 con 0x564468feb800 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468ff2270 con 0x564468feb800 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 20 started sync module instance, tier type = 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff1310 con 0x7fc260021020 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851819310688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff26a0 con 0x7fc260021020 2024-09-12T00:19:03.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.897+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff2ef0 con 0x564468fe6e00 2024-09-12T00:19:03.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851819310688] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851819317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff3310 con 0x564468fe6e00 2024-09-12T00:19:03.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff3b60 con 0x564468feb800 2024-09-12T00:19:03.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851819317824] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851819319152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff3980 con 0x564468feb800 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.901+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff4570 con 0x7fc260021020 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851819323584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff4dc0 con 0x7fc260021020 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff5780 con 0x564468fe6e00 2024-09-12T00:19:03.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851819319152] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851819323584] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851819325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff5780 con 0x564468fe6e00 2024-09-12T00:19:03.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.905+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff4d30 con 0x7fc2680e96c0 2024-09-12T00:19:03.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851819325712] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851819328208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff5ba0 con 0x7fc2680e96c0 2024-09-12T00:19:03.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff6560 con 0x7fc2680e96c0 2024-09-12T00:19:03.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851819331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff6980 con 0x7fc2680e96c0 2024-09-12T00:19:03.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff73d0 con 0x7fc2680e96c0 2024-09-12T00:19:03.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.909+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851819328208] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851819331760] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851819329264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff6980 con 0x7fc2680e96c0 2024-09-12T00:19:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=0 2024-09-12T00:19:03.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=1 2024-09-12T00:19:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=2 2024-09-12T00:19:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=3 2024-09-12T00:19:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=4 2024-09-12T00:19:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=5 2024-09-12T00:19:03.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=6 2024-09-12T00:19:03.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851819329264] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 20 add_watcher() i=7 2024-09-12T00:19:03.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.913+0000 7fc2728239c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:03.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564468ffa3c0 con 0x564468fe6e00 2024-09-12T00:19:03.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851819333280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff7840 con 0x564468fe6e00 2024-09-12T00:19:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851819333280] v31'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc1267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc2728239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc2728239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:03.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.917+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469002c20 con 0x564468fe6e00 2024-09-12T00:19:03.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.921+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.921+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469002c20 con 0x7fc2680e96c0 2024-09-12T00:19:03.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.921+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.921+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690036a0 con 0x564468feb800 2024-09-12T00:19:03.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.925+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.925+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003640 con 0x564468fe6e00 2024-09-12T00:19:03.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.925+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.925+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003bb0 con 0x7fc260021020 2024-09-12T00:19:03.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.925+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.929+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003f90 con 0x564468feb800 2024-09-12T00:19:03.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.929+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.929+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003f30 con 0x564468fe6e00 2024-09-12T00:19:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.929+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.929+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003f30 con 0x7fc2680e96c0 2024-09-12T00:19:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.933+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.933+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469003f30 con 0x7fc260021020 2024-09-12T00:19:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.937+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.937+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x564468feb800 2024-09-12T00:19:03.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.937+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.937+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x7fc260021020 2024-09-12T00:19:03.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.937+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.941+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x7fc2680e96c0 2024-09-12T00:19:03.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.941+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.941+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x7fc260021020 2024-09-12T00:19:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.945+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.945+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x7fc2680e96c0 2024-09-12T00:19:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.945+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'37 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.945+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x564468fe6e00 2024-09-12T00:19:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.949+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'44 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.949+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644690043e0 con 0x564468feb800 2024-09-12T00:19:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.949+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.949+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004470 con 0x7fc260021020 2024-09-12T00:19:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.953+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.953+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004470 con 0x564468feb800 2024-09-12T00:19:03.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.953+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.953+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004470 con 0x564468fe6e00 2024-09-12T00:19:03.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004470 con 0x564468fe6e00 2024-09-12T00:19:03.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'45 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004470 con 0x564468feb800 2024-09-12T00:19:03.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.957+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x7fc260021020 2024-09-12T00:19:03.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.961+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.961+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x564468feb800 2024-09-12T00:19:03.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.961+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.961+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x564468feb800 2024-09-12T00:19:03.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.965+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.965+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x564468feb800 2024-09-12T00:19:03.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.965+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.965+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x564468feb800 2024-09-12T00:19:03.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.969+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'30 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.969+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x7fc2680e96c0 2024-09-12T00:19:03.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.969+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.969+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004550 con 0x564468feb800 2024-09-12T00:19:03.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.973+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'24 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.973+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004550 con 0x7fc2680e96c0 2024-09-12T00:19:03.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.973+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.973+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004510 con 0x564468feb800 2024-09-12T00:19:03.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.977+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.977+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004550 con 0x7fc2680e96c0 2024-09-12T00:19:03.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469004550 con 0x7fc260021020 2024-09-12T00:19:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc1257e2640 20 reqs_thread_entry: start 2024-09-12T00:19:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 20 Filter name: none 2024-09-12T00:19:03.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc11e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:03.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.981+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564469002820 con 0x7fc2680e96c0 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc2728239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc2728239c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T00:19:03.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc2728239c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:03.991 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T00:19:03.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc1267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:03.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851819333280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564469002200 con 0x564468fe6e00 2024-09-12T00:19:03.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94851819333280] v31'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.985+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851819310688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff6670 con 0x7fc260021020 2024-09-12T00:19:03.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94851819310688] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc2728239c0 20 remove_watcher() i=0 2024-09-12T00:19:03.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc2728239c0 2 removed watcher, disabling cache 2024-09-12T00:19:03.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851819317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff0e60 con 0x564468fe6e00 2024-09-12T00:19:03.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94851819317824] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:03.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc2728239c0 20 remove_watcher() i=1 2024-09-12T00:19:03.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.989+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851819319152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff0e60 con 0x564468feb800 2024-09-12T00:19:03.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc270b2a640 1 -- 172.21.15.66:0/3963568011 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94851819319152] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26003c020 con 0x564468feb800 2024-09-12T00:19:03.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc2728239c0 20 remove_watcher() i=2 2024-09-12T00:19:03.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851819323584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff2f70 con 0x7fc260021020 2024-09-12T00:19:03.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc270329640 1 -- 172.21.15.66:0/3963568011 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94851819323584] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2680a93c0 con 0x7fc260021020 2024-09-12T00:19:03.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc2728239c0 20 remove_watcher() i=3 2024-09-12T00:19:04.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.993+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851819325712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff0e60 con 0x564468fe6e00 2024-09-12T00:19:04.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94851819325712] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x564468fe6e00 2024-09-12T00:19:04.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc2728239c0 20 remove_watcher() i=4 2024-09-12T00:19:04.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851819328208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff4910 con 0x7fc2680e96c0 2024-09-12T00:19:04.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94851819328208] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:04.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc2728239c0 20 remove_watcher() i=5 2024-09-12T00:19:04.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:03.997+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851819331760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff0e60 con 0x7fc2680e96c0 2024-09-12T00:19:04.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.001+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94851819331760] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:04.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.001+0000 7fc2728239c0 20 remove_watcher() i=6 2024-09-12T00:19:04.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.001+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851819329264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564468ff52d0 con 0x7fc2680e96c0 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94851819329264] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25802a040 con 0x7fc2680e96c0 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 20 remove_watcher() i=7 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc2680e96c0 msgr2=0x7fc2680d7570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc2680e96c0 0x7fc2680d7570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468fe6e00 msgr2=0x564468fe92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468fe6e00 0x564468fe92c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc260021020 msgr2=0x7fc26002b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc260021020 0x7fc26002b870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468feb800 msgr2=0x564468fedbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468feb800 0x564468fedbf0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc138039a70 msgr2=0x7fc13803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc138039a70 0x7fc13803bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2680d73f0 tx=0x7fc2680e3000 comp rx=0 tx=0).stop 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 msgr2=0x564468fdb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc260021fd0 tx=0x7fc260050090 comp rx=0 tx=0).stop 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc26fb28640 1 -- 172.21.15.66:0/3963568011 reap_dead start 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 shutdown_connections 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/3963568011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fd5460 0x564468fdb8d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 >> 172.21.15.66:0/3963568011 conn(0x564468fd0820 msgr2=0x564468fcea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 shutdown_connections 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/3963568011 wait complete. 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 msgr2=0x7fc14803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 0x7fc14803bf30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564468fae7d0 tx=0x7fc2680bde80 comp rx=0 tx=0).stop 2024-09-12T00:19:04.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 msgr2=0x564468fc7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564468fad9a0 tx=0x7fc26000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 shutdown_connections 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc148039a70 0x7fc14803bf30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/28266887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468fc7af0 0x564468fc7f10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 >> 172.21.15.66:0/28266887 conn(0x564468fbd4a0 msgr2=0x564468fbd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 shutdown_connections 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/28266887 wait complete. 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 msgr2=0x564468fb40d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 0x564468fb40d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 msgr2=0x564468fb8ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 0x564468fb8ca0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 msgr2=0x7fc15403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 0x7fc15403bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc258001e60 tx=0x7fc2580013e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 msgr2=0x564468facf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f90 tx=0x7fc268017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 shutdown_connections 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564468fb68b0 0x564468fb8ca0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564468ebd8b0 0x564468fb40d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc154039a70 0x7fc15403bf30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 --2- 172.21.15.66:0/735489844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564468eba770 0x564468facf60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 >> 172.21.15.66:0/735489844 conn(0x564468e2e080 msgr2=0x564468fa0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 shutdown_connections 2024-09-12T00:19:04.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.005+0000 7fc2728239c0 1 -- 172.21.15.66:0/735489844 wait complete. 2024-09-12T00:19:04.025 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T00:19:04.025 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:04.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:04.025 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T00:19:04.105 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:04.105 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:04.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc5651569c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc5651569c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc9fa879c0 con 0x55bc9fbd5770 2024-09-12T00:19:04.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc5651569c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55bc9fad76d0 con 0x55bc9fbd98c0 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc55bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc55bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53532/0 (socket says 172.21.15.66:53532) 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc55bfff640 1 -- 172.21.15.66:0/3909947216 learned_addr learned my addr 172.21.15.66:0/3909947216 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc562c5c640 1 --1- 172.21.15.66:0/3909947216 >> v1:172.21.15.31:6789/0 conn(0x55bc9fbd5770 0x55bc9fbd5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36090/0 (socket says 172.21.15.66:36090) 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.101+0000 7fc55bfff640 1 -- 172.21.15.66:0/3909947216 >> v1:172.21.15.31:6789/0 conn(0x55bc9fbd5770 legacy=0x55bc9fbd5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc55bfff640 1 -- 172.21.15.66:0/3909947216 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fa7bca0 con 0x55bc9fbd98c0 2024-09-12T00:19:04.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc55bfff640 1 --2- 172.21.15.66:0/3909947216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00a5c0 tx=0x7fc54c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c67d3fb3785be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc56245b640 1 -- 172.21.15.66:0/3909947216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c0a9590 con 0x55bc9fbd98c0 2024-09-12T00:19:04.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc56245b640 1 -- 172.21.15.66:0/3909947216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0ae070 con 0x55bc9fbd98c0 2024-09-12T00:19:04.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc56245b640 1 -- 172.21.15.66:0/3909947216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c0a9880 con 0x55bc9fbd98c0 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 -- 172.21.15.66:0/3909947216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd98c0 msgr2=0x55bc9fbdbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3909947216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00a5c0 tx=0x7fc54c01b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 -- 172.21.15.66:0/3909947216 shutdown_connections 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3909947216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd98c0 0x55bc9fbdbcb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 -- 172.21.15.66:0/3909947216 >> 172.21.15.66:0/3909947216 conn(0x55bc9fb49080 msgr2=0x55bc9fb49490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 -- 172.21.15.66:0/3909947216 shutdown_connections 2024-09-12T00:19:04.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.105+0000 7fc5651569c0 1 -- 172.21.15.66:0/3909947216 wait complete. 2024-09-12T00:19:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc5651569c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc5651569c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bc9fadb680 con 0x55bc9fbd5770 2024-09-12T00:19:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc562c5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc562c5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53544/0 (socket says 172.21.15.66:53544) 2024-09-12T00:19:04.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.121+0000 7fc562c5c640 1 -- 172.21.15.66:0/1860602594 learned_addr learned my addr 172.21.15.66:0/1860602594 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 -- 172.21.15.66:0/1860602594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fa56da0 con 0x55bc9fbd5770 2024-09-12T00:19:04.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 --2- 172.21.15.66:0/1860602594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc554001ec0 tx=0x7fc55400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea4663dfbd8af99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc450e09640 1 -- 172.21.15.66:0/1860602594 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55400e5d0 con 0x55bc9fbd5770 2024-09-12T00:19:04.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc450e09640 1 -- 172.21.15.66:0/1860602594 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55400e770 con 0x55bc9fbd5770 2024-09-12T00:19:04.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc450e09640 1 -- 172.21.15.66:0/1860602594 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55400ea70 con 0x55bc9fbd5770 2024-09-12T00:19:04.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/1860602594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 msgr2=0x55bc9fcc09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 --2- 172.21.15.66:0/1860602594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc554001ec0 tx=0x7fc55400b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/1860602594 shutdown_connections 2024-09-12T00:19:04.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 --2- 172.21.15.66:0/1860602594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc09b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/1860602594 >> 172.21.15.66:0/1860602594 conn(0x55bc9fb49080 msgr2=0x55bc9fcbc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/1860602594 shutdown_connections 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/1860602594 wait complete. 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bc9fa7da50 con 0x55bc9fbd5770 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53556/0 (socket says 172.21.15.66:53556) 2024-09-12T00:19:04.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 -- 172.21.15.66:0/535729805 learned_addr learned my addr 172.21.15.66:0/535729805 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fcc85b0 con 0x55bc9fbd5770 2024-09-12T00:19:04.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc562c5c640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55bc9fcc19a0 tx=0x7fc554000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc44f606640 1 -- 172.21.15.66:0/535729805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55400f8e0 con 0x55bc9fbd5770 2024-09-12T00:19:04.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9fcc8840 con 0x55bc9fbd5770 2024-09-12T00:19:04.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc44f606640 1 -- 172.21.15.66:0/535729805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55400fa80 con 0x55bc9fbd5770 2024-09-12T00:19:04.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc44f606640 1 -- 172.21.15.66:0/535729805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55400fda0 con 0x55bc9fbd5770 2024-09-12T00:19:04.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.125+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9fcc91f0 con 0x55bc9fbd5770 2024-09-12T00:19:04.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc44f606640 1 -- 172.21.15.66:0/535729805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc554017070 con 0x55bc9fbd5770 2024-09-12T00:19:04.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc44f606640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 0x7fc44803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc44f606640 1 -- 172.21.15.66:0/535729805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc554015020 con 0x55bc9fbd5770 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc55bfff640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 0x7fc44803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 0x55bc9fccf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fccf700 con 0x55bc9fbd98c0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc56345d640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 0x55bc9fccf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc55bfff640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 0x7fc44803bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0ad000 tx=0x7fc54c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc56345d640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 0x55bc9fccf1c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc56345d640 1 -- 172.21.15.66:0/535729805 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc55c00a4d0 con 0x55bc9fbd98c0 2024-09-12T00:19:04.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fcc9530 con 0x55bc9fbd98c0 2024-09-12T00:19:04.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc56345d640 1 -- 172.21.15.66:0/535729805 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc55c00a4d0 con 0x55bc9fbd98c0 2024-09-12T00:19:04.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 0x55bc9fcd3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fcd4450 con 0x55bc9fcd1970 2024-09-12T00:19:04.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc562c5c640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 0x55bc9fcd3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.129+0000 7fc562c5c640 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 0x55bc9fcd3d60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc562c5c640 1 -- 172.21.15.66:0/535729805 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc55402e070 con 0x55bc9fcd1970 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fcd0840 con 0x55bc9fbd98c0 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 -- 172.21.15.66:0/535729805 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc55c00a4d0 con 0x55bc9fbd98c0 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fcd0ca0 con 0x55bc9fcd1970 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc562c5c640 1 -- 172.21.15.66:0/535729805 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc55402e070 con 0x55bc9fcd1970 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bc9fae8450 con 0x55bc9fce2b40 2024-09-12T00:19:04.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53566/0 (socket says 172.21.15.66:53566) 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 -- 172.21.15.66:0/3017851651 learned_addr learned my addr 172.21.15.66:0/3017851651 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 -- 172.21.15.66:0/3017851651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fce35a0 con 0x55bc9fce2b40 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc56345d640 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55bc9fcc93e0 tx=0x7fc55c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc44ce01640 1 -- 172.21.15.66:0/3017851651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c013450 con 0x55bc9fce2b40 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc44ce01640 1 -- 172.21.15.66:0/3017851651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c013610 con 0x55bc9fce2b40 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9fce3e00 con 0x55bc9fce2b40 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc44ce01640 1 -- 172.21.15.66:0/3017851651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c013970 con 0x55bc9fce2b40 2024-09-12T00:19:04.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.133+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9fce4370 con 0x55bc9fce2b40 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc44ce01640 1 -- 172.21.15.66:0/3017851651 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc55c011040 con 0x55bc9fce2b40 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc44ce01640 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 0x7fc43c03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc44ce01640 1 -- 172.21.15.66:0/3017851651 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc55c00e040 con 0x55bc9fce2b40 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 0x7fc43c03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 0x7fc43c03bfd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55bc9fccfb40 tx=0x7fc55401c640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc5651569c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc5651569c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bc9fcc1200 con 0x55bc9fcf04f0 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53580/0 (socket says 172.21.15.66:53580) 2024-09-12T00:19:04.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc56345d640 1 -- 172.21.15.66:0/2215162221 learned_addr learned my addr 172.21.15.66:0/2215162221 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc56345d640 1 -- 172.21.15.66:0/2215162221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fcf0ec0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc56345d640 1 --2- 172.21.15.66:0/2215162221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0508f0 tx=0x7fc55c029870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2134d1a3208ba77a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc4467fc640 1 -- 172.21.15.66:0/2215162221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c013e20 con 0x55bc9fcf04f0 2024-09-12T00:19:04.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc4467fc640 1 -- 172.21.15.66:0/2215162221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c02a960 con 0x55bc9fcf04f0 2024-09-12T00:19:04.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.137+0000 7fc4467fc640 1 -- 172.21.15.66:0/2215162221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c02a440 con 0x55bc9fcf04f0 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/2215162221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 msgr2=0x55bc9fcf08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 --2- 172.21.15.66:0/2215162221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0508f0 tx=0x7fc55c029870 comp rx=0 tx=0).stop 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/2215162221 shutdown_connections 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 --2- 172.21.15.66:0/2215162221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf08d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/2215162221 >> 172.21.15.66:0/2215162221 conn(0x55bc9fceb8b0 msgr2=0x55bc9fce9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/2215162221 shutdown_connections 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/2215162221 wait complete. 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 Processor -- start 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- start start 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bc9fcef3e0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc56345d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53596/0 (socket says 172.21.15.66:53596) 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 learned_addr learned my addr 172.21.15.66:0/3057443645 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9fcf6eb0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc56345d640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf6950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0298b0 tx=0x7fc55c050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc444ff9640 1 -- 172.21.15.66:0/3057443645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c0522e0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc9fcf7140 con 0x55bc9fcf04f0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc444ff9640 1 -- 172.21.15.66:0/3057443645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c01fae0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc444ff9640 1 -- 172.21.15.66:0/3057443645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c01fdc0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9fcf7af0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.141+0000 7fc444ff9640 1 -- 172.21.15.66:0/3057443645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc55c029ba0 con 0x55bc9fcf04f0 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc444ff9640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc42c039a70 0x7fc42c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc444ff9640 1 -- 172.21.15.66:0/3057443645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fc55c048040 con 0x55bc9fcf04f0 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc42c039a70 0x7fc42c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fd02070 0x55bc9fd04530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd04c80 con 0x55bc9fd02070 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fd02070 0x55bc9fd04530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc42c039a70 0x7fc42c03bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5540176b0 tx=0x7fc554033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fd02070 0x55bc9fd04530 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 realm 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd050b0 con 0x55bc9fd02070 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:04.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd05980 con 0x55bc9fd02070 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd05d20 con 0x55bc9fd02070 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fd06a80 0x55bc9fd08e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd09480 con 0x55bc9fd06a80 2024-09-12T00:19:04.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fd06a80 0x55bc9fd08e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fd06a80 0x55bc9fd08e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:04.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 20 searching for the correct realm 2024-09-12T00:19:04.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc55c013070 0x7fc55c0117b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc55c013070 0x7fc55c0117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.145+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc55c013070 0x7fc55c0117b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc562c5c640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc554042100 0x7fc55401d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc554042100 0x7fc55401d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc554042100 0x7fc55401d7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.149+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.153+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.157+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd06a80 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc554042100 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x55bc9fd02070 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0ad50 con 0x7fc55c013070 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:04.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd09ed0 con 0x55bc9fd02070 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0a720 con 0x55bc9fd02070 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0b0f0 con 0x55bc9fd06a80 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 zone default found 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 4 Realm: () 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 zonegroup default 2024-09-12T00:19:04.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0b520 con 0x7fc554042100 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.161+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0d350 con 0x55bc9fd06a80 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0d7a0 con 0x55bc9fd06a80 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 20 started sync module instance, tier type = 2024-09-12T00:19:04.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:04.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0c7f0 con 0x7fc55c013070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94268623471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0dc00 con 0x7fc55c013070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0e450 con 0x55bc9fd02070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94268623471424] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94268623473680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0e530 con 0x55bc9fd02070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.165+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0f050 con 0x55bc9fd06a80 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94268623473680] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94268623481632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0f010 con 0x55bc9fd06a80 2024-09-12T00:19:04.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd0fa60 con 0x7fc55c013070 2024-09-12T00:19:04.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94268623484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd102b0 con 0x7fc55c013070 2024-09-12T00:19:04.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.169+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd10cb0 con 0x55bc9fd02070 2024-09-12T00:19:04.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94268623481632] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94268623484336] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94268623486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd107c0 con 0x55bc9fd02070 2024-09-12T00:19:04.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11550 con 0x7fc554042100 2024-09-12T00:19:04.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94268623486464] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94268623478688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11500 con 0x7fc554042100 2024-09-12T00:19:04.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.173+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11f60 con 0x7fc554042100 2024-09-12T00:19:04.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.177+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94268623478688] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.177+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.177+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94268623491424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11f60 con 0x7fc554042100 2024-09-12T00:19:04.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.177+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd12920 con 0x7fc554042100 2024-09-12T00:19:04.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94268623496304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd12d40 con 0x7fc554042100 2024-09-12T00:19:04.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=0 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=1 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=2 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=3 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=4 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=5 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94268623491424] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=6 2024-09-12T00:19:04.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94268623496304] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x7fc554042100 2024-09-12T00:19:04.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 20 add_watcher() i=7 2024-09-12T00:19:04.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:04.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11b00 con 0x55bc9fd02070 2024-09-12T00:19:04.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.181+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94268623497360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd11b00 con 0x55bc9fd02070 2024-09-12T00:19:04.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94268623497360] v31'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc4197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc5651569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:04.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc5651569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:04.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1e510 con 0x55bc9fd02070 2024-09-12T00:19:04.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54c0a99f0 con 0x55bc9fd02070 2024-09-12T00:19:04.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.185+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1ebe0 con 0x7fc554042100 2024-09-12T00:19:04.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1f040 con 0x55bc9fd06a80 2024-09-12T00:19:04.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1eef0 con 0x55bc9fd02070 2024-09-12T00:19:04.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.189+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1f4c0 con 0x7fc55c013070 2024-09-12T00:19:04.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.193+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.193+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1f910 con 0x55bc9fd06a80 2024-09-12T00:19:04.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.193+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.193+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1f910 con 0x55bc9fd02070 2024-09-12T00:19:04.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.197+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.197+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c5e0 con 0x7fc554042100 2024-09-12T00:19:04.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.197+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.197+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c5e0 con 0x7fc55c013070 2024-09-12T00:19:04.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c5e0 con 0x55bc9fd06a80 2024-09-12T00:19:04.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c5e0 con 0x7fc55c013070 2024-09-12T00:19:04.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.201+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c5e0 con 0x7fc554042100 2024-09-12T00:19:04.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.205+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.205+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x7fc55c013070 2024-09-12T00:19:04.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.205+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.205+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x7fc554042100 2024-09-12T00:19:04.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.209+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'39 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.209+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd02070 2024-09-12T00:19:04.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.209+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'49 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.209+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd06a80 2024-09-12T00:19:04.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x7fc55c013070 2024-09-12T00:19:04.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd06a80 2024-09-12T00:19:04.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.213+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd02070 2024-09-12T00:19:04.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.217+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.217+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd02070 2024-09-12T00:19:04.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.217+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'50 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.217+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7b0 con 0x55bc9fd06a80 2024-09-12T00:19:04.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1c7e0 con 0x7fc55c013070 2024-09-12T00:19:04.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.221+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.225+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.225+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.225+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.225+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.229+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'32 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.229+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x7fc554042100 2024-09-12T00:19:04.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.229+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.229+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.233+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'25 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.233+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x7fc554042100 2024-09-12T00:19:04.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.233+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.233+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x55bc9fd06a80 2024-09-12T00:19:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.237+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.237+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x7fc554042100 2024-09-12T00:19:04.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'40 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd20700 con 0x7fc55c013070 2024-09-12T00:19:04.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc393fff640 20 reqs_thread_entry: start 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 20 Filter name: none 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc391ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6f0 con 0x55bc9fd02070 2024-09-12T00:19:04.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T00:19:04.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.241+0000 7fc5651569c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:04.248 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T00:19:04.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.245+0000 7fc4197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.245+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94268623497360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6f0 con 0x55bc9fd02070 2024-09-12T00:19:04.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.245+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94268623497360] v31'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.245+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94268623471424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6f0 con 0x7fc55c013070 2024-09-12T00:19:04.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94268623471424] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc5651569c0 20 remove_watcher() i=0 2024-09-12T00:19:04.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc5651569c0 2 removed watcher, disabling cache 2024-09-12T00:19:04.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94268623473680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x55bc9fd02070 2024-09-12T00:19:04.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94268623473680] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc5651569c0 20 remove_watcher() i=1 2024-09-12T00:19:04.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.249+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94268623481632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x55bc9fd06a80 2024-09-12T00:19:04.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc56345d640 1 -- 172.21.15.66:0/3057443645 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94268623481632] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55c039020 con 0x55bc9fd06a80 2024-09-12T00:19:04.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc5651569c0 20 remove_watcher() i=2 2024-09-12T00:19:04.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94268623484336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x7fc55c013070 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc562c5c640 1 -- 172.21.15.66:0/3057443645 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94268623484336] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc55402e070 con 0x7fc55c013070 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc5651569c0 20 remove_watcher() i=3 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.253+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94268623486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x55bc9fd02070 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94268623486464] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x55bc9fd02070 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc5651569c0 20 remove_watcher() i=4 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94268623478688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x7fc554042100 2024-09-12T00:19:04.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94268623478688] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc5651569c0 20 remove_watcher() i=5 2024-09-12T00:19:04.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.257+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94268623491424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x7fc554042100 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.261+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94268623491424] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.261+0000 7fc5651569c0 20 remove_watcher() i=6 2024-09-12T00:19:04.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.261+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94268623496304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bc9fd1b6b0 con 0x7fc554042100 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94268623496304] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc54c0d5040 con 0x7fc554042100 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 20 remove_watcher() i=7 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc554042100 msgr2=0x7fc55401d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc554042100 0x7fc55401d7b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fd02070 msgr2=0x55bc9fd04530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fd02070 0x55bc9fd04530 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc55c013070 msgr2=0x7fc55c0117b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc55c013070 0x7fc55c0117b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fd06a80 msgr2=0x55bc9fd08e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fd06a80 0x55bc9fd08e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc42c039a70 msgr2=0x7fc42c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc42c039a70 0x7fc42c03bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5540176b0 tx=0x7fc554033000 comp rx=0 tx=0).stop 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 msgr2=0x55bc9fcf6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3057443645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fcf04f0 0x55bc9fcf6950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0298b0 tx=0x7fc55c050880 comp rx=0 tx=0).stop 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 reap_dead start 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc55bfff640 1 -- 172.21.15.66:0/3057443645 reap_dead start 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 shutdown_connections 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 >> 172.21.15.66:0/3057443645 conn(0x55bc9fceb8b0 msgr2=0x55bc9fce9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 shutdown_connections 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3057443645 wait complete. 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 msgr2=0x7fc43c03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 0x7fc43c03bfd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55bc9fccfb40 tx=0x7fc55401c640 comp rx=0 tx=0).stop 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 msgr2=0x55bc9fce2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55bc9fcc93e0 tx=0x7fc55c0163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 shutdown_connections 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc43c039b10 0x7fc43c03bfd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/3017851651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fce2b40 0x55bc9fce2f60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 >> 172.21.15.66:0/3017851651 conn(0x55bc9fcd84f0 msgr2=0x55bc9fcd88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 shutdown_connections 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/3017851651 wait complete. 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 msgr2=0x55bc9fccf1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 0x55bc9fccf1c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 msgr2=0x55bc9fcd3d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 0x55bc9fcd3d60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 msgr2=0x7fc44803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 0x7fc44803bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0ad000 tx=0x7fc54c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 msgr2=0x55bc9fcc8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55bc9fcc19a0 tx=0x7fc554000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 shutdown_connections 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bc9fcd1970 0x55bc9fcd3d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bc9fbd98c0 0x55bc9fccf1c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc448039a70 0x7fc44803bf30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 --2- 172.21.15.66:0/535729805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc9fbd5770 0x55bc9fcc8050 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 >> 172.21.15.66:0/535729805 conn(0x55bc9fb49080 msgr2=0x55bc9fcbb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 shutdown_connections 2024-09-12T00:19:04.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.265+0000 7fc5651569c0 1 -- 172.21.15.66:0/535729805 wait complete. 2024-09-12T00:19:04.284 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T00:19:04.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T00:19:04.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T00:19:04.285 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T00:19:04.370 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:04.370 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f14507f19c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5570736b68b0 0x5570736b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f14507f19c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570735649c0 con 0x5570736b27b0 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f14507f19c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5570735b46d0 con 0x5570736b68b0 2024-09-12T00:19:04.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.365+0000 7f144daf6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5570736b68b0 0x5570736b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144daf6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5570736b68b0 0x5570736b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53600/0 (socket says 172.21.15.66:53600) 2024-09-12T00:19:04.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144e2f7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5570736b27b0 0x5570736b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36104/0 (socket says 172.21.15.66:36104) 2024-09-12T00:19:04.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144daf6640 1 -- 172.21.15.66:0/966823552 learned_addr learned my addr 172.21.15.66:0/966823552 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144daf6640 1 -- 172.21.15.66:0/966823552 >> v1:172.21.15.31:6789/0 conn(0x5570736b27b0 legacy=0x5570736b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144daf6640 1 -- 172.21.15.66:0/966823552 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557073558ca0 con 0x5570736b68b0 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144daf6640 1 --2- 172.21.15.66:0/966823552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b68b0 0x5570736b8ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f144400a5c0 tx=0x7f144401b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e619431f70c3655 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144d2f5640 1 -- 172.21.15.66:0/966823552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14440b0070 con 0x5570736b68b0 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144d2f5640 1 -- 172.21.15.66:0/966823552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14440ab570 con 0x5570736b68b0 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.369+0000 7f144d2f5640 1 -- 172.21.15.66:0/966823552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14440ab870 con 0x5570736b68b0 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 -- 172.21.15.66:0/966823552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b68b0 msgr2=0x5570736b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 --2- 172.21.15.66:0/966823552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b68b0 0x5570736b8ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f144400a5c0 tx=0x7f144401b260 comp rx=0 tx=0).stop 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 -- 172.21.15.66:0/966823552 shutdown_connections 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 --2- 172.21.15.66:0/966823552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b68b0 0x5570736b8ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 -- 172.21.15.66:0/966823552 >> 172.21.15.66:0/966823552 conn(0x557073626060 msgr2=0x557073626470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 -- 172.21.15.66:0/966823552 shutdown_connections 2024-09-12T00:19:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.373+0000 7f14507f19c0 1 -- 172.21.15.66:0/966823552 wait complete. 2024-09-12T00:19:04.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f14507f19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f14507f19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5570735b8680 con 0x5570736b27b0 2024-09-12T00:19:04.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53614/0 (socket says 172.21.15.66:53614) 2024-09-12T00:19:04.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f144e2f7640 1 -- 172.21.15.66:0/484191443 learned_addr learned my addr 172.21.15.66:0/484191443 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f144e2f7640 1 -- 172.21.15.66:0/484191443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557073533da0 con 0x5570736b27b0 2024-09-12T00:19:04.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f144e2f7640 1 --2- 172.21.15.66:0/484191443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f144000b520 tx=0x7f144000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b5f999ef54afef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f133c608640 1 -- 172.21.15.66:0/484191443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144000d700 con 0x5570736b27b0 2024-09-12T00:19:04.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f133c608640 1 -- 172.21.15.66:0/484191443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1440008070 con 0x5570736b27b0 2024-09-12T00:19:04.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.389+0000 7f133c608640 1 -- 172.21.15.66:0/484191443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144000da10 con 0x5570736b27b0 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/484191443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 msgr2=0x55707379db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 --2- 172.21.15.66:0/484191443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f144000b520 tx=0x7f144000b9e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/484191443 shutdown_connections 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 --2- 172.21.15.66:0/484191443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x55707379db80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/484191443 >> 172.21.15.66:0/484191443 conn(0x557073626060 msgr2=0x557073799820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/484191443 shutdown_connections 2024-09-12T00:19:04.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/484191443 wait complete. 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55707355aa50 con 0x5570736b27b0 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53626/0 (socket says 172.21.15.66:53626) 2024-09-12T00:19:04.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f144e2f7640 1 -- 172.21.15.66:0/1580633542 learned_addr learned my addr 172.21.15.66:0/1580633542 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f144e2f7640 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570737a57b0 con 0x5570736b27b0 2024-09-12T00:19:04.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1440000f70 tx=0x7f1440000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f133ae05640 1 -- 172.21.15.66:0/1580633542 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144000fa20 con 0x5570736b27b0 2024-09-12T00:19:04.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f133ae05640 1 -- 172.21.15.66:0/1580633542 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144000fbc0 con 0x5570736b27b0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570737a5a40 con 0x5570736b27b0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f133ae05640 1 -- 172.21.15.66:0/1580633542 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440019430 con 0x5570736b27b0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570737a6470 con 0x5570736b27b0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.393+0000 7f14507f19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5570735c5450 con 0x5570737b1f30 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53640/0 (socket says 172.21.15.66:53640) 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f133ae05640 1 -- 172.21.15.66:0/1580633542 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f14400196a0 con 0x5570736b27b0 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 -- 172.21.15.66:0/422435964 learned_addr learned my addr 172.21.15.66:0/422435964 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f133ae05640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 0x7f133403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f133ae05640 1 -- 172.21.15.66:0/1580633542 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1440050750 con 0x5570736b27b0 2024-09-12T00:19:04.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 -- 172.21.15.66:0/422435964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570737b2920 con 0x5570737b1f30 2024-09-12T00:19:04.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 0x7f133403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- 172.21.15.66:0/422435964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f144800a430 tx=0x7f144800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2422614389b65060 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 0x7f133403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f144000dfd0 tx=0x7f14400195d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f1338e01640 1 -- 172.21.15.66:0/422435964 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144800f6e0 con 0x5570737b1f30 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f1338e01640 1 -- 172.21.15.66:0/422435964 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448015070 con 0x5570737b1f30 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f1338e01640 1 -- 172.21.15.66:0/422435964 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f144800fa10 con 0x5570737b1f30 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- 172.21.15.66:0/422435964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 msgr2=0x5570737b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 --2- 172.21.15.66:0/422435964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f144800a430 tx=0x7f144800a8f0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- 172.21.15.66:0/422435964 shutdown_connections 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 --2- 172.21.15.66:0/422435964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b2330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- 172.21.15.66:0/422435964 >> 172.21.15.66:0/422435964 conn(0x5570736b68b0 msgr2=0x5570737ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- 172.21.15.66:0/422435964 shutdown_connections 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- 172.21.15.66:0/422435964 wait complete. 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f14507f19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5570737b3110 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53654/0 (socket says 172.21.15.66:53654) 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 -- 172.21.15.66:0/373187168 learned_addr learned my addr 172.21.15.66:0/373187168 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 -- 172.21.15.66:0/373187168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570737b9810 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.397+0000 7f144eaf8640 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f144800adf0 tx=0x7f1448003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 -- 172.21.15.66:0/373187168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448010a10 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 -- 172.21.15.66:0/373187168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448020070 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 -- 172.21.15.66:0/373187168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1448010d40 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570737b9aa0 con 0x5570737b1f30 2024-09-12T00:19:04.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570737ba450 con 0x5570737b1f30 2024-09-12T00:19:04.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 -- 172.21.15.66:0/373187168 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f144801b420 con 0x5570737b1f30 2024-09-12T00:19:04.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 0x7f132803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f1332ffd640 1 -- 172.21.15.66:0/373187168 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1448050c60 con 0x5570737b1f30 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144daf6640 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 0x7f132803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 Processor -- start 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 -- start start 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f14507f19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55707379e3b0 con 0x5570737d2b10 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144daf6640 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 0x7f132803bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440ad000 tx=0x7f14440a5070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144e2f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53668/0 (socket says 172.21.15.66:53668) 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144e2f7640 1 -- 172.21.15.66:0/1106478268 learned_addr learned my addr 172.21.15.66:0/1106478268 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144e2f7640 1 -- 172.21.15.66:0/1106478268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570737d3550 con 0x5570737d2b10 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.401+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f144001bc00 tx=0x7f144001b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 -- 172.21.15.66:0/1106478268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14400185b0 con 0x5570737d2b10 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570737d3d60 con 0x5570737d2b10 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 -- 172.21.15.66:0/1106478268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1440018390 con 0x5570737d2b10 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 -- 172.21.15.66:0/1106478268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440016650 con 0x5570737d2b10 2024-09-12T00:19:04.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570737d42d0 con 0x5570737d2b10 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 -- 172.21.15.66:0/1106478268 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1440016280 con 0x5570737d2b10 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 0x7f128403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13137e6640 1 -- 172.21.15.66:0/1106478268 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f1440043030 con 0x5570737d2b10 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144daf6640 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 0x7f128403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f13117e2640 20 reqs_thread_entry: start 2024-09-12T00:19:04.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 0x5570737da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570737db0b0 con 0x5570737d8520 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144eaf8640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 0x5570737da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144daf6640 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 0x7f128403bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1444017e70 tx=0x7f1444005ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144eaf8640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 0x5570737da9e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144eaf8640 1 -- 172.21.15.66:0/1580633542 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f144800e070 con 0x5570737d8520 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 0x5570737df270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:2 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570737df970 con 0x5570737dce80 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 0x5570737df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144e2f7640 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 0x5570737df270 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.405+0000 7f144e2f7640 1 -- 172.21.15.66:0/1580633542 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(2 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f144002d070 con 0x5570737dce80 2024-09-12T00:19:04.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570737e4b30 con 0x5570737dce80 2024-09-12T00:19:04.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f144e2f7640 1 -- 172.21.15.66:0/1580633542 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [stat,call,call,writefull 0~993] v31'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f144002d070 con 0x5570737dce80 2024-09-12T00:19:04.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 msgr2=0x7f132803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 0x7f132803bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440ad000 tx=0x7f14440a5070 comp rx=0 tx=0).stop 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 msgr2=0x5570737b92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f144800adf0 tx=0x7f1448003380 comp rx=0 tx=0).stop 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 shutdown_connections 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1328039a70 0x7f132803bf30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 --2- 172.21.15.66:0/373187168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737b1f30 0x5570737b92b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.409+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 >> 172.21.15.66:0/373187168 conn(0x5570736b68b0 msgr2=0x5570737ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 shutdown_connections 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/373187168 wait complete. 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 msgr2=0x7f128403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 0x7f128403bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1444017e70 tx=0x7f1444005ad0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 msgr2=0x5570737d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f144001bc00 tx=0x7f144001b9d0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 shutdown_connections 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1284039a70 0x7f128403bf30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1106478268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570737d2b10 0x5570737d2f10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 >> 172.21.15.66:0/1106478268 conn(0x5570737c80d0 msgr2=0x5570737c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 shutdown_connections 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1106478268 wait complete. 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 msgr2=0x5570737da9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 0x5570737da9e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 msgr2=0x5570737df270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 0x5570737df270 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 msgr2=0x7f133403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 0x7f133403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f144000dfd0 tx=0x7f14400195d0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 msgr2=0x5570737a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1440000f70 tx=0x7f1440000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 shutdown_connections 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570737dce80 0x5570737df270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570737d8520 0x5570737da9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1334039a70 0x7f133403bf30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 --2- 172.21.15.66:0/1580633542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570736b27b0 0x5570737a5250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 >> 172.21.15.66:0/1580633542 conn(0x557073626060 msgr2=0x5570737982b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 shutdown_connections 2024-09-12T00:19:04.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.413+0000 7f14507f19c0 1 -- 172.21.15.66:0/1580633542 wait complete. 2024-09-12T00:19:04.427 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:19:04.428 DEBUG:tasks.util.rgw: json result: {'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:19:04.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T00:19:04.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T00:19:04.429 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T00:19:04.501 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:04.501 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:04.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c6091f9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56528c4c2750 0x56528c4c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c6091f9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56528c3749c0 con 0x56528c4c5890 2024-09-12T00:19:04.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c6091f9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56528c3c46d0 con 0x56528c4c2750 2024-09-12T00:19:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c5e425640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56528c4c2750 0x56528c4c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c5dc24640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56528c4c5890 0x56528c4c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36116/0 (socket says 172.21.15.66:36116) 2024-09-12T00:19:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c5dc24640 1 -- 172.21.15.66:0/683689444 learned_addr learned my addr 172.21.15.66:0/683689444 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c5e425640 1 -- 172.21.15.66:0/683689444 >> v1:172.21.15.31:6789/0 conn(0x56528c4c5890 legacy=0x56528c4c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.497+0000 7f8c5e425640 1 -- 172.21.15.66:0/683689444 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c368ca0 con 0x56528c4c2750 2024-09-12T00:19:04.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c5e425640 1 --2- 172.21.15.66:0/683689444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c4c2b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a480 tx=0x7f8c5001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbefdd3411c0b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c5d423640 1 -- 172.21.15.66:0/683689444 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b0070 con 0x56528c4c2750 2024-09-12T00:19:04.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c5d423640 1 -- 172.21.15.66:0/683689444 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500ab540 con 0x56528c4c2750 2024-09-12T00:19:04.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c5d423640 1 -- 172.21.15.66:0/683689444 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab840 con 0x56528c4c2750 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/683689444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 msgr2=0x56528c4c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/683689444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c4c2b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a480 tx=0x7f8c5001b280 comp rx=0 tx=0).stop 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/683689444 shutdown_connections 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/683689444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c4c2b30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/683689444 >> 172.21.15.66:0/683689444 conn(0x56528c436060 msgr2=0x56528c436470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/683689444 shutdown_connections 2024-09-12T00:19:04.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.501+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/683689444 wait complete. 2024-09-12T00:19:04.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.517+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.517+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.517+0000 7f8c6091f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.517+0000 7f8c6091f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56528c3c8680 con 0x56528c4c2750 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.517+0000 7f8c5e425640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53686/0 (socket says 172.21.15.66:53686) 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 -- 172.21.15.66:0/3848492430 learned_addr learned my addr 172.21.15.66:0/3848492430 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 -- 172.21.15.66:0/3848492430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c343da0 con 0x56528c4c2750 2024-09-12T00:19:04.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3848492430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c50018eb0 tx=0x7f8c50003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14480b02baafc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8b4c608640 1 -- 172.21.15.66:0/3848492430 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b0070 con 0x56528c4c2750 2024-09-12T00:19:04.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8b4c608640 1 -- 172.21.15.66:0/3848492430 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500b1040 con 0x56528c4c2750 2024-09-12T00:19:04.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8b4c608640 1 -- 172.21.15.66:0/3848492430 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab6f0 con 0x56528c4c2750 2024-09-12T00:19:04.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3848492430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 msgr2=0x56528c5ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3848492430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c50018eb0 tx=0x7f8c50003030 comp rx=0 tx=0).stop 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3848492430 shutdown_connections 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3848492430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5ada00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3848492430 >> 172.21.15.66:0/3848492430 conn(0x56528c436060 msgr2=0x56528c5a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3848492430 shutdown_connections 2024-09-12T00:19:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3848492430 wait complete. 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c6091f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56528c36aa50 con 0x56528c4c2750 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53688/0 (socket says 172.21.15.66:53688) 2024-09-12T00:19:04.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 -- 172.21.15.66:0/3248874475 learned_addr learned my addr 172.21.15.66:0/3248874475 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c5b5450 con 0x56528c4c2750 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.521+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ab510 tx=0x7f8c50018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 -- 172.21.15.66:0/3248874475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500c4070 con 0x56528c4c2750 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 -- 172.21.15.66:0/3248874475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500b75b0 con 0x56528c4c2750 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56528c5b56e0 con 0x56528c4c2750 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 -- 172.21.15.66:0/3248874475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b7890 con 0x56528c4c2750 2024-09-12T00:19:04.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528c5b6090 con 0x56528c4c2750 2024-09-12T00:19:04.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 -- 172.21.15.66:0/3248874475 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c500c7070 con 0x56528c4c2750 2024-09-12T00:19:04.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 0x7f8b4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8b4ae05640 1 -- 172.21.15.66:0/3248874475 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8c500bc070 con 0x56528c4c2750 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 0x7f8b4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 0x56528c5bc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5bc5a0 con 0x56528c4c5890 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 0x56528c5bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 0x7f8b4403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c54001d80 tx=0x7f8c540012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 0x56528c5bc060 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3248874475 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5800a4d0 con 0x56528c4c5890 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5b64c0 con 0x56528c4c5890 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3248874475 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c5800a4d0 con 0x56528c4c5890 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 0x56528c5c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5c1320 con 0x56528c5be840 2024-09-12T00:19:04.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 0x56528c5c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.525+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 0x56528c5c0c30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5e425640 1 -- 172.21.15.66:0/3248874475 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c500d0070 con 0x56528c5be840 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5bd6b0 con 0x56528c4c5890 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3248874475 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c5800a4d0 con 0x56528c4c5890 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5bdb60 con 0x56528c5be840 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5e425640 1 -- 172.21.15.66:0/3248874475 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c500d0070 con 0x56528c5be840 2024-09-12T00:19:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56528c3d5450 con 0x56528c5cfa30 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53696/0 (socket says 172.21.15.66:53696) 2024-09-12T00:19:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 -- 172.21.15.66:0/401103695 learned_addr learned my addr 172.21.15.66:0/401103695 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 -- 172.21.15.66:0/401103695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c5d0490 con 0x56528c5cfa30 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56528c5b5c70 tx=0x7f8c580167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8b43fff640 1 -- 172.21.15.66:0/401103695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58013640 con 0x56528c5cfa30 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8b43fff640 1 -- 172.21.15.66:0/401103695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c580137e0 con 0x56528c5cfa30 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56528c5d0cf0 con 0x56528c5cfa30 2024-09-12T00:19:04.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8b43fff640 1 -- 172.21.15.66:0/401103695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58013ac0 con 0x56528c5cfa30 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.529+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528c5d1260 con 0x56528c5cfa30 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b43fff640 1 -- 172.21.15.66:0/401103695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c58011040 con 0x56528c5cfa30 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b43fff640 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 0x7f8b3803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b43fff640 1 -- 172.21.15.66:0/401103695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8c5800e040 con 0x56528c5cfa30 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5e425640 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 0x7f8b3803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5e425640 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 0x7f8b3803bf80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b65a0 tx=0x7f8c500aaf50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56528c5ae170 con 0x56528c5dd360 2024-09-12T00:19:04.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53712/0 (socket says 172.21.15.66:53712) 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5ec26640 1 -- 172.21.15.66:0/4018423264 learned_addr learned my addr 172.21.15.66:0/4018423264 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5ec26640 1 -- 172.21.15.66:0/4018423264 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c5ddd50 con 0x56528c5dd360 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/4018423264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8c580508e0 tx=0x7f8c58020e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9550aa6172fbeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b41ffb640 1 -- 172.21.15.66:0/4018423264 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58012dc0 con 0x56528c5dd360 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b41ffb640 1 -- 172.21.15.66:0/4018423264 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5801f340 con 0x56528c5dd360 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8b41ffb640 1 -- 172.21.15.66:0/4018423264 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c580204d0 con 0x56528c5dd360 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/4018423264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 msgr2=0x56528c5dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/4018423264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8c580508e0 tx=0x7f8c58020e10 comp rx=0 tx=0).stop 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/4018423264 shutdown_connections 2024-09-12T00:19:04.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/4018423264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5dd760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/4018423264 >> 172.21.15.66:0/4018423264 conn(0x56528c5d8780 msgr2=0x56528c5d69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/4018423264 shutdown_connections 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/4018423264 wait complete. 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 Processor -- start 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.533+0000 7f8c6091f9c0 1 -- start start 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56528c5dc2b0 con 0x56528c5dd360 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5ec26640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53724/0 (socket says 172.21.15.66:53724) 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 learned_addr learned my addr 172.21.15.66:0/3959790410 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528c5e3d70 con 0x56528c5dd360 2024-09-12T00:19:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c580508e0 tx=0x7f8c58050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 -- 172.21.15.66:0/3959790410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c58037070 con 0x56528c5dd360 2024-09-12T00:19:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56528c5e4000 con 0x56528c5dd360 2024-09-12T00:19:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 -- 172.21.15.66:0/3959790410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5804f4c0 con 0x56528c5dd360 2024-09-12T00:19:04.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 -- 172.21.15.66:0/3959790410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c5803ebb0 con 0x56528c5dd360 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528c5e4000 con 0x56528c5dd360 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 -- 172.21.15.66:0/3959790410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c5803a070 con 0x56528c5dd360 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b28039a70 0x7f8b2803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8b2ffff640 1 -- 172.21.15.66:0/3959790410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8c5803fe00 con 0x56528c5dd360 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b28039a70 0x7f8b2803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c5eeb90 0x56528c5f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f1770 con 0x56528c5eeb90 2024-09-12T00:19:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c5eeb90 0x56528c5f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b28039a70 0x7f8b2803bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c5001b2c0 tx=0x7f8c500dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.537+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c5eeb90 0x56528c5f1020 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 realm 2024-09-12T00:19:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5edf40 con 0x56528c5eeb90 2024-09-12T00:19:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f2270 con 0x56528c5eeb90 2024-09-12T00:19:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f2b40 con 0x56528c5eeb90 2024-09-12T00:19:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5f3440 0x56528c5f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f5f70 con 0x56528c5f3440 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5f3440 0x56528c5f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5f3440 0x56528c5f5830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 20 searching for the correct realm 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8c5803c060 0x7f8c580509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8c5803c060 0x7f8c580509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8c5803c060 0x7f8c580509f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5e425640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8c500c9070 0x7f8c500aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.541+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8c500c9070 0x7f8c500aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8c500c9070 0x7f8c500aa5d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.545+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.549+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5f3440 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.553+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x56528c5eeb90 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f77d0 con 0x7f8c5803c060 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f68f0 con 0x56528c5eeb90 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f7190 con 0x56528c5eeb90 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c5400e5a0 con 0x56528c5eeb90 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f6530 con 0x56528c5f3440 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 zone default found 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 4 Realm: () 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:04.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 zonegroup default 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f6dc0 con 0x7f8c500c9070 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c5400e5a0 con 0x7f8c500c9070 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f9bf0 con 0x56528c5f3440 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fa080 con 0x56528c5f3440 2024-09-12T00:19:04.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 started sync module instance, tier type = 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.557+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5f9060 con 0x7f8c5803c060 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94912542378928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fa4e0 con 0x7f8c5803c060 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fad30 con 0x56528c5eeb90 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94912542378928] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94912542386304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fb150 con 0x56528c5eeb90 2024-09-12T00:19:04.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.561+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fb9a0 con 0x56528c5f3440 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94912542388832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fbd90 con 0x56528c5f3440 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fc8b0 con 0x7f8c5803c060 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94912542386304] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94912542393216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fcca0 con 0x7f8c5803c060 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fd660 con 0x56528c5eeb90 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94912542388832] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94912542393216] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.565+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94912542390144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fadb0 con 0x56528c5eeb90 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.569+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fd660 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.569+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94912542390144] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.569+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.569+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94912542399552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fd660 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.569+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fe7e0 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94912542401328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fec00 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5ff6a0 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94912542399552] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94912542401328] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94912542405008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fe750 con 0x7f8c500c9070 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=0 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=1 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=2 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=3 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=4 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=5 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.573+0000 7f8c6091f9c0 20 add_watcher() i=6 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94912542405008] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 20 add_watcher() i=7 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fe750 con 0x56528c5eeb90 2024-09-12T00:19:04.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94912542396848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c5fe750 con 0x56528c5eeb90 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94912542396848] v31'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8b14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 5 note: GC not initialized 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8a8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 20 Filter name: none 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8a8d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626250 con 0x56528c5eeb90 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626250 con 0x7f8c5803c060 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626250 con 0x56528c5eeb90 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.577+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c5803c060 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.581+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c5803c060 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.585+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.589+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8b14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94912542396848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94912542396848] v31'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94912542378928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c5803c060 2024-09-12T00:19:04.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94912542378928] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c6091f9c0 20 remove_watcher() i=0 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c6091f9c0 2 removed watcher, disabling cache 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.593+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94912542386304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94912542386304] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c6091f9c0 20 remove_watcher() i=1 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94912542388832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5f3440 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c5ec26640 1 -- 172.21.15.66:0/3959790410 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94912542388832] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c58039030 con 0x56528c5f3440 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c6091f9c0 20 remove_watcher() i=2 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.597+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94912542393216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c5803c060 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c5e425640 1 -- 172.21.15.66:0/3959790410 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94912542393216] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d0070 con 0x7f8c5803c060 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c6091f9c0 20 remove_watcher() i=3 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94912542390144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x56528c5eeb90 2024-09-12T00:19:04.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94912542390144] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x56528c5eeb90 2024-09-12T00:19:04.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c6091f9c0 20 remove_watcher() i=4 2024-09-12T00:19:04.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.601+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94912542399552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94912542399552] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c6091f9c0 20 remove_watcher() i=5 2024-09-12T00:19:04.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94912542401328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94912542401328] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c6091f9c0 20 remove_watcher() i=6 2024-09-12T00:19:04.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.605+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94912542405008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56528c626210 con 0x7f8c500c9070 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94912542405008] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c54038040 con 0x7f8c500c9070 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 20 remove_watcher() i=7 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8c500c9070 msgr2=0x7f8c500aa5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8c500c9070 0x7f8c500aa5d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c5eeb90 msgr2=0x56528c5f1020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c5eeb90 0x56528c5f1020 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8c5803c060 msgr2=0x7f8c580509f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8c5803c060 0x7f8c580509f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5f3440 msgr2=0x56528c5f5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5f3440 0x56528c5f5830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b28039a70 msgr2=0x7f8b2803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b28039a70 0x7f8b2803bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c5001b2c0 tx=0x7f8c500dc000 comp rx=0 tx=0).stop 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 msgr2=0x56528c5e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c5dc24640 1 -- 172.21.15.66:0/3959790410 reap_dead start 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c580508e0 tx=0x7f8c58050840 comp rx=0 tx=0).stop 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 shutdown_connections 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3959790410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5dd360 0x56528c5e3810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 >> 172.21.15.66:0/3959790410 conn(0x56528c5d8780 msgr2=0x56528c5d6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 shutdown_connections 2024-09-12T00:19:04.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3959790410 wait complete. 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 msgr2=0x7f8b3803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 0x7f8b3803bf80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b65a0 tx=0x7f8c500aaf50 comp rx=0 tx=0).stop 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 msgr2=0x56528c5cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56528c5b5c70 tx=0x7f8c580167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 shutdown_connections 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b38039ac0 0x7f8b3803bf80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/401103695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c5cfa30 0x56528c5cfe50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 >> 172.21.15.66:0/401103695 conn(0x56528c5c53e0 msgr2=0x56528c5c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 shutdown_connections 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/401103695 wait complete. 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 msgr2=0x56528c5bc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 0x56528c5bc060 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 msgr2=0x56528c5c0c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 0x56528c5c0c30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 msgr2=0x7f8b4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 0x7f8b4403bf30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c54001d80 tx=0x7f8c540012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 msgr2=0x56528c5b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ab510 tx=0x7f8c50018020 comp rx=0 tx=0).stop 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 shutdown_connections 2024-09-12T00:19:04.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56528c5be840 0x56528c5c0c30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56528c4c5890 0x56528c5bc060 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8b44039a70 0x7f8b4403bf30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 --2- 172.21.15.66:0/3248874475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56528c4c2750 0x56528c5b4ef0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 >> 172.21.15.66:0/3248874475 conn(0x56528c436060 msgr2=0x56528c5a8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 shutdown_connections 2024-09-12T00:19:04.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.609+0000 7f8c6091f9c0 1 -- 172.21.15.66:0/3248874475 wait complete. 2024-09-12T00:19:04.625 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[],"summary":[]} 2024-09-12T00:19:04.626 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T00:19:04.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:04.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:04.626 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:04.702 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:04.702 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:04.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f033849c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f6c7c8a510 0x55f6c7c8a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f033849c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6c7bc79c0 con 0x55f6c7c8d650 2024-09-12T00:19:04.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f033849c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f6c7c176d0 con 0x55f6c7c8a510 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f00e8a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f6c7c8a510 0x55f6c7c8a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f00e8a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f6c7c8a510 0x55f6c7c8a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53726/0 (socket says 172.21.15.66:53726) 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f00e8a640 1 -- 172.21.15.66:0/542544386 learned_addr learned my addr 172.21.15.66:0/542544386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.697+0000 7f8f00689640 1 --1- 172.21.15.66:0/542544386 >> v1:172.21.15.31:6789/0 conn(0x55f6c7c8d650 0x55f6c7c8da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36122/0 (socket says 172.21.15.66:36122) 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f00e8a640 1 -- 172.21.15.66:0/542544386 >> v1:172.21.15.31:6789/0 conn(0x55f6c7c8d650 legacy=0x55f6c7c8da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f00e8a640 1 -- 172.21.15.66:0/542544386 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7bbbca0 con 0x55f6c7c8a510 2024-09-12T00:19:04.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/542544386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7c8a8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000a5c0 tx=0x7f8ef001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35644b0bc19d76f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8effe88640 1 -- 172.21.15.66:0/542544386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00af070 con 0x55f6c7c8a510 2024-09-12T00:19:04.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8effe88640 1 -- 172.21.15.66:0/542544386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef00aa530 con 0x55f6c7c8a510 2024-09-12T00:19:04.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8effe88640 1 -- 172.21.15.66:0/542544386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00aa830 con 0x55f6c7c8a510 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f033849c0 1 -- 172.21.15.66:0/542544386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 msgr2=0x55f6c7c8a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f033849c0 1 --2- 172.21.15.66:0/542544386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7c8a8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000a5c0 tx=0x7f8ef001b340 comp rx=0 tx=0).stop 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f033849c0 1 -- 172.21.15.66:0/542544386 shutdown_connections 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f033849c0 1 --2- 172.21.15.66:0/542544386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7c8a8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.701+0000 7f8f033849c0 1 -- 172.21.15.66:0/542544386 >> 172.21.15.66:0/542544386 conn(0x55f6c7c89080 msgr2=0x55f6c7c89490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.705+0000 7f8f033849c0 1 -- 172.21.15.66:0/542544386 shutdown_connections 2024-09-12T00:19:04.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.705+0000 7f8f033849c0 1 -- 172.21.15.66:0/542544386 wait complete. 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.717+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.717+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.717+0000 7f8f033849c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.717+0000 7f8f033849c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f6c7c1b680 con 0x55f6c7c8a510 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53742/0 (socket says 172.21.15.66:53742) 2024-09-12T00:19:04.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 -- 172.21.15.66:0/546656232 learned_addr learned my addr 172.21.15.66:0/546656232 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 -- 172.21.15.66:0/546656232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7b96da0 con 0x55f6c7c8a510 2024-09-12T00:19:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/546656232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0017f50 tx=0x7f8ef0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c472da760f00e21b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8deee0d640 1 -- 172.21.15.66:0/546656232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00af040 con 0x55f6c7c8a510 2024-09-12T00:19:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8deee0d640 1 -- 172.21.15.66:0/546656232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef00aa9d0 con 0x55f6c7c8a510 2024-09-12T00:19:04.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8deee0d640 1 -- 172.21.15.66:0/546656232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00aacf0 con 0x55f6c7c8a510 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- 172.21.15.66:0/546656232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 msgr2=0x55f6c7e05450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 --2- 172.21.15.66:0/546656232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0017f50 tx=0x7f8ef0003030 comp rx=0 tx=0).stop 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- 172.21.15.66:0/546656232 shutdown_connections 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 --2- 172.21.15.66:0/546656232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e05450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- 172.21.15.66:0/546656232 >> 172.21.15.66:0/546656232 conn(0x55f6c7c89080 msgr2=0x55f6c7e010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- 172.21.15.66:0/546656232 shutdown_connections 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- 172.21.15.66:0/546656232 wait complete. 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f033849c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f6c7bbda50 con 0x55f6c7c8a510 2024-09-12T00:19:04.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53744/0 (socket says 172.21.15.66:53744) 2024-09-12T00:19:04.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 -- 172.21.15.66:0/2192678697 learned_addr learned my addr 172.21.15.66:0/2192678697 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.721+0000 7f8f00e8a640 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7e0cee0 con 0x55f6c7c8a510 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b7040 tx=0x7f8ef00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 -- 172.21.15.66:0/2192678697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00c3020 con 0x55f6c7c8a510 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6c7e0d170 con 0x55f6c7c8a510 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 -- 172.21.15.66:0/2192678697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef00b5b30 con 0x55f6c7c8a510 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 -- 172.21.15.66:0/2192678697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef00af070 con 0x55f6c7c8a510 2024-09-12T00:19:04.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c7e0db20 con 0x55f6c7c8a510 2024-09-12T00:19:04.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 -- 172.21.15.66:0/2192678697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ef00c6020 con 0x55f6c7c8a510 2024-09-12T00:19:04.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 0x7f8de803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8ded60a640 1 -- 172.21.15.66:0/2192678697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ef00ba070 con 0x55f6c7c8a510 2024-09-12T00:19:04.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f00689640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 0x7f8de803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 0x55f6c7e13af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e14030 con 0x55f6c7c8d650 2024-09-12T00:19:04.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f0168b640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 0x55f6c7e13af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f00689640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 0x7f8de803bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001e40 tx=0x7f8ef40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f0168b640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 0x55f6c7e13af0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f0168b640 1 -- 172.21.15.66:0/2192678697 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7c8d650 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e143f0 con 0x55f6c7c8d650 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f0168b640 1 -- 172.21.15.66:0/2192678697 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7c8d650 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 0x55f6c7e185f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.725+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e18cc0 con 0x55f6c7e16200 2024-09-12T00:19:04.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 0x55f6c7e185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 0x55f6c7e185f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f00e8a640 1 -- 172.21.15.66:0/2192678697 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ef00b2040 con 0x55f6c7e16200 2024-09-12T00:19:04.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e150a0 con 0x55f6c7c8d650 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 -- 172.21.15.66:0/2192678697 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7c8d650 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e15580 con 0x55f6c7e16200 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f00e8a640 1 -- 172.21.15.66:0/2192678697 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ef00b2040 con 0x55f6c7e16200 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f6c7c28450 con 0x55f6c7e273f0 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53756/0 (socket says 172.21.15.66:53756) 2024-09-12T00:19:04.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 -- 172.21.15.66:0/2635360767 learned_addr learned my addr 172.21.15.66:0/2635360767 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 -- 172.21.15.66:0/2635360767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7e27e50 con 0x55f6c7e273f0 2024-09-12T00:19:04.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f0168b640 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55f6c7e0ea80 tx=0x7f8ef80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8de67fc640 1 -- 172.21.15.66:0/2635360767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef8013640 con 0x55f6c7e273f0 2024-09-12T00:19:04.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8de67fc640 1 -- 172.21.15.66:0/2635360767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef80137e0 con 0x55f6c7e273f0 2024-09-12T00:19:04.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8de67fc640 1 -- 172.21.15.66:0/2635360767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef8013ac0 con 0x55f6c7e273f0 2024-09-12T00:19:04.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6c7e286b0 con 0x55f6c7e273f0 2024-09-12T00:19:04.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.729+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c7e28c20 con 0x55f6c7e273f0 2024-09-12T00:19:04.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8de67fc640 1 -- 172.21.15.66:0/2635360767 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ef8011040 con 0x55f6c7e273f0 2024-09-12T00:19:04.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8de67fc640 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 0x7f8dd803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8de67fc640 1 -- 172.21.15.66:0/2635360767 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ef800e040 con 0x55f6c7e273f0 2024-09-12T00:19:04.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 0x7f8dd803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 0x7f8dd803bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b4e00 tx=0x7f8ef00e94e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f6c7e05bc0 con 0x55f6c7e34d60 2024-09-12T00:19:04.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53770/0 (socket says 172.21.15.66:53770) 2024-09-12T00:19:04.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f0168b640 1 -- 172.21.15.66:0/2062151355 learned_addr learned my addr 172.21.15.66:0/2062151355 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f0168b640 1 -- 172.21.15.66:0/2062151355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7e35730 con 0x55f6c7e34d60 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f0168b640 1 --2- 172.21.15.66:0/2062151355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80508d0 tx=0x7f8ef8013f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a892d71dde8d5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8dd7fff640 1 -- 172.21.15.66:0/2062151355 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef8012d90 con 0x55f6c7e34d60 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8dd7fff640 1 -- 172.21.15.66:0/2062151355 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef802a910 con 0x55f6c7e34d60 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8dd7fff640 1 -- 172.21.15.66:0/2062151355 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef802a3f0 con 0x55f6c7e34d60 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 -- 172.21.15.66:0/2062151355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 msgr2=0x55f6c7e35140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.733+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2062151355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80508d0 tx=0x7f8ef8013f80 comp rx=0 tx=0).stop 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/2062151355 shutdown_connections 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2062151355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e35140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/2062151355 >> 172.21.15.66:0/2062151355 conn(0x55f6c7e30120 msgr2=0x55f6c7e2e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/2062151355 shutdown_connections 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/2062151355 wait complete. 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 Processor -- start 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- start start 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e3b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f6c7e33c50 con 0x55f6c7e34d60 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e3b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f0168b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e3b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53778/0 (socket says 172.21.15.66:53778) 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 learned_addr learned my addr 172.21.15.66:0/926048291 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c7e3b700 con 0x55f6c7e34d60 2024-09-12T00:19:04.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f0168b640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e3b1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ef804f7a0 tx=0x7f8ef8050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 -- 172.21.15.66:0/926048291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef802e070 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6c7e3b700 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 -- 172.21.15.66:0/926048291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8045030 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 -- 172.21.15.66:0/926048291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef804f2a0 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c7e3b700 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 -- 172.21.15.66:0/926048291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8ef803ea80 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dcc039a70 0x7f8dcc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8dd67fc640 1 -- 172.21.15.66:0/926048291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8ef8034020 con 0x55f6c7e34d60 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dcc039a70 0x7f8dcc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7e46370 0x55f6c7e487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.737+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e48f10 con 0x55f6c7e46370 2024-09-12T00:19:04.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7e46370 0x55f6c7e487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dcc039a70 0x7f8dcc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ef001b170 tx=0x7f8ef00e2000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7e46370 0x55f6c7e487c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ef400f620 con 0x55f6c7e46370 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 realm 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e45780 con 0x55f6c7e46370 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ef400f620 con 0x55f6c7e46370 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e49a10 con 0x55f6c7e46370 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ef400f620 con 0x55f6c7e46370 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4a2e0 con 0x55f6c7e46370 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ef400f620 con 0x55f6c7e46370 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e4abe0 0x55f6c7e4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4d710 con 0x55f6c7e4abe0 2024-09-12T00:19:04.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e4abe0 0x55f6c7e4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e4abe0 0x55f6c7e4cfd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 20 searching for the correct realm 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ef8033460 0x7f8ef803da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ef8033460 0x7f8ef803da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.741+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ef8033460 0x7f8ef803da70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00e8a640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ef00c8020 0x7f8ef00b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ef00c8020 0x7f8ef00b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ef00c8020 0x7f8ef00b3370 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef400f620 con 0x7f8ef00c8020 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef400f620 con 0x55f6c7e46370 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.745+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.749+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef402b040 con 0x55f6c7e46370 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.753+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef00c8020 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x55f6c7e46370 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4efe0 con 0x7f8ef8033460 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:04.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4e0d0 con 0x55f6c7e46370 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4e970 con 0x55f6c7e46370 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4dd10 con 0x55f6c7e4abe0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:04.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 zone default found 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 4 Realm: () 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 zonegroup default 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e4e570 con 0x7f8ef00c8020 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.757+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e51380 con 0x55f6c7e4abe0 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e51800 con 0x55f6c7e4abe0 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 20 started sync module instance, tier type = 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:04.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e50820 con 0x7f8ef8033460 2024-09-12T00:19:04.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94518403990384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e51c60 con 0x7f8ef8033460 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e524b0 con 0x55f6c7e46370 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94518403990384] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94518403996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e52530 con 0x55f6c7e46370 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.761+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e52d80 con 0x55f6c7e4abe0 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94518403999296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e53170 con 0x55f6c7e4abe0 2024-09-12T00:19:04.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e53c60 con 0x7f8ef8033460 2024-09-12T00:19:04.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94518403996768] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94518404003632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e53c20 con 0x7f8ef8033460 2024-09-12T00:19:04.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.765+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e54670 con 0x55f6c7e46370 2024-09-12T00:19:04.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94518403999296] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94518404003632] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94518403997824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e541c0 con 0x55f6c7e46370 2024-09-12T00:19:04.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e54f10 con 0x7f8ef00c8020 2024-09-12T00:19:04.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94518403997824] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94518404000608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e54c30 con 0x7f8ef00c8020 2024-09-12T00:19:04.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.769+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e55480 con 0x7f8ef00c8020 2024-09-12T00:19:04.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.773+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.773+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94518404009280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e557b0 con 0x7f8ef00c8020 2024-09-12T00:19:04.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.773+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e562b0 con 0x7f8ef00c8020 2024-09-12T00:19:04.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.773+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94518404000608] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94518404009280] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94518404013472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e55200 con 0x7f8ef00c8020 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=0 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=1 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=2 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=3 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=4 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=5 2024-09-12T00:19:04.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=6 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94518404013472] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 20 add_watcher() i=7 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e592a0 con 0x55f6c7e46370 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.777+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94518404007808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e56720 con 0x55f6c7e46370 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94518404007808] v31'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 5 note: GC not initialized 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8db5fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 Filter name: none 2024-09-12T00:19:04.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8d277fe640 20 reqs_thread_entry: start 2024-09-12T00:19:04.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c310 con 0x55f6c7e46370 2024-09-12T00:19:04.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.787 INFO:teuthology.orchestra.run.smithi066.stderr:could not fetch user info: no user info saved 2024-09-12T00:19:04.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8db6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.781+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94518404007808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x55f6c7e46370 2024-09-12T00:19:04.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94518404007808] v31'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94518403990384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x7f8ef8033460 2024-09-12T00:19:04.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94518403990384] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 20 remove_watcher() i=0 2024-09-12T00:19:04.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 2 removed watcher, disabling cache 2024-09-12T00:19:04.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94518403996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x55f6c7e46370 2024-09-12T00:19:04.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94518403996768] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 20 remove_watcher() i=1 2024-09-12T00:19:04.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.785+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94518403999296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f0168b640 1 -- 172.21.15.66:0/926048291 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94518403999296] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef800a4d0 con 0x55f6c7e4abe0 2024-09-12T00:19:04.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f033849c0 20 remove_watcher() i=2 2024-09-12T00:19:04.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94518404003632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x7f8ef8033460 2024-09-12T00:19:04.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f00e8a640 1 -- 172.21.15.66:0/926048291 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94518404003632] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef00b2040 con 0x7f8ef8033460 2024-09-12T00:19:04.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f033849c0 20 remove_watcher() i=3 2024-09-12T00:19:04.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.789+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94518403997824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x55f6c7e46370 2024-09-12T00:19:04.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94518403997824] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x55f6c7e46370 2024-09-12T00:19:04.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f033849c0 20 remove_watcher() i=4 2024-09-12T00:19:04.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94518404000608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x7f8ef00c8020 2024-09-12T00:19:04.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94518404000608] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f033849c0 20 remove_watcher() i=5 2024-09-12T00:19:04.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.793+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94518404009280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x7f8ef00c8020 2024-09-12T00:19:04.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94518404009280] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 20 remove_watcher() i=6 2024-09-12T00:19:04.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94518404013472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f6c7e7c2d0 con 0x7f8ef00c8020 2024-09-12T00:19:04.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94518404013472] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ef403b040 con 0x7f8ef00c8020 2024-09-12T00:19:04.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 20 remove_watcher() i=7 2024-09-12T00:19:04.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ef00c8020 msgr2=0x7f8ef00b3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8ef00c8020 0x7f8ef00b3370 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7e46370 msgr2=0x55f6c7e487c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7e46370 0x55f6c7e487c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ef8033460 msgr2=0x7f8ef803da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8ef8033460 0x7f8ef803da70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e4abe0 msgr2=0x55f6c7e4cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e4abe0 0x55f6c7e4cfd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dcc039a70 msgr2=0x7f8dcc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dcc039a70 0x7f8dcc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ef001b170 tx=0x7f8ef00e2000 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 msgr2=0x55f6c7e3b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 --2- 172.21.15.66:0/926048291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e34d60 0x55f6c7e3b1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ef804f7a0 tx=0x7f8ef8050860 comp rx=0 tx=0).stop 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 reap_dead start 2024-09-12T00:19:04.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f00689640 1 -- 172.21.15.66:0/926048291 reap_dead start 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 shutdown_connections 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.797+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 >> 172.21.15.66:0/926048291 conn(0x55f6c7e30120 msgr2=0x55f6c7e2e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 shutdown_connections 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/926048291 wait complete. 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 msgr2=0x7f8dd803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 0x7f8dd803bf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b4e00 tx=0x7f8ef00e94e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 msgr2=0x55f6c7e27810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55f6c7e0ea80 tx=0x7f8ef80167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 shutdown_connections 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8dd8039ac0 0x7f8dd803bf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2635360767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7e273f0 0x55f6c7e27810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 >> 172.21.15.66:0/2635360767 conn(0x55f6c7e1cda0 msgr2=0x55f6c7e1d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 shutdown_connections 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2635360767 wait complete. 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 msgr2=0x55f6c7e13af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 0x55f6c7e13af0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 msgr2=0x55f6c7e185f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 0x55f6c7e185f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 msgr2=0x7f8de803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 0x7f8de803bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4001e40 tx=0x7f8ef40013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 msgr2=0x55f6c7e0c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b7040 tx=0x7f8ef00180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 shutdown_connections 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f6c7e16200 0x55f6c7e185f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f6c7c8d650 0x55f6c7e13af0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8de8039a70 0x7f8de803bf30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 --2- 172.21.15.66:0/2192678697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f6c7c8a510 0x55f6c7e0c980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 >> 172.21.15.66:0/2192678697 conn(0x55f6c7c89080 msgr2=0x55f6c7dffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 shutdown_connections 2024-09-12T00:19:04.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.801+0000 7f8f033849c0 1 -- 172.21.15.66:0/2192678697 wait complete. 2024-09-12T00:19:04.816 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T00:19:04.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T00:19:04.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T00:19:04.817 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-12T00:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:04.912 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2cb2a9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d0ef5fc740 0x55d0ef68b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2cb2a9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0ef53c9c0 con 0x55d0ef68b630 2024-09-12T00:19:04.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2cb2a9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d0ef58c6d0 con 0x55d0ef5fc740 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2a630640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d0ef5fc740 0x55d0ef68b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2a630640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d0ef5fc740 0x55d0ef68b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53786/0 (socket says 172.21.15.66:53786) 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2a630640 1 -- 172.21.15.66:0/2044098257 learned_addr learned my addr 172.21.15.66:0/2044098257 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c29e2f640 1 --1- 172.21.15.66:0/2044098257 >> v1:172.21.15.31:6789/0 conn(0x55d0ef68b630 0x55d0ef68da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36130/0 (socket says 172.21.15.66:36130) 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2a630640 1 -- 172.21.15.66:0/2044098257 >> v1:172.21.15.31:6789/0 conn(0x55d0ef68b630 legacy=0x55d0ef68da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.909+0000 7f9c2a630640 1 -- 172.21.15.66:0/2044098257 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef530ca0 con 0x55d0ef5fc740 2024-09-12T00:19:04.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2a630640 1 --2- 172.21.15.66:0/2044098257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef68b0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00a5c0 tx=0x7f9c1c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c96f5982386513 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2962e640 1 -- 172.21.15.66:0/2044098257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0b1070 con 0x55d0ef5fc740 2024-09-12T00:19:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2962e640 1 -- 172.21.15.66:0/2044098257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0a8070 con 0x55d0ef5fc740 2024-09-12T00:19:04.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2962e640 1 -- 172.21.15.66:0/2044098257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0ac5b0 con 0x55d0ef5fc740 2024-09-12T00:19:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2044098257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 msgr2=0x55d0ef68b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2044098257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef68b0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00a5c0 tx=0x7f9c1c01b340 comp rx=0 tx=0).stop 2024-09-12T00:19:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2044098257 shutdown_connections 2024-09-12T00:19:04.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2044098257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef68b0f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2044098257 >> 172.21.15.66:0/2044098257 conn(0x55d0ef682e20 msgr2=0x55d0ef685240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2044098257 shutdown_connections 2024-09-12T00:19:04.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.913+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2044098257 wait complete. 2024-09-12T00:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2cb2a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2cb2a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0ef590680 con 0x55d0ef5fc740 2024-09-12T00:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2a630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2a630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53790/0 (socket says 172.21.15.66:53790) 2024-09-12T00:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2a630640 1 -- 172.21.15.66:0/2983738987 learned_addr learned my addr 172.21.15.66:0/2983738987 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2a630640 1 -- 172.21.15.66:0/2983738987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef50bda0 con 0x55d0ef5fc740 2024-09-12T00:19:04.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9c2a630640 1 --2- 172.21.15.66:0/2983738987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c017f50 tx=0x7f9c1c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693d4e5acafa27c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9b18608640 1 -- 172.21.15.66:0/2983738987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0b1040 con 0x55d0ef5fc740 2024-09-12T00:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9b18608640 1 -- 172.21.15.66:0/2983738987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0ac7a0 con 0x55d0ef5fc740 2024-09-12T00:19:04.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.929+0000 7f9b18608640 1 -- 172.21.15.66:0/2983738987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0acaa0 con 0x55d0ef5fc740 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2983738987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 msgr2=0x55d0ef6885f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2983738987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c017f50 tx=0x7f9c1c003030 comp rx=0 tx=0).stop 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2983738987 shutdown_connections 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2983738987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef6885f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2983738987 >> 172.21.15.66:0/2983738987 conn(0x55d0ef682e20 msgr2=0x55d0ef76f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2983738987 shutdown_connections 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2983738987 wait complete. 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0ef532a50 con 0x55d0ef5fc740 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2a630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2a630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53794/0 (socket says 172.21.15.66:53794) 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2a630640 1 -- 172.21.15.66:0/2805383548 learned_addr learned my addr 172.21.15.66:0/2805383548 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2a630640 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef77d710 con 0x55d0ef5fc740 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2a630640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c017f50 tx=0x7f9c1c019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9b16e05640 1 -- 172.21.15.66:0/2805383548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0cd070 con 0x55d0ef5fc740 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9b16e05640 1 -- 172.21.15.66:0/2805383548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0b7840 con 0x55d0ef5fc740 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ef77d9a0 con 0x55d0ef5fc740 2024-09-12T00:19:04.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9b16e05640 1 -- 172.21.15.66:0/2805383548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c1c0b1070 con 0x55d0ef5fc740 2024-09-12T00:19:04.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.933+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ef77e260 con 0x55d0ef5fc740 2024-09-12T00:19:04.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9b16e05640 1 -- 172.21.15.66:0/2805383548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c1c0d0070 con 0x55d0ef5fc740 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9b16e05640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 0x7f9b1003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9b16e05640 1 -- 172.21.15.66:0/2805383548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c1c0eaf50 con 0x55d0ef5fc740 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 0x7f9b1003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 0x55d0ef784230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef784770 con 0x55d0ef68b630 2024-09-12T00:19:04.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 0x55d0ef784230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 0x7f9b1003bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001e90 tx=0x7f9c200013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 0x55d0ef784230 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2ae31640 1 -- 172.21.15.66:0/2805383548 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef68b630 2024-09-12T00:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef784b70 con 0x55d0ef68b630 2024-09-12T00:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2ae31640 1 -- 172.21.15.66:0/2805383548 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef68b630 2024-09-12T00:19:04.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 0x55d0ef788d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef789440 con 0x55d0ef786980 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2a630640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 0x55d0ef788d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2a630640 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 0x55d0ef788d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2a630640 1 -- 172.21.15.66:0/2805383548 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c1c0cf030 con 0x55d0ef786980 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef785820 con 0x55d0ef68b630 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2ae31640 1 -- 172.21.15.66:0/2805383548 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef68b630 2024-09-12T00:19:04.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.937+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef785ce0 con 0x55d0ef786980 2024-09-12T00:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2a630640 1 -- 172.21.15.66:0/2805383548 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c1c0cf030 con 0x55d0ef786980 2024-09-12T00:19:04.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0ef59d450 con 0x55d0ef797b70 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53806/0 (socket says 172.21.15.66:53806) 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2ae31640 1 -- 172.21.15.66:0/324716524 learned_addr learned my addr 172.21.15.66:0/324716524 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2ae31640 1 -- 172.21.15.66:0/324716524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef7985d0 con 0x55d0ef797b70 2024-09-12T00:19:04.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55d0ef77f1f0 tx=0x7f9c240167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9b0ffff640 1 -- 172.21.15.66:0/324716524 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c24013640 con 0x55d0ef797b70 2024-09-12T00:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9b0ffff640 1 -- 172.21.15.66:0/324716524 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c240137e0 con 0x55d0ef797b70 2024-09-12T00:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ef798e30 con 0x55d0ef797b70 2024-09-12T00:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9b0ffff640 1 -- 172.21.15.66:0/324716524 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c24013ac0 con 0x55d0ef797b70 2024-09-12T00:19:04.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ef7993a0 con 0x55d0ef797b70 2024-09-12T00:19:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.941+0000 7f9b0ffff640 1 -- 172.21.15.66:0/324716524 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c24011040 con 0x55d0ef797b70 2024-09-12T00:19:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9b0ffff640 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 0x7f9b0403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9b0ffff640 1 -- 172.21.15.66:0/324716524 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c2400e040 con 0x55d0ef797b70 2024-09-12T00:19:04.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2a630640 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 0x7f9b0403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2a630640 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 0x7f9b0403bf80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ab720 tx=0x7f9c1c0d1ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0ef688de0 con 0x55d0ef7a5480 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53822/0 (socket says 172.21.15.66:53822) 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 -- 172.21.15.66:0/4259460633 learned_addr learned my addr 172.21.15.66:0/4259460633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 -- 172.21.15.66:0/4259460633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef7a5e70 con 0x55d0ef7a5480 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/4259460633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c240508d0 tx=0x7f9c2401fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ea0de9a4c98c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9b0dffb640 1 -- 172.21.15.66:0/4259460633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2402a910 con 0x55d0ef7a5480 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9b0dffb640 1 -- 172.21.15.66:0/4259460633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2402a3f0 con 0x55d0ef7a5480 2024-09-12T00:19:04.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9b0dffb640 1 -- 172.21.15.66:0/4259460633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2402aab0 con 0x55d0ef7a5480 2024-09-12T00:19:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/4259460633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 msgr2=0x55d0ef7a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:04.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/4259460633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c240508d0 tx=0x7f9c2401fd70 comp rx=0 tx=0).stop 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/4259460633 shutdown_connections 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/4259460633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7a5880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/4259460633 >> 172.21.15.66:0/4259460633 conn(0x55d0ef7a08a0 msgr2=0x55d0ef79eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/4259460633 shutdown_connections 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/4259460633 wait complete. 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 Processor -- start 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- start start 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2cb2a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0ef7a43d0 con 0x55d0ef7a5480 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53834/0 (socket says 172.21.15.66:53834) 2024-09-12T00:19:04.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.945+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 learned_addr learned my addr 172.21.15.66:0/3572052655 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ef7abe60 con 0x55d0ef7a5480 2024-09-12T00:19:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c2404f7a0 tx=0x7f9c24050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 -- 172.21.15.66:0/3572052655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2402e070 con 0x55d0ef7a5480 2024-09-12T00:19:04.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0ef7abe60 con 0x55d0ef7a5480 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 -- 172.21.15.66:0/3572052655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c24045030 con 0x55d0ef7a5480 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 -- 172.21.15.66:0/3572052655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c240520d0 con 0x55d0ef7a5480 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ef7ac3e0 con 0x55d0ef7a5480 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 -- 172.21.15.66:0/3572052655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c2403ea80 con 0x55d0ef7a5480 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9af4039a70 0x7f9af403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9afbfff640 1 -- 172.21.15.66:0/3572052655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9c24022030 con 0x55d0ef7a5480 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2a630640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9af4039a70 0x7f9af403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef7b6b10 0x55d0ef7b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7b96f0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef7b6b10 0x55d0ef7b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c2a630640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9af4039a70 0x7f9af403bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0e95c0 tx=0x7f9c1c0e9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.949+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef7b6b10 0x55d0ef7b8fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2000f660 con 0x55d0ef7b6b10 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 realm 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7b5ec0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2000f660 con 0x55d0ef7b6b10 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ba1f0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2000f660 con 0x55d0ef7b6b10 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7baac0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c2000f660 con 0x55d0ef7b6b10 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef7bb4e0 0x55d0ef7bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bdfc0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef7bb4e0 0x55d0ef7bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef7bb4e0 0x55d0ef7bd8d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 20 searching for the correct realm 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c24033460 0x7f9c240338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c24033460 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2a630640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c24033460 0x7f9c240338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2a630640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c24033460 0x7f9c240338c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2a630640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c1c0ff040 0x7f9c1c0e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c1c0ff040 2024-09-12T00:19:04.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.953+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c1c0ff040 0x7f9c1c0e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c1c0ff040 0x7f9c1c0e96d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:04.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2000f660 con 0x7f9c1c0ff040 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7b6b10 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2000f660 con 0x55d0ef7b6b10 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7b6b10 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c1c0ff040 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c1c0ff040 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c24033460 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7b6b10 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c1c0ff040 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.957+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7b6b10 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c24033460 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x7f9c1c0ff040 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf890 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.961+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c24033460 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2002b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c24033460 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.965+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9c24064040 con 0x7f9c24033460 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7be940 con 0x55d0ef7b6b10 2024-09-12T00:19:04.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bf1e0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7bfcc0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 zone default found 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 4 Realm: () 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:04.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 zonegroup default 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c0060 con 0x7f9c1c0ff040 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c1e70 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c2400 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 started sync module instance, tier type = 2024-09-12T00:19:04.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:04.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c12e0 con 0x7f9c24033460 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.969+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94355859443248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c2860 con 0x7f9c24033460 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c30b0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94355859443248] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94355859445456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c30b0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c3b80 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94355859453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c3b40 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.973+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c4ab0 con 0x7f9c24033460 2024-09-12T00:19:04.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94355859445456] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94355859457472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c4ab0 con 0x7f9c24033460 2024-09-12T00:19:04.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c54c0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94355859453552] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:04.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94355859457472] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:04.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94355859450880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c5010 con 0x55d0ef7b6b10 2024-09-12T00:19:04.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.977+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c5d60 con 0x7f9c1c0ff040 2024-09-12T00:19:04.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.981+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94355859450880] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.981+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.981+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94355859455856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c5a30 con 0x7f9c1c0ff040 2024-09-12T00:19:04.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.981+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c6280 con 0x7f9c1c0ff040 2024-09-12T00:19:04.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.981+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94355859455856] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94355859461776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c60c0 con 0x7f9c1c0ff040 2024-09-12T00:19:04.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c6b80 con 0x7f9c1c0ff040 2024-09-12T00:19:04.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94355859461776] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94355859465808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c6b40 con 0x7f9c1c0ff040 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=0 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=1 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=2 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=3 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=4 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=5 2024-09-12T00:19:04.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.985+0000 7f9c2cb2a9c0 20 add_watcher() i=6 2024-09-12T00:19:04.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94355859465808] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 add_watcher() i=7 2024-09-12T00:19:04.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:04.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ca000 con 0x55d0ef7b6b10 2024-09-12T00:19:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94355859462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7c7520 con 0x55d0ef7b6b10 2024-09-12T00:19:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94355859462928] v31'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9ae0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:04.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 5 note: GC not initialized 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9a5b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 Filter name: none 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9a597fa640 20 reqs_thread_entry: start 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ed710 con 0x55d0ef7b6b10 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ebdb0 con 0x55d0ef7b6b10 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:04.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.989+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ebdb0 con 0x7f9c1c0ff040 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T00:19:04.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7f0cb0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94355859635360 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7f15e0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== watch-notify(notify (1) cookie 94355859450880 notify 133143986176 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d0ef7ecba0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9b0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94355859450880 notifier 4292 bl.length()=567 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9b0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9b0dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9b0dffb640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9af0003eb0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify cookie 94355859635360 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== watch-notify(notify_complete (2) cookie 94355859635360 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0ef7ec3c0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.993+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ef140 con 0x55d0ef7b6b10 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2cb2a9c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2cb2a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94355859631248 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ef0b0 con 0x7f9c24033460 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== watch-notify(notify (1) cookie 94355859457472 notify 133143986176 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f9c1c107060 con 0x7f9c24033460 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9b0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94355859457472 notifier 4292 bl.length()=169 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9b0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9b0d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T00:19:05.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(69 notify.3 [notify cookie 94355859631248 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9b0d7fa640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9a60003410 con 0x7f9c24033460 2024-09-12T00:19:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== watch-notify(notify_complete (2) cookie 94355859631248 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0ef77e260 con 0x7f9c24033460 2024-09-12T00:19:05.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:04.997+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7ef640 con 0x7f9c1c0ff040 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94355859631600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7f0ba0 con 0x7f9c24033460 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== watch-notify(notify (1) cookie 94355859457472 notify 133143986177 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d0ef77e260 con 0x7f9c24033460 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9b0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94355859457472 notifier 4292 bl.length()=177 2024-09-12T00:19:05.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9b0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9b0dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(72 notify.3 [notify cookie 94355859631600 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9b0dffb640 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9af0003eb0 con 0x7f9c24033460 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== watch-notify(notify_complete (2) cookie 94355859631600 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d0ef77d9a0 con 0x7f9c24033460 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9ae0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94355859462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94355859462928] v31'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.001+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94355859443248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x7f9c24033460 2024-09-12T00:19:05.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94355859443248] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2cb2a9c0 20 remove_watcher() i=0 2024-09-12T00:19:05.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2cb2a9c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94355859445456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94355859445456] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2cb2a9c0 20 remove_watcher() i=1 2024-09-12T00:19:05.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.005+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94355859453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x55d0ef7bb4e0 2024-09-12T00:19:05.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2ae31640 1 -- 172.21.15.66:0/3572052655 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94355859453552] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2400a4d0 con 0x55d0ef7bb4e0 2024-09-12T00:19:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2cb2a9c0 20 remove_watcher() i=2 2024-09-12T00:19:05.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94355859457472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x7f9c24033460 2024-09-12T00:19:05.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2a630640 1 -- 172.21.15.66:0/3572052655 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94355859457472] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c1c0ec040 con 0x7f9c24033460 2024-09-12T00:19:05.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2cb2a9c0 20 remove_watcher() i=3 2024-09-12T00:19:05.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.009+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94355859450880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x55d0ef7b6b10 2024-09-12T00:19:05.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94355859450880] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x55d0ef7b6b10 2024-09-12T00:19:05.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c2cb2a9c0 20 remove_watcher() i=4 2024-09-12T00:19:05.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94355859455856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x7f9c1c0ff040 2024-09-12T00:19:05.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94355859455856] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:05.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c2cb2a9c0 20 remove_watcher() i=5 2024-09-12T00:19:05.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.013+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94355859461776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x7f9c1c0ff040 2024-09-12T00:19:05.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94355859461776] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:05.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 20 remove_watcher() i=6 2024-09-12T00:19:05.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94355859465808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0ef7eb3e0 con 0x7f9c1c0ff040 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94355859465808] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2003b040 con 0x7f9c1c0ff040 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 20 remove_watcher() i=7 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c1c0ff040 msgr2=0x7f9c1c0e96d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c1c0ff040 0x7f9c1c0e96d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef7b6b10 msgr2=0x55d0ef7b8fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef7b6b10 0x55d0ef7b8fa0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c24033460 msgr2=0x7f9c240338c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c24033460 0x7f9c240338c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef7bb4e0 msgr2=0x55d0ef7bd8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef7bb4e0 0x55d0ef7bd8d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9af4039a70 msgr2=0x7f9af403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9af4039a70 0x7f9af403bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0e95c0 tx=0x7f9c1c0e9000 comp rx=0 tx=0).stop 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c29e2f640 1 -- 172.21.15.66:0/3572052655 reap_dead start 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 msgr2=0x55d0ef7ab900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c2404f7a0 tx=0x7f9c24050860 comp rx=0 tx=0).stop 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 shutdown_connections 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/3572052655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef7a5480 0x55d0ef7ab900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 >> 172.21.15.66:0/3572052655 conn(0x55d0ef7a08a0 msgr2=0x55d0ef79eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 shutdown_connections 2024-09-12T00:19:05.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/3572052655 wait complete. 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 msgr2=0x7f9b0403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 0x7f9b0403bf80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ab720 tx=0x7f9c1c0d1ed0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 msgr2=0x55d0ef797f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55d0ef77f1f0 tx=0x7f9c240167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 shutdown_connections 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b04039ac0 0x7f9b0403bf80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/324716524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef797b70 0x55d0ef797f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 >> 172.21.15.66:0/324716524 conn(0x55d0ef78d520 msgr2=0x55d0ef78d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 shutdown_connections 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/324716524 wait complete. 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 msgr2=0x55d0ef784230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 0x55d0ef784230 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 msgr2=0x55d0ef788d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 0x55d0ef788d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 msgr2=0x7f9b1003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 0x7f9b1003bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001e90 tx=0x7f9c200013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 msgr2=0x55d0ef77d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.017+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c017f50 tx=0x7f9c1c019b80 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 shutdown_connections 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d0ef786980 0x55d0ef788d70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d0ef68b630 0x55d0ef784230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b10039a70 0x7f9b1003bf30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 --2- 172.21.15.66:0/2805383548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0ef5fc740 0x55d0ef77d1b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 >> 172.21.15.66:0/2805383548 conn(0x55d0ef682e20 msgr2=0x55d0ef6872d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 shutdown_connections 2024-09-12T00:19:05.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.021+0000 7f9c2cb2a9c0 1 -- 172.21.15.66:0/2805383548 wait complete. 2024-09-12T00:19:05.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:05.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T00:19:05.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T00:19:05.035 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-12T00:19:05.071 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:05.071 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:05.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.065+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d59c29c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ff1a2d6780 0x55ff1a2d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d59c29c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff1a2149c0 con 0x55ff1a2d5170 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d59c29c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ff1a2646d0 con 0x55ff1a2d6780 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ff1a2d6780 0x55ff1a2d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ff1a2d6780 0x55ff1a2d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53844/0 (socket says 172.21.15.66:53844) 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d2cc7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ff1a2d5170 0x55ff1a2d5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36136/0 (socket says 172.21.15.66:36136) 2024-09-12T00:19:05.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 -- 172.21.15.66:0/1274768640 learned_addr learned my addr 172.21.15.66:0/1274768640 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 -- 172.21.15.66:0/1274768640 >> v1:172.21.15.31:6789/0 conn(0x55ff1a2d5170 legacy=0x55ff1a2d5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 -- 172.21.15.66:0/1274768640 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a208ca0 con 0x55ff1a2d6780 2024-09-12T00:19:05.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d24c6640 1 -- 172.21.15.66:0/1274768640 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888745812 0 0) 0x55ff1a2149c0 con 0x55ff1a2d5170 2024-09-12T00:19:05.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/1274768640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d6780 0x55ff1a2d6b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400a5c0 tx=0x7fb8c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db466d6e6c725dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.069+0000 7fb8d24c6640 1 -- 172.21.15.66:0/1274768640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40a6070 con 0x55ff1a2d6780 2024-09-12T00:19:05.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d24c6640 1 -- 172.21.15.66:0/1274768640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40af070 con 0x55ff1a2d6780 2024-09-12T00:19:05.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d24c6640 1 -- 172.21.15.66:0/1274768640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40aa5c0 con 0x55ff1a2d6780 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1274768640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d6780 msgr2=0x55ff1a2d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1274768640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d6780 0x55ff1a2d6b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400a5c0 tx=0x7fb8c401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1274768640 shutdown_connections 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1274768640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d6780 0x55ff1a2d6b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1274768640 >> 172.21.15.66:0/1274768640 conn(0x55ff1a35bfa0 msgr2=0x55ff1a35e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1274768640 shutdown_connections 2024-09-12T00:19:05.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.073+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1274768640 wait complete. 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.085+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.085+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.085+0000 7fb8d59c29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ff1a268680 con 0x55ff1a2d5170 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53848/0 (socket says 172.21.15.66:53848) 2024-09-12T00:19:05.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 -- 172.21.15.66:0/740443139 learned_addr learned my addr 172.21.15.66:0/740443139 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 -- 172.21.15.66:0/740443139 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a1e3da0 con 0x55ff1a2d5170 2024-09-12T00:19:05.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/740443139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40ac040 tx=0x7fb8c4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1f9ea3c352dc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb7c160a640 1 -- 172.21.15.66:0/740443139 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40aa970 con 0x55ff1a2d5170 2024-09-12T00:19:05.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb7c160a640 1 -- 172.21.15.66:0/740443139 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40aab10 con 0x55ff1a2d5170 2024-09-12T00:19:05.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb7c160a640 1 -- 172.21.15.66:0/740443139 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40aae30 con 0x55ff1a2d5170 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/740443139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 msgr2=0x55ff1a44db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/740443139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40ac040 tx=0x7fb8c4003030 comp rx=0 tx=0).stop 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/740443139 shutdown_connections 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/740443139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a44db30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/740443139 >> 172.21.15.66:0/740443139 conn(0x55ff1a35bfa0 msgr2=0x55ff1a449770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/740443139 shutdown_connections 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/740443139 wait complete. 2024-09-12T00:19:05.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d59c29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ff1a20aa50 con 0x55ff1a2d5170 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53860/0 (socket says 172.21.15.66:53860) 2024-09-12T00:19:05.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 -- 172.21.15.66:0/166569239 learned_addr learned my addr 172.21.15.66:0/166569239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.089+0000 7fb8d34c8640 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a4555a0 con 0x55ff1a2d5170 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8c401b170 tx=0x7fb8c40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 -- 172.21.15.66:0/166569239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40c6480 con 0x55ff1a2d5170 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff1a455830 con 0x55ff1a2d5170 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 -- 172.21.15.66:0/166569239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40cc070 con 0x55ff1a2d5170 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 -- 172.21.15.66:0/166569239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8c40c6790 con 0x55ff1a2d5170 2024-09-12T00:19:05.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff1a4561e0 con 0x55ff1a2d5170 2024-09-12T00:19:05.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 -- 172.21.15.66:0/166569239 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8c40c6a00 con 0x55ff1a2d5170 2024-09-12T00:19:05.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 0x7fb7b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb7bfe07640 1 -- 172.21.15.66:0/166569239 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb8c40eba00 con 0x55ff1a2d5170 2024-09-12T00:19:05.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 0x7fb7b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 0x55ff1a45c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a45c6f0 con 0x55ff1a2d6780 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 0x55ff1a45c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 0x7fb7b803bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8000c10 tx=0x7fb8c80013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 0x55ff1a45c1b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/166569239 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8cc00a4d0 con 0x55ff1a2d6780 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a45cb20 con 0x55ff1a2d6780 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/166569239 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8cc00a4d0 con 0x55ff1a2d6780 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 0x55ff1a460d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4613f0 con 0x55ff1a45e930 2024-09-12T00:19:05.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.093+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 0x55ff1a460d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 0x55ff1a460d20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d34c8640 1 -- 172.21.15.66:0/166569239 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8c40bc400 con 0x55ff1a45e930 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a45d7a0 con 0x55ff1a2d6780 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/166569239 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8cc00a4d0 con 0x55ff1a2d6780 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a45dc60 con 0x55ff1a45e930 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d34c8640 1 -- 172.21.15.66:0/166569239 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8c40bc400 con 0x55ff1a45e930 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ff1a275450 con 0x55ff1a46fae0 2024-09-12T00:19:05.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53870/0 (socket says 172.21.15.66:53870) 2024-09-12T00:19:05.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/1806325886 learned_addr learned my addr 172.21.15.66:0/1806325886 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/1806325886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a470540 con 0x55ff1a46fae0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55ff1a455dc0 tx=0x7fb8cc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb7bd602640 1 -- 172.21.15.66:0/1806325886 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc013640 con 0x55ff1a46fae0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb7bd602640 1 -- 172.21.15.66:0/1806325886 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0137e0 con 0x55ff1a46fae0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb7bd602640 1 -- 172.21.15.66:0/1806325886 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc013ac0 con 0x55ff1a46fae0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff1a470da0 con 0x55ff1a46fae0 2024-09-12T00:19:05.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.097+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff1a471310 con 0x55ff1a46fae0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7bd602640 1 -- 172.21.15.66:0/1806325886 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8cc011040 con 0x55ff1a46fae0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7bd602640 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 0x7fb7ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7bd602640 1 -- 172.21.15.66:0/1806325886 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb8cc00e040 con 0x55ff1a46fae0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 0x7fb7ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ff1a44e2c0 con 0x55ff1a47c400 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 0x7fb7ac03bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40bc6b0 tx=0x7fb8c40e9da0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53878/0 (socket says 172.21.15.66:53878) 2024-09-12T00:19:05.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/1650556621 learned_addr learned my addr 172.21.15.66:0/1650556621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/1650556621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a47cdb0 con 0x55ff1a47c400 2024-09-12T00:19:05.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/1650556621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0508b0 tx=0x7fb8cc020e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8354a32c45f900f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7b6ffd640 1 -- 172.21.15.66:0/1650556621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc01f340 con 0x55ff1a47c400 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7b6ffd640 1 -- 172.21.15.66:0/1650556621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc02a910 con 0x55ff1a47c400 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb7b6ffd640 1 -- 172.21.15.66:0/1650556621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc0203a0 con 0x55ff1a47c400 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1650556621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 msgr2=0x55ff1a47c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1650556621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0508b0 tx=0x7fb8cc020e10 comp rx=0 tx=0).stop 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1650556621 shutdown_connections 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1650556621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a47c7e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1650556621 >> 172.21.15.66:0/1650556621 conn(0x55ff1a478830 msgr2=0x55ff1a476a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1650556621 shutdown_connections 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.101+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1650556621 wait complete. 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 Processor -- start 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 -- start start 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ff1a47d410 con 0x55ff1a47c400 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d3cc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53884/0 (socket says 172.21.15.66:53884) 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 learned_addr learned my addr 172.21.15.66:0/3937144637 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1a483e50 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0114f0 tx=0x7fb8cc050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 -- 172.21.15.66:0/3937144637 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc037070 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff1a4840e0 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff1a4840e0 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 -- 172.21.15.66:0/3937144637 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc04f2b0 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 -- 172.21.15.66:0/3937144637 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc03ea60 con 0x55ff1a47c400 2024-09-12T00:19:05.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 -- 172.21.15.66:0/3937144637 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8cc03a070 con 0x55ff1a47c400 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb79c039a70 0x7fb79c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb7b57fa640 1 -- 172.21.15.66:0/3937144637 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb8cc03fe00 con 0x55ff1a47c400 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb79c039a70 0x7fb79c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a48ec90 0x55ff1a491120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a491870 con 0x55ff1a48ec90 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.105+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a48ec90 0x55ff1a491120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb79c039a70 0x7fb79c03bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40bc8a0 tx=0x7fb8c40dd3b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a48ec90 0x55ff1a491120 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 realm 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a48e0a0 con 0x55ff1a48ec90 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a492370 con 0x55ff1a48ec90 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a492c40 con 0x55ff1a48ec90 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a493660 0x55ff1a495a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4961c0 con 0x55ff1a493660 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a493660 0x55ff1a495a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a493660 0x55ff1a495a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 20 searching for the correct realm 2024-09-12T00:19:05.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb8cc03c060 0x7fb8cc021870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb8cc03c060 0x7fb8cc021870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb8cc03c060 0x7fb8cc021870 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb8c40e3070 0x7fb8c40cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.109+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb8c40e3070 0x7fb8c40cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb8c40e3070 0x7fb8c40cf7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.113+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.117+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.121+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a493660 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8c40e3070 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x55ff1a48ec90 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497a90 con 0x7fb8cc03c060 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a496b10 con 0x55ff1a48ec90 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497360 con 0x55ff1a48ec90 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a497ec0 con 0x55ff1a493660 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 zone default found 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 4 Realm: () 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:05.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 zonegroup default 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a498260 con 0x7fb8c40e3070 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49a4a0 con 0x55ff1a493660 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49a840 con 0x55ff1a493660 2024-09-12T00:19:05.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.125+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 20 started sync module instance, tier type = 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4998e0 con 0x7fb8cc03c060 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554146051120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49ac30 con 0x7fb8cc03c060 2024-09-12T00:19:05.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49b480 con 0x55ff1a48ec90 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554146051120] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554146058192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49b8a0 con 0x55ff1a48ec90 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.129+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49c130 con 0x55ff1a493660 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554146058192] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554146059248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49bcc0 con 0x55ff1a493660 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49cb70 con 0x7fb8cc03c060 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554146064064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49d410 con 0x7fb8cc03c060 2024-09-12T00:19:05.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49de10 con 0x55ff1a48ec90 2024-09-12T00:19:05.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.133+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554146059248] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554146064064] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554146060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49cf60 con 0x55ff1a48ec90 2024-09-12T00:19:05.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49e6b0 con 0x7fb8c40e3070 2024-09-12T00:19:05.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554146060304] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554146070576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49e900 con 0x7fb8c40e3070 2024-09-12T00:19:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.137+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49d920 con 0x7fb8c40e3070 2024-09-12T00:19:05.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554146070576] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554146071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49ed20 con 0x7fb8c40e3070 2024-09-12T00:19:05.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49f570 con 0x7fb8c40e3070 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554146074368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49f9b0 con 0x7fb8c40e3070 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d59c29c0 20 add_watcher() i=0 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.141+0000 7fb8d59c29c0 20 add_watcher() i=1 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=2 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=3 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=4 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=5 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554146071632] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=6 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554146074368] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 add_watcher() i=7 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49e870 con 0x55ff1a48ec90 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554146072688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49fef0 con 0x55ff1a48ec90 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554146072688] v31'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.145+0000 7fb8d59c29c0 5 note: GC not initialized 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb788fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:05.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 Filter name: none 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb7027fc640 20 reqs_thread_entry: start 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c6060 con 0x7fb8c40e3070 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c4700 con 0x55ff1a48ec90 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c4af0 con 0x55ff1a48ec90 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:05.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.149+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554146072688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4a07c0 con 0x55ff1a48ec90 2024-09-12T00:19:05.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94554146072688] v31'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554146051120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x7fb8cc03c060 2024-09-12T00:19:05.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94554146051120] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 20 remove_watcher() i=0 2024-09-12T00:19:05.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554146058192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x55ff1a48ec90 2024-09-12T00:19:05.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94554146058192] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 20 remove_watcher() i=1 2024-09-12T00:19:05.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.153+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554146059248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49afd0 con 0x55ff1a493660 2024-09-12T00:19:05.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d3cc9640 1 -- 172.21.15.66:0/3937144637 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94554146059248] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8cc039030 con 0x55ff1a493660 2024-09-12T00:19:05.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d59c29c0 20 remove_watcher() i=2 2024-09-12T00:19:05.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554146064064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x7fb8cc03c060 2024-09-12T00:19:05.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d34c8640 1 -- 172.21.15.66:0/3937144637 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94554146064064] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c40e0040 con 0x7fb8cc03c060 2024-09-12T00:19:05.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d59c29c0 20 remove_watcher() i=3 2024-09-12T00:19:05.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.157+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554146060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x55ff1a48ec90 2024-09-12T00:19:05.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94554146060304] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x55ff1a48ec90 2024-09-12T00:19:05.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d59c29c0 20 remove_watcher() i=4 2024-09-12T00:19:05.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554146070576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x7fb8c40e3070 2024-09-12T00:19:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94554146070576] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d59c29c0 20 remove_watcher() i=5 2024-09-12T00:19:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.161+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554146071632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a49e030 con 0x7fb8c40e3070 2024-09-12T00:19:05.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.165+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94554146071632] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.165+0000 7fb8d59c29c0 20 remove_watcher() i=6 2024-09-12T00:19:05.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.165+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554146074368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ff1a4c3d90 con 0x7fb8c40e3070 2024-09-12T00:19:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.165+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94554146074368] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8c800f600 con 0x7fb8c40e3070 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.165+0000 7fb8d59c29c0 20 remove_watcher() i=7 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb8c40e3070 msgr2=0x7fb8c40cf7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb8c40e3070 0x7fb8c40cf7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a48ec90 msgr2=0x55ff1a491120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a48ec90 0x55ff1a491120 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb8cc03c060 msgr2=0x7fb8cc021870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb8cc03c060 0x7fb8cc021870 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a493660 msgr2=0x55ff1a495a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a493660 0x55ff1a495a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb79c039a70 msgr2=0x7fb79c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb79c039a70 0x7fb79c03bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40bc8a0 tx=0x7fb8c40dd3b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d2cc7640 1 -- 172.21.15.66:0/3937144637 reap_dead start 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 msgr2=0x55ff1a4838f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0114f0 tx=0x7fb8cc050840 comp rx=0 tx=0).stop 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 shutdown_connections 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/3937144637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a47c400 0x55ff1a4838f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 >> 172.21.15.66:0/3937144637 conn(0x55ff1a478830 msgr2=0x55ff1a476a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 shutdown_connections 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/3937144637 wait complete. 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 msgr2=0x7fb7ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 0x7fb7ac03bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40bc6b0 tx=0x7fb8c40e9da0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 msgr2=0x55ff1a46ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55ff1a455dc0 tx=0x7fb8cc0167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 shutdown_connections 2024-09-12T00:19:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7ac039a70 0x7fb7ac03bf30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/1806325886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a46fae0 0x55ff1a46ff00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 >> 172.21.15.66:0/1806325886 conn(0x55ff1a465490 msgr2=0x55ff1a465870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 shutdown_connections 2024-09-12T00:19:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/1806325886 wait complete. 2024-09-12T00:19:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 msgr2=0x55ff1a45c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 0x55ff1a45c1b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 msgr2=0x55ff1a460d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 0x55ff1a460d20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 msgr2=0x7fb7b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 0x7fb7b803bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8000c10 tx=0x7fb8c80013c0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 msgr2=0x55ff1a455040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb8c401b170 tx=0x7fb8c40180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 shutdown_connections 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ff1a45e930 0x55ff1a460d20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ff1a2d6780 0x55ff1a45c1b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb7b8039a70 0x7fb7b803bf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 --2- 172.21.15.66:0/166569239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ff1a2d5170 0x55ff1a455040 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 >> 172.21.15.66:0/166569239 conn(0x55ff1a35bfa0 msgr2=0x55ff1a448200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 shutdown_connections 2024-09-12T00:19:05.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.169+0000 7fb8d59c29c0 1 -- 172.21.15.66:0/166569239 wait complete. 2024-09-12T00:19:05.185 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-12T00:19:05.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.185 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:05.269 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:05.270 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:05.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c75b369c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b3a5e1770 0x562b3a5e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c75b369c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b3a4939c0 con 0x562b3a5e48b0 2024-09-12T00:19:05.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c75b369c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x562b3a4e36d0 con 0x562b3a5e1770 2024-09-12T00:19:05.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c7363c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b3a5e1770 0x562b3a5e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c7363c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b3a5e1770 0x562b3a5e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53890/0 (socket says 172.21.15.66:53890) 2024-09-12T00:19:05.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.265+0000 7f2c7363c640 1 -- 172.21.15.66:0/4182914501 learned_addr learned my addr 172.21.15.66:0/4182914501 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7363c640 1 -- 172.21.15.66:0/4182914501 >> v1:172.21.15.31:6789/0 conn(0x562b3a5e48b0 legacy=0x562b3a5e6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7363c640 1 -- 172.21.15.66:0/4182914501 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a487ca0 con 0x562b3a5e1770 2024-09-12T00:19:05.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7363c640 1 --2- 172.21.15.66:0/4182914501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a5e1b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00a4e0 tx=0x7f2c6c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc180ccaad99763 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7263a640 1 -- 172.21.15.66:0/4182914501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0aa540 con 0x562b3a5e1770 2024-09-12T00:19:05.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7263a640 1 -- 172.21.15.66:0/4182914501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0aa6e0 con 0x562b3a5e1770 2024-09-12T00:19:05.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c7263a640 1 -- 172.21.15.66:0/4182914501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0aaa40 con 0x562b3a5e1770 2024-09-12T00:19:05.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 -- 172.21.15.66:0/4182914501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 msgr2=0x562b3a5e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/4182914501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a5e1b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00a4e0 tx=0x7f2c6c01b090 comp rx=0 tx=0).stop 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 -- 172.21.15.66:0/4182914501 shutdown_connections 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/4182914501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a5e1b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 -- 172.21.15.66:0/4182914501 >> 172.21.15.66:0/4182914501 conn(0x562b3a555080 msgr2=0x562b3a555490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 -- 172.21.15.66:0/4182914501 shutdown_connections 2024-09-12T00:19:05.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.269+0000 7f2c75b369c0 1 -- 172.21.15.66:0/4182914501 wait complete. 2024-09-12T00:19:05.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.285+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.285+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b3a4e7680 con 0x562b3a5e1770 2024-09-12T00:19:05.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53906/0 (socket says 172.21.15.66:53906) 2024-09-12T00:19:05.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 -- 172.21.15.66:0/472361258 learned_addr learned my addr 172.21.15.66:0/472361258 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 -- 172.21.15.66:0/472361258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a462da0 con 0x562b3a5e1770 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 --2- 172.21.15.66:0/472361258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c017ca0 tx=0x7f2c6c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d6e783149947a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2b6160a640 1 -- 172.21.15.66:0/472361258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0b9030 con 0x562b3a5e1770 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2b6160a640 1 -- 172.21.15.66:0/472361258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0aaa80 con 0x562b3a5e1770 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2b6160a640 1 -- 172.21.15.66:0/472361258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0aada0 con 0x562b3a5e1770 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- 172.21.15.66:0/472361258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 msgr2=0x562b3a6cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/472361258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c017ca0 tx=0x7f2c6c0033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- 172.21.15.66:0/472361258 shutdown_connections 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/472361258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6cc9e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- 172.21.15.66:0/472361258 >> 172.21.15.66:0/472361258 conn(0x562b3a555080 msgr2=0x562b3a6c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- 172.21.15.66:0/472361258 shutdown_connections 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- 172.21.15.66:0/472361258 wait complete. 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c75b369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b3a489a50 con 0x562b3a5e1770 2024-09-12T00:19:05.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53916/0 (socket says 172.21.15.66:53916) 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.289+0000 7f2c7363c640 1 -- 172.21.15.66:0/3629873974 learned_addr learned my addr 172.21.15.66:0/3629873974 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c7363c640 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a6d4530 con 0x562b3a5e1770 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c7363c640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c017ca0 tx=0x7f2c6c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 -- 172.21.15.66:0/3629873974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0b9070 con 0x562b3a5e1770 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 -- 172.21.15.66:0/3629873974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0c3030 con 0x562b3a5e1770 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b3a6d47c0 con 0x562b3a5e1770 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 -- 172.21.15.66:0/3629873974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c0b5bf0 con 0x562b3a5e1770 2024-09-12T00:19:05.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3a6d5170 con 0x562b3a5e1770 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 -- 172.21.15.66:0/3629873974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2c6c0b3040 con 0x562b3a5e1770 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 0x7f2b5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2b5fe07640 1 -- 172.21.15.66:0/3629873974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2c6c0ba070 con 0x562b3a5e1770 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 0x562b3a6db140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a6db680 con 0x562b3a5e48b0 2024-09-12T00:19:05.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 0x7f2b5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 0x562b3a6db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 0x562b3a6db140 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 0x7f2b5803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c001e60 tx=0x7f2c5c0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c73e3d640 1 -- 172.21.15.66:0/3629873974 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c640083f0 con 0x562b3a5e48b0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.293+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a6d54b0 con 0x562b3a5e48b0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 -- 172.21.15.66:0/3629873974 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c640083f0 con 0x562b3a5e48b0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 0x562b3a6dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a6e03b0 con 0x562b3a6dd8f0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c7363c640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 0x562b3a6dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c7363c640 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 0x562b3a6dfce0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c7363c640 1 -- 172.21.15.66:0/3629873974 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c6c0cf070 con 0x562b3a6dd8f0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a6dc790 con 0x562b3a5e48b0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 -- 172.21.15.66:0/3629873974 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c640083f0 con 0x562b3a5e48b0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a6dcc70 con 0x562b3a6dd8f0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c7363c640 1 -- 172.21.15.66:0/3629873974 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c6c0cf070 con 0x562b3a6dd8f0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c75b369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b3a4f4450 con 0x562b3a6eeb00 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53920/0 (socket says 172.21.15.66:53920) 2024-09-12T00:19:05.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 -- 172.21.15.66:0/1206779540 learned_addr learned my addr 172.21.15.66:0/1206779540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.297+0000 7f2c73e3d640 1 -- 172.21.15.66:0/1206779540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a6ef560 con 0x562b3a6eeb00 2024-09-12T00:19:05.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562b3a6d4e90 tx=0x7f2c6400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 -- 172.21.15.66:0/1206779540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6401c020 con 0x562b3a6eeb00 2024-09-12T00:19:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 -- 172.21.15.66:0/1206779540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64007d00 con 0x562b3a6eeb00 2024-09-12T00:19:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 -- 172.21.15.66:0/1206779540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64018440 con 0x562b3a6eeb00 2024-09-12T00:19:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b3a6efdc0 con 0x562b3a6eeb00 2024-09-12T00:19:05.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3a6f0330 con 0x562b3a6eeb00 2024-09-12T00:19:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 -- 172.21.15.66:0/1206779540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2c6401f020 con 0x562b3a6eeb00 2024-09-12T00:19:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 0x7f2b4c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2b5d602640 1 -- 172.21.15.66:0/1206779540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2c64051db0 con 0x562b3a6eeb00 2024-09-12T00:19:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c7363c640 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 0x7f2b4c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c7363c640 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 0x7f2b4c03bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0aa6b0 tx=0x7f2c6c0bced0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c75b369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b3a6cd150 con 0x562b3a6fc450 2024-09-12T00:19:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53936/0 (socket says 172.21.15.66:53936) 2024-09-12T00:19:05.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.301+0000 7f2c73e3d640 1 -- 172.21.15.66:0/2828675778 learned_addr learned my addr 172.21.15.66:0/2828675778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 -- 172.21.15.66:0/2828675778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a6fce40 con 0x562b3a6fc450 2024-09-12T00:19:05.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/2828675778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c64050100 tx=0x7f2c64043050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4650f285c12792 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b56ffd640 1 -- 172.21.15.66:0/2828675778 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64021530 con 0x562b3a6fc450 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b56ffd640 1 -- 172.21.15.66:0/2828675778 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c64029350 con 0x562b3a6fc450 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b56ffd640 1 -- 172.21.15.66:0/2828675778 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64029c70 con 0x562b3a6fc450 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/2828675778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 msgr2=0x562b3a6fc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/2828675778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c64050100 tx=0x7f2c64043050 comp rx=0 tx=0).stop 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/2828675778 shutdown_connections 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/2828675778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a6fc850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/2828675778 >> 172.21.15.66:0/2828675778 conn(0x562b3a6f7870 msgr2=0x562b3a6f5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/2828675778 shutdown_connections 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/2828675778 wait complete. 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 Processor -- start 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- start start 2024-09-12T00:19:05.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b3a6fb3a0 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53950/0 (socket says 172.21.15.66:53950) 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 learned_addr learned my addr 172.21.15.66:0/664254788 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3a702e60 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c64016aa0 tx=0x7f2c64050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b557fa640 1 -- 172.21.15.66:0/664254788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c64028300 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b3a7030f0 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b557fa640 1 -- 172.21.15.66:0/664254788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c640284a0 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2b557fa640 1 -- 172.21.15.66:0/664254788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c640289c0 con 0x562b3a6fc450 2024-09-12T00:19:05.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.305+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3a703aa0 con 0x562b3a6fc450 2024-09-12T00:19:05.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2b557fa640 1 -- 172.21.15.66:0/664254788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2c64016040 con 0x562b3a6fc450 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2b557fa640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b3c039a70 0x7f2b3c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2b557fa640 1 -- 172.21.15.66:0/664254788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2c64056060 con 0x562b3a6fc450 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c7363c640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b3c039a70 0x7f2b3c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a70de60 0x562b3a7102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a710a40 con 0x562b3a70de60 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a70de60 0x562b3a7102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c7363c640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b3c039a70 0x7f2b3c03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0033d0 tx=0x7f2c6c0dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a70de60 0x562b3a7102f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00d040 con 0x562b3a70de60 2024-09-12T00:19:05.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 realm 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a70d210 con 0x562b3a70de60 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00d040 con 0x562b3a70de60 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a711540 con 0x562b3a70de60 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c00d040 con 0x562b3a70de60 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a711e10 con 0x562b3a70de60 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c5c00d040 con 0x562b3a70de60 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a712710 0x562b3a714b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a715270 con 0x562b3a712710 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a712710 0x562b3a714b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.309+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a712710 0x562b3a714b00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c75b369c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c75b369c0 20 searching for the correct realm 2024-09-12T00:19:05.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c73e3d640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2c64021020 0x7f2c640463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c7363c640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2c64021020 0x7f2c640463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c7363c640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2c64021020 0x7f2c640463f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c7363c640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2c6c0f8040 0x7f2c6c0bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2c6c0f8040 0x7f2c6c0bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2c6c0f8040 0x7f2c6c0bc5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00d040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c00d040 con 0x562b3a70de60 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.313+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.317+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.321+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a712710 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c6c0f8040 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x562b3a70de60 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716b40 con 0x7f2c64021020 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a715c60 con 0x562b3a70de60 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716500 con 0x562b3a70de60 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a7158a0 con 0x562b3a712710 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 zone default found 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 4 Realm: () 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:05.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 zonegroup default 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.325+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a716ff0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a718b40 con 0x562b3a712710 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a718fe0 con 0x562b3a712710 2024-09-12T00:19:05.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 started sync module instance, tier type = 2024-09-12T00:19:05.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:05.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a717e80 con 0x7f2c64021020 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743664097744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a719440 con 0x7f2c64021020 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a719c90 con 0x562b3a70de60 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.329+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743664097744] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743664099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a719d50 con 0x562b3a70de60 2024-09-12T00:19:05.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71a870 con 0x562b3a712710 2024-09-12T00:19:05.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743664099952] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743664108352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71a830 con 0x562b3a712710 2024-09-12T00:19:05.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.333+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71b280 con 0x7f2c64021020 2024-09-12T00:19:05.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743664111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71bad0 con 0x7f2c64021020 2024-09-12T00:19:05.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71c4d0 con 0x562b3a70de60 2024-09-12T00:19:05.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743664108352] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743664111056] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743664113184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71bfe0 con 0x562b3a70de60 2024-09-12T00:19:05.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.337+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71cda0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743664113184] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743664105440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71cce0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71d6a0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743664105440] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743664118288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71d6a0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.341+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71e0a0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743664122800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71e4c0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=0 2024-09-12T00:19:05.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=1 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=2 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=3 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=4 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=5 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743664118288] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=6 2024-09-12T00:19:05.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743664122800] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 20 add_watcher() i=7 2024-09-12T00:19:05.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:05.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.345+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71d1f0 con 0x562b3a70de60 2024-09-12T00:19:05.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743664120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71ea70 con 0x562b3a70de60 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743664120304] v31'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2b29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 5 note: GC not initialized 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2b28fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:05.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 Filter name: none 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2aa27fc640 20 reqs_thread_entry: start 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b3a744680 con 0x562b3a70de60 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.349+0000 7f2c75b369c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:05.356 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:05.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2b29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743664120304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a7434f0 con 0x562b3a70de60 2024-09-12T00:19:05.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94743664120304] v31'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743664097744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71d1f0 con 0x7f2c64021020 2024-09-12T00:19:05.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94743664097744] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c75b369c0 20 remove_watcher() i=0 2024-09-12T00:19:05.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c75b369c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.353+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743664099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a7179d0 con 0x562b3a70de60 2024-09-12T00:19:05.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94743664099952] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c75b369c0 20 remove_watcher() i=1 2024-09-12T00:19:05.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743664108352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a7179d0 con 0x562b3a712710 2024-09-12T00:19:05.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c73e3d640 1 -- 172.21.15.66:0/664254788 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94743664108352] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c64057040 con 0x562b3a712710 2024-09-12T00:19:05.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c75b369c0 20 remove_watcher() i=2 2024-09-12T00:19:05.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.357+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743664111056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71a340 con 0x7f2c64021020 2024-09-12T00:19:05.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c7363c640 1 -- 172.21.15.66:0/664254788 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94743664111056] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c0db030 con 0x7f2c64021020 2024-09-12T00:19:05.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c75b369c0 20 remove_watcher() i=3 2024-09-12T00:19:05.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743664113184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71add0 con 0x562b3a70de60 2024-09-12T00:19:05.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94743664113184] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x562b3a70de60 2024-09-12T00:19:05.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c75b369c0 20 remove_watcher() i=4 2024-09-12T00:19:05.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.361+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743664105440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71a340 con 0x7f2c6c0f8040 2024-09-12T00:19:05.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94743664105440] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c75b369c0 20 remove_watcher() i=5 2024-09-12T00:19:05.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743664118288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71add0 con 0x7f2c6c0f8040 2024-09-12T00:19:05.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94743664118288] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c75b369c0 20 remove_watcher() i=6 2024-09-12T00:19:05.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.365+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743664122800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b3a71a340 con 0x7f2c6c0f8040 2024-09-12T00:19:05.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94743664122800] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c5c02a040 con 0x7f2c6c0f8040 2024-09-12T00:19:05.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 20 remove_watcher() i=7 2024-09-12T00:19:05.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2c6c0f8040 msgr2=0x7f2c6c0bc5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2c6c0f8040 0x7f2c6c0bc5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a70de60 msgr2=0x562b3a7102f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a70de60 0x562b3a7102f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2c64021020 msgr2=0x7f2c640463f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2c64021020 0x7f2c640463f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a712710 msgr2=0x562b3a714b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a712710 0x562b3a714b00 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b3c039a70 msgr2=0x7f2b3c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b3c039a70 0x7f2b3c03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0033d0 tx=0x7f2c6c0dd000 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 msgr2=0x562b3a702900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c64016aa0 tx=0x7f2c64050090 comp rx=0 tx=0).stop 2024-09-12T00:19:05.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c72e3b640 1 -- 172.21.15.66:0/664254788 reap_dead start 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 shutdown_connections 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/664254788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6fc450 0x562b3a702900 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 >> 172.21.15.66:0/664254788 conn(0x562b3a6f7870 msgr2=0x562b3a6f5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 shutdown_connections 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/664254788 wait complete. 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 msgr2=0x7f2b4c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 0x7f2b4c03bf80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0aa6b0 tx=0x7f2c6c0bced0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 msgr2=0x562b3a6eef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562b3a6d4e90 tx=0x7f2c6400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 shutdown_connections 2024-09-12T00:19:05.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b4c039ac0 0x7f2b4c03bf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/1206779540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a6eeb00 0x562b3a6eef20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 >> 172.21.15.66:0/1206779540 conn(0x562b3a6e44b0 msgr2=0x562b3a6e4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 shutdown_connections 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/1206779540 wait complete. 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 msgr2=0x562b3a6db140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 0x562b3a6db140 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 msgr2=0x562b3a6dfce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 0x562b3a6dfce0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 msgr2=0x7f2b5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 0x7f2b5803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c001e60 tx=0x7f2c5c0013e0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 msgr2=0x562b3a6d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c017ca0 tx=0x7f2c6c017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:05.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 shutdown_connections 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b3a6dd8f0 0x562b3a6dfce0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b3a5e48b0 0x562b3a6db140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2b58039a70 0x7f2b5803bf30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 --2- 172.21.15.66:0/3629873974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b3a5e1770 0x562b3a6d3fd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 >> 172.21.15.66:0/3629873974 conn(0x562b3a555080 msgr2=0x562b3a6c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 shutdown_connections 2024-09-12T00:19:05.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.369+0000 7f2c75b369c0 1 -- 172.21.15.66:0/3629873974 wait complete. 2024-09-12T00:19:05.386 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:05.386 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T00:19:05.386 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T00:19:05.386 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T00:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:05.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656e2c79c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b3d809770 0x560b3d809b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656e2c79c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b3d6bb9c0 con 0x560b3d80c8b0 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656e2c79c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560b3d70b6d0 con 0x560b3d809770 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656bdcd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b3d809770 0x560b3d809b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656bdcd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560b3d809770 0x560b3d809b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53960/0 (socket says 172.21.15.66:53960) 2024-09-12T00:19:05.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656bdcd640 1 -- 172.21.15.66:0/4250453399 learned_addr learned my addr 172.21.15.66:0/4250453399 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.457+0000 7f656b5cc640 1 --1- 172.21.15.66:0/4250453399 >> v1:172.21.15.31:6789/0 conn(0x560b3d80c8b0 0x560b3d80eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36164/0 (socket says 172.21.15.66:36164) 2024-09-12T00:19:05.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656bdcd640 1 -- 172.21.15.66:0/4250453399 >> v1:172.21.15.31:6789/0 conn(0x560b3d80c8b0 legacy=0x560b3d80eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656bdcd640 1 -- 172.21.15.66:0/4250453399 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d6afca0 con 0x560b3d809770 2024-09-12T00:19:05.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656bdcd640 1 --2- 172.21.15.66:0/4250453399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d809b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f655c00a5c0 tx=0x7f655c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80cc552dcad9f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656adcb640 1 -- 172.21.15.66:0/4250453399 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0a6070 con 0x560b3d809770 2024-09-12T00:19:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656adcb640 1 -- 172.21.15.66:0/4250453399 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c0af070 con 0x560b3d809770 2024-09-12T00:19:05.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656adcb640 1 -- 172.21.15.66:0/4250453399 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0aa5c0 con 0x560b3d809770 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 -- 172.21.15.66:0/4250453399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 msgr2=0x560b3d809b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/4250453399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d809b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f655c00a5c0 tx=0x7f655c01b340 comp rx=0 tx=0).stop 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 -- 172.21.15.66:0/4250453399 shutdown_connections 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/4250453399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d809b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 -- 172.21.15.66:0/4250453399 >> 172.21.15.66:0/4250453399 conn(0x560b3d77d080 msgr2=0x560b3d77d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.461+0000 7f656e2c79c0 1 -- 172.21.15.66:0/4250453399 shutdown_connections 2024-09-12T00:19:05.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.465+0000 7f656e2c79c0 1 -- 172.21.15.66:0/4250453399 wait complete. 2024-09-12T00:19:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.477+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.477+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.477+0000 7f656e2c79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.477+0000 7f656e2c79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b3d70f680 con 0x560b3d809770 2024-09-12T00:19:05.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53972/0 (socket says 172.21.15.66:53972) 2024-09-12T00:19:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 -- 172.21.15.66:0/3682312940 learned_addr learned my addr 172.21.15.66:0/3682312940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 -- 172.21.15.66:0/3682312940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d68ada0 con 0x560b3d809770 2024-09-12T00:19:05.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3682312940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f655c0ac040 tx=0x7f655c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e1310a8332e375 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f6459e0b640 1 -- 172.21.15.66:0/3682312940 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0aa9d0 con 0x560b3d809770 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f6459e0b640 1 -- 172.21.15.66:0/3682312940 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c0aab70 con 0x560b3d809770 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f6459e0b640 1 -- 172.21.15.66:0/3682312940 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0bd3f0 con 0x560b3d809770 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3682312940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 msgr2=0x560b3d8f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3682312940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f655c0ac040 tx=0x7f655c003030 comp rx=0 tx=0).stop 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3682312940 shutdown_connections 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3682312940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8f49e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3682312940 >> 172.21.15.66:0/3682312940 conn(0x560b3d77d080 msgr2=0x560b3d8f0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3682312940 shutdown_connections 2024-09-12T00:19:05.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3682312940 wait complete. 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656e2c79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b3d6b1a50 con 0x560b3d809770 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53984/0 (socket says 172.21.15.66:53984) 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 -- 172.21.15.66:0/2924775888 learned_addr learned my addr 172.21.15.66:0/2924775888 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.481+0000 7f656bdcd640 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d8fc450 con 0x560b3d809770 2024-09-12T00:19:05.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656bdcd640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f655c01bbe0 tx=0x7f655c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 -- 172.21.15.66:0/2924775888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0cb020 con 0x560b3d809770 2024-09-12T00:19:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d8fc6e0 con 0x560b3d809770 2024-09-12T00:19:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 -- 172.21.15.66:0/2924775888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c0c6650 con 0x560b3d809770 2024-09-12T00:19:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 -- 172.21.15.66:0/2924775888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f655c0c6970 con 0x560b3d809770 2024-09-12T00:19:05.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d8fd090 con 0x560b3d809770 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 -- 172.21.15.66:0/2924775888 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f655c0ce020 con 0x560b3d809770 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 0x7f645403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f6453fff640 1 -- 172.21.15.66:0/2924775888 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f655c0ebbe0 con 0x560b3d809770 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656b5cc640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 0x7f645403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 0x560b3d903060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9035a0 con 0x560b3d80c8b0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656c5ce640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 0x560b3d903060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656b5cc640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 0x7f645403bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6560001e90 tx=0x7f65600013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656c5ce640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 0x560b3d903060 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656c5ce640 1 -- 172.21.15.66:0/2924775888 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d80c8b0 2024-09-12T00:19:05.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9039e0 con 0x560b3d80c8b0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656c5ce640 1 -- 172.21.15.66:0/2924775888 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d80c8b0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 0x560b3d907be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.485+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d908280 con 0x560b3d9057f0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656bdcd640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 0x560b3d907be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656bdcd640 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 0x560b3d907be0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656bdcd640 1 -- 172.21.15.66:0/2924775888 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f655c0bd910 con 0x560b3d9057f0 2024-09-12T00:19:05.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d904660 con 0x560b3d80c8b0 2024-09-12T00:19:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 -- 172.21.15.66:0/2924775888 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d80c8b0 2024-09-12T00:19:05.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d904b90 con 0x560b3d9057f0 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656bdcd640 1 -- 172.21.15.66:0/2924775888 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f655c0bd910 con 0x560b3d9057f0 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b3d71c450 con 0x560b3d9169d0 2024-09-12T00:19:05.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53988/0 (socket says 172.21.15.66:53988) 2024-09-12T00:19:05.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 -- 172.21.15.66:0/1383948414 learned_addr learned my addr 172.21.15.66:0/1383948414 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 -- 172.21.15.66:0/1383948414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d917430 con 0x560b3d9169d0 2024-09-12T00:19:05.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656c5ce640 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x560b3d8fe030 tx=0x7f65640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f64517fa640 1 -- 172.21.15.66:0/1383948414 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6564013640 con 0x560b3d9169d0 2024-09-12T00:19:05.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d917c90 con 0x560b3d9169d0 2024-09-12T00:19:05.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f64517fa640 1 -- 172.21.15.66:0/1383948414 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65640137e0 con 0x560b3d9169d0 2024-09-12T00:19:05.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.489+0000 7f64517fa640 1 -- 172.21.15.66:0/1383948414 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6564013ac0 con 0x560b3d9169d0 2024-09-12T00:19:05.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d918200 con 0x560b3d9169d0 2024-09-12T00:19:05.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f64517fa640 1 -- 172.21.15.66:0/1383948414 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6564011040 con 0x560b3d9169d0 2024-09-12T00:19:05.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f64517fa640 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 0x7f644403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f64517fa640 1 -- 172.21.15.66:0/1383948414 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f656400e040 con 0x560b3d9169d0 2024-09-12T00:19:05.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656bdcd640 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 0x7f644403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656bdcd640 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 0x7f644403bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f655c0bc760 tx=0x7f655c0e9f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656e2c79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656e2c79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b3d8f5150 con 0x560b3d924320 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:53990/0 (socket says 172.21.15.66:53990) 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656c5ce640 1 -- 172.21.15.66:0/942543559 learned_addr learned my addr 172.21.15.66:0/942543559 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656c5ce640 1 -- 172.21.15.66:0/942543559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d924cf0 con 0x560b3d924320 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f656c5ce640 1 --2- 172.21.15.66:0/942543559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6564012e70 tx=0x7f65640204b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16603e25b79fc197 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f644affd640 1 -- 172.21.15.66:0/942543559 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656402a910 con 0x560b3d924320 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f644affd640 1 -- 172.21.15.66:0/942543559 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6564013c60 con 0x560b3d924320 2024-09-12T00:19:05.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.493+0000 7f644affd640 1 -- 172.21.15.66:0/942543559 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656402aab0 con 0x560b3d924320 2024-09-12T00:19:05.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/942543559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 msgr2=0x560b3d924700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/942543559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6564012e70 tx=0x7f65640204b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/942543559 shutdown_connections 2024-09-12T00:19:05.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/942543559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d924700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/942543559 >> 172.21.15.66:0/942543559 conn(0x560b3d91f6e0 msgr2=0x560b3d91d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/942543559 shutdown_connections 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/942543559 wait complete. 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 Processor -- start 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- start start 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d92a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560b3d923210 con 0x560b3d924320 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d92a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656c5ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d92a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54004/0 (socket says 172.21.15.66:54004) 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 learned_addr learned my addr 172.21.15.66:0/3017703602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d92ad00 con 0x560b3d924320 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656c5ce640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d92a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f656404b010 tx=0x7f6564050810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f64497fa640 1 -- 172.21.15.66:0/3017703602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f656402e070 con 0x560b3d924320 2024-09-12T00:19:05.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b3d92af90 con 0x560b3d924320 2024-09-12T00:19:05.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f64497fa640 1 -- 172.21.15.66:0/3017703602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6564045030 con 0x560b3d924320 2024-09-12T00:19:05.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f64497fa640 1 -- 172.21.15.66:0/3017703602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6564013d90 con 0x560b3d924320 2024-09-12T00:19:05.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d92af90 con 0x560b3d924320 2024-09-12T00:19:05.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.497+0000 7f64497fa640 1 -- 172.21.15.66:0/3017703602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6564039060 con 0x560b3d924320 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f64497fa640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6434039a70 0x7f643403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f64497fa640 1 -- 172.21.15.66:0/3017703602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f656403cc40 con 0x560b3d924320 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6434039a70 0x7f643403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d935b00 0x560b3d937fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d938710 con 0x560b3d935b00 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d935b00 0x560b3d937fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6434039a70 0x7f643403bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f655c0bdc20 tx=0x7f655c0e0000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d935b00 0x560b3d937fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656000f660 con 0x560b3d935b00 2024-09-12T00:19:05.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 realm 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d934ea0 con 0x560b3d935b00 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656000f660 con 0x560b3d935b00 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d939210 con 0x560b3d935b00 2024-09-12T00:19:05.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656000f660 con 0x560b3d935b00 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d939ae0 con 0x560b3d935b00 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f656000f660 con 0x560b3d935b00 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d93a500 0x560b3d93c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93cfe0 con 0x560b3d93a500 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d93a500 0x560b3d93c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d93a500 0x560b3d93c8f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 20 searching for the correct realm 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d93a500 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6564032020 0x7f65640143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f6564032020 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.501+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6564032020 0x7f65640143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6564032020 0x7f65640143c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656bdcd640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f655c0d0020 0x7f655c0d8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f655c0d0020 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f655c0d0020 0x7f655c0d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f655c0d0020 0x7f655c0d8780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656000f660 con 0x7f655c0d0020 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d935b00 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656000f660 con 0x560b3d935b00 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d935b00 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f655c0d0020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x7f655c0d0020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.505+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f655c0d0020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x7f655c0d0020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f6564032020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d93a500 2024-09-12T00:19:05.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d935b00 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f655c0d0020 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x7f655c0d0020 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x560b3d935b00 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e8b0 con 0x7f6564032020 2024-09-12T00:19:05.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.509+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f655c0d0020 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x7f655c0d0020 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d935b00 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d935b00 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f655c0d0020 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x7f655c0d0020 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f6564032020 2024-09-12T00:19:05.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d935b00 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656002b040 con 0x560b3d935b00 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f655c0d0020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.513+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f655c0d0020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f6564032020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d93a500 2024-09-12T00:19:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f655c0d0020 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x560b3d935b00 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f655c105060 con 0x7f6564032020 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93d930 con 0x560b3d935b00 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93e1d0 con 0x560b3d935b00 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93ece0 con 0x560b3d93a500 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 zone default found 2024-09-12T00:19:05.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 4 Realm: () 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 zonegroup default 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.517+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d93f080 con 0x7f655c0d0020 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d940f20 con 0x560b3d93a500 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9412c0 con 0x560b3d93a500 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 started sync module instance, tier type = 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d940360 con 0x7f6564032020 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606277738160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9416d0 con 0x7f6564032020 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d941f20 con 0x560b3d935b00 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.521+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606277738160] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606277740368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d942000 con 0x560b3d935b00 2024-09-12T00:19:05.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d942b20 con 0x560b3d93a500 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606277748208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d942ae0 con 0x560b3d93a500 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d943a20 con 0x7f6564032020 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606277740368] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.525+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606277752112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d943a20 con 0x7f6564032020 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d944430 con 0x560b3d935b00 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606277748208] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606277750544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d944430 con 0x560b3d935b00 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d944df0 con 0x7f655c0d0020 2024-09-12T00:19:05.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606277752112] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.529+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606277750544] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606277754752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9443a0 con 0x7f655c0d0020 2024-09-12T00:19:05.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9452a0 con 0x7f655c0d0020 2024-09-12T00:19:05.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606277754752] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606277757248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d945210 con 0x7f655c0d0020 2024-09-12T00:19:05.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.533+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d945bd0 con 0x7f655c0d0020 2024-09-12T00:19:05.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606277757248] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606277758304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d945db0 con 0x7f655c0d0020 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=0 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=1 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=2 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=3 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=4 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=5 2024-09-12T00:19:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=6 2024-09-12T00:19:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606277758304] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 20 add_watcher() i=7 2024-09-12T00:19:05.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.537+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d9490a0 con 0x560b3d935b00 2024-09-12T00:19:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.541+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.541+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606277773968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d945e60 con 0x560b3d935b00 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.545+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606277773968] v31'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.545+0000 7f6421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.545+0000 7f656e2c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.545+0000 7f656e2c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 5 note: GC not initialized 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f6420fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:05.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 20 Filter name: none 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f639a7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96c650 con 0x560b3d935b00 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96f0e0 con 0x7f6564032020 2024-09-12T00:19:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d972d10 con 0x560b3d935b00 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94606277945248 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96e4f0 con 0x560b3d935b00 2024-09-12T00:19:05.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94606277750544 notify 133143986177 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6560018040 con 0x560b3d935b00 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f644affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94606277750544 notifier 4313 bl.length()=567 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f644affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f644affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify cookie 94606277945248 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f644affd640 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6430003eb0 con 0x560b3d935b00 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.549+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94606277945248 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b3d6bb9c0 con 0x560b3d935b00 2024-09-12T00:19:05.559 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f6421fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606277773968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96e4f0 con 0x560b3d935b00 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94606277773968] v31'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606277738160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96e4f0 con 0x7f6564032020 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94606277738160] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656e2c79c0 20 remove_watcher() i=0 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656e2c79c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.553+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606277740368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x560b3d935b00 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94606277740368] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656e2c79c0 20 remove_watcher() i=1 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606277748208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x560b3d93a500 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656c5ce640 1 -- 172.21.15.66:0/3017703602 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94606277748208] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656400a4d0 con 0x560b3d93a500 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656e2c79c0 20 remove_watcher() i=2 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.557+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606277752112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x7f6564032020 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656bdcd640 1 -- 172.21.15.66:0/3017703602 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94606277752112] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f655c0de040 con 0x7f6564032020 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656e2c79c0 20 remove_watcher() i=3 2024-09-12T00:19:05.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606277750544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x560b3d935b00 2024-09-12T00:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94606277750544] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x560b3d935b00 2024-09-12T00:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656e2c79c0 20 remove_watcher() i=4 2024-09-12T00:19:05.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.561+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606277754752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x7f655c0d0020 2024-09-12T00:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94606277754752] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656e2c79c0 20 remove_watcher() i=5 2024-09-12T00:19:05.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606277757248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x7f655c0d0020 2024-09-12T00:19:05.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94606277757248] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656e2c79c0 20 remove_watcher() i=6 2024-09-12T00:19:05.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.565+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606277758304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b3d96a3b0 con 0x7f655c0d0020 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94606277758304] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656003b040 con 0x7f655c0d0020 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 20 remove_watcher() i=7 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f655c0d0020 msgr2=0x7f655c0d8780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f655c0d0020 0x7f655c0d8780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d935b00 msgr2=0x560b3d937fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d935b00 0x560b3d937fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6564032020 msgr2=0x7f65640143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6564032020 0x7f65640143c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d93a500 msgr2=0x560b3d93c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d93a500 0x560b3d93c8f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6434039a70 msgr2=0x7f643403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6434039a70 0x7f643403bf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f655c0bdc20 tx=0x7f655c0e0000 comp rx=0 tx=0).stop 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 msgr2=0x560b3d92a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/3017703602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d924320 0x560b3d92a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f656404b010 tx=0x7f6564050810 comp rx=0 tx=0).stop 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 reap_dead start 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656b5cc640 1 -- 172.21.15.66:0/3017703602 reap_dead start 2024-09-12T00:19:05.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 shutdown_connections 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 >> 172.21.15.66:0/3017703602 conn(0x560b3d91f6e0 msgr2=0x560b3d91d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 shutdown_connections 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/3017703602 wait complete. 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 msgr2=0x7f644403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 0x7f644403bf30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f655c0bc760 tx=0x7f655c0e9f40 comp rx=0 tx=0).stop 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 msgr2=0x560b3d916df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x560b3d8fe030 tx=0x7f65640167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 shutdown_connections 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6444039a70 0x7f644403bf30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/1383948414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d9169d0 0x560b3d916df0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 >> 172.21.15.66:0/1383948414 conn(0x560b3d90c380 msgr2=0x560b3d90c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 shutdown_connections 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/1383948414 wait complete. 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 msgr2=0x560b3d903060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 0x560b3d903060 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 msgr2=0x560b3d907be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 0x560b3d907be0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 msgr2=0x7f645403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 0x7f645403bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6560001e90 tx=0x7f65600013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 msgr2=0x560b3d8fbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f655c01bbe0 tx=0x7f655c0180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 shutdown_connections 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560b3d9057f0 0x560b3d907be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560b3d80c8b0 0x560b3d903060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6454039a70 0x7f645403bf30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 --2- 172.21.15.66:0/2924775888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560b3d809770 0x560b3d8fbef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 >> 172.21.15.66:0/2924775888 conn(0x560b3d77d080 msgr2=0x560b3d8ef110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 shutdown_connections 2024-09-12T00:19:05.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.569+0000 7f656e2c79c0 1 -- 172.21.15.66:0/2924775888 wait complete. 2024-09-12T00:19:05.587 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:05.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.588 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:05.667 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:05.667 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:05.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa113c579c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564dd5d06060 0x564dd5d06440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa113c579c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564dd5c439c0 con 0x564dd5d04a60 2024-09-12T00:19:05.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa113c579c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564dd5c936d0 con 0x564dd5d06060 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564dd5d06060 0x564dd5d06440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564dd5d06060 0x564dd5d06440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54008/0 (socket says 172.21.15.66:54008) 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 -- 172.21.15.66:0/875194 learned_addr learned my addr 172.21.15.66:0/875194 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa110f5c640 1 --1- 172.21.15.66:0/875194 >> v1:172.21.15.31:6789/0 conn(0x564dd5d04a60 0x564dd5d04e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36174/0 (socket says 172.21.15.66:36174) 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 -- 172.21.15.66:0/875194 >> v1:172.21.15.31:6789/0 conn(0x564dd5d04a60 legacy=0x564dd5d04e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 -- 172.21.15.66:0/875194 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5c37ca0 con 0x564dd5d06060 2024-09-12T00:19:05.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.665+0000 7fa11175d640 1 --2- 172.21.15.66:0/875194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d06060 0x564dd5d06440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a4e0 tx=0x7fa10c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258e852cc958ee2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa103fff640 1 -- 172.21.15.66:0/875194 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0ab410 con 0x564dd5d06060 2024-09-12T00:19:05.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa103fff640 1 -- 172.21.15.66:0/875194 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0a7070 con 0x564dd5d06060 2024-09-12T00:19:05.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa103fff640 1 -- 172.21.15.66:0/875194 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0ab760 con 0x564dd5d06060 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 -- 172.21.15.66:0/875194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d06060 msgr2=0x564dd5d06440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 --2- 172.21.15.66:0/875194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d06060 0x564dd5d06440 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00a4e0 tx=0x7fa10c01b090 comp rx=0 tx=0).stop 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 -- 172.21.15.66:0/875194 shutdown_connections 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 --2- 172.21.15.66:0/875194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d06060 0x564dd5d06440 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 -- 172.21.15.66:0/875194 >> 172.21.15.66:0/875194 conn(0x564dd5d8b040 msgr2=0x564dd5d8d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 -- 172.21.15.66:0/875194 shutdown_connections 2024-09-12T00:19:05.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.669+0000 7fa113c579c0 1 -- 172.21.15.66:0/875194 wait complete. 2024-09-12T00:19:05.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa113c579c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa113c579c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564dd5c97680 con 0x564dd5d04a60 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa11175d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa11175d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54024/0 (socket says 172.21.15.66:54024) 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa11175d640 1 -- 172.21.15.66:0/3787314230 learned_addr learned my addr 172.21.15.66:0/3787314230 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa11175d640 1 -- 172.21.15.66:0/3787314230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5c12da0 con 0x564dd5d04a60 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7fa11175d640 1 --2- 172.21.15.66:0/3787314230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa10c000f90 tx=0x7fa10c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960afa88fd62ec0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7f9fff606640 1 -- 172.21.15.66:0/3787314230 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0ab540 con 0x564dd5d04a60 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7f9fff606640 1 -- 172.21.15.66:0/3787314230 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0ab6e0 con 0x564dd5d04a60 2024-09-12T00:19:05.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.685+0000 7f9fff606640 1 -- 172.21.15.66:0/3787314230 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0ab9e0 con 0x564dd5d04a60 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/3787314230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 msgr2=0x564dd5e81410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3787314230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa10c000f90 tx=0x7fa10c0033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/3787314230 shutdown_connections 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3787314230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e81410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/3787314230 >> 172.21.15.66:0/3787314230 conn(0x564dd5d8b040 msgr2=0x564dd5e7d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/3787314230 shutdown_connections 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/3787314230 wait complete. 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564dd5c39a50 con 0x564dd5d04a60 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa11175d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa11175d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54036/0 (socket says 172.21.15.66:54036) 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa11175d640 1 -- 172.21.15.66:0/729978670 learned_addr learned my addr 172.21.15.66:0/729978670 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa11175d640 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5e88dd0 con 0x564dd5d04a60 2024-09-12T00:19:05.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa11175d640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa10c01aec0 tx=0x7fa10c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 -- 172.21.15.66:0/729978670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0c3070 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dd5e89060 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 -- 172.21.15.66:0/729978670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0b5920 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 -- 172.21.15.66:0/729978670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10c0b5c20 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd5e899f0 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 -- 172.21.15.66:0/729978670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa10c0c6070 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 0x7f9ff803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.689+0000 7f9ffde03640 1 -- 172.21.15.66:0/729978670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa10c0ba040 con 0x564dd5d04a60 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa110f5c640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 0x7f9ff803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 0x564dd5e8f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5e8fe80 con 0x564dd5d06060 2024-09-12T00:19:05.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa111f5e640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 0x564dd5e8f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa110f5c640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 0x7f9ff803bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa108001e90 tx=0x7fa1080013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa111f5e640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 0x564dd5e8f940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa111f5e640 1 -- 172.21.15.66:0/729978670 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1040083f0 con 0x564dd5d06060 2024-09-12T00:19:05.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5e902a0 con 0x564dd5d06060 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa111f5e640 1 -- 172.21.15.66:0/729978670 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1040083f0 con 0x564dd5d06060 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 0x564dd5e944a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5e94b70 con 0x564dd5e920b0 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa11175d640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 0x564dd5e944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa11175d640 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 0x564dd5e944a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa11175d640 1 -- 172.21.15.66:0/729978670 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa10c0c5030 con 0x564dd5e920b0 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5e90f50 con 0x564dd5d06060 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa111f5e640 1 -- 172.21.15.66:0/729978670 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1040083f0 con 0x564dd5d06060 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5e91430 con 0x564dd5e920b0 2024-09-12T00:19:05.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa11175d640 1 -- 172.21.15.66:0/729978670 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa10c0c5030 con 0x564dd5e920b0 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.693+0000 7fa113c579c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564dd5ca4450 con 0x564dd5ea32c0 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54052/0 (socket says 172.21.15.66:54052) 2024-09-12T00:19:05.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa111f5e640 1 -- 172.21.15.66:0/3451478465 learned_addr learned my addr 172.21.15.66:0/3451478465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa111f5e640 1 -- 172.21.15.66:0/3451478465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5ea3d20 con 0x564dd5ea32c0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa111f5e640 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x564dd5e896e0 tx=0x7fa10400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 -- 172.21.15.66:0/3451478465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10401c020 con 0x564dd5ea32c0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dd5ea4580 con 0x564dd5ea32c0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 -- 172.21.15.66:0/3451478465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa104007d00 con 0x564dd5ea32c0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 -- 172.21.15.66:0/3451478465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa104018440 con 0x564dd5ea32c0 2024-09-12T00:19:05.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd5ea4af0 con 0x564dd5ea32c0 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 -- 172.21.15.66:0/3451478465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa10401f020 con 0x564dd5ea32c0 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 0x7f9fe803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7f9ff6ffd640 1 -- 172.21.15.66:0/3451478465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa104051dd0 con 0x564dd5ea32c0 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa11175d640 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 0x7f9fe803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa11175d640 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 0x7f9fe803bf30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0c6ce0 tx=0x7fa10c0bfe70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.697+0000 7fa113c579c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564dd5e81b80 con 0x564dd5eafb80 2024-09-12T00:19:05.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54068/0 (socket says 172.21.15.66:54068) 2024-09-12T00:19:05.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 -- 172.21.15.66:0/657788112 learned_addr learned my addr 172.21.15.66:0/657788112 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 -- 172.21.15.66:0/657788112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5eb0530 con 0x564dd5eafb80 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 --2- 172.21.15.66:0/657788112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa104050120 tx=0x7fa104050260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca073ce09a41da1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7f9ff4ff9640 1 -- 172.21.15.66:0/657788112 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa104021400 con 0x564dd5eafb80 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7f9ff4ff9640 1 -- 172.21.15.66:0/657788112 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa104018b50 con 0x564dd5eafb80 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7f9ff4ff9640 1 -- 172.21.15.66:0/657788112 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040215a0 con 0x564dd5eafb80 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- 172.21.15.66:0/657788112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 msgr2=0x564dd5eaff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 --2- 172.21.15.66:0/657788112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa104050120 tx=0x7fa104050260 comp rx=0 tx=0).stop 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- 172.21.15.66:0/657788112 shutdown_connections 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 --2- 172.21.15.66:0/657788112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eaff60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- 172.21.15.66:0/657788112 >> 172.21.15.66:0/657788112 conn(0x564dd5eabfb0 msgr2=0x564dd5eaa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- 172.21.15.66:0/657788112 shutdown_connections 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- 172.21.15.66:0/657788112 wait complete. 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 Processor -- start 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- start start 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eb7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa113c579c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564dd5eb0b90 con 0x564dd5eafb80 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eb7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eb7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54082/0 (socket says 172.21.15.66:54082) 2024-09-12T00:19:05.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 learned_addr learned my addr 172.21.15.66:0/359214076 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.701+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd5eb7560 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa111f5e640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eb7000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa104018fd0 tx=0x7fa1040500b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 -- 172.21.15.66:0/359214076 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa104038070 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dd5eb77f0 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 -- 172.21.15.66:0/359214076 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa104029c70 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 -- 172.21.15.66:0/359214076 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa104020a90 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd5eb81a0 con 0x564dd5eafb80 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 -- 172.21.15.66:0/359214076 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa10403b070 con 0x564dd5eafb80 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fdc039a70 0x7f9fdc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7f9fe6ffd640 1 -- 172.21.15.66:0/359214076 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa10402c040 con 0x564dd5eafb80 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa11175d640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fdc039a70 0x7f9fdc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5ec25a0 0x564dd5ec4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec5180 con 0x564dd5ec25a0 2024-09-12T00:19:05.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa110f5c640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5ec25a0 0x564dd5ec4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa11175d640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fdc039a70 0x7f9fdc03bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564dd5e89c30 tx=0x7fa10c0e3000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa110f5c640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5ec25a0 0x564dd5ec4a30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa10800f660 con 0x564dd5ec25a0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 realm 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec19b0 con 0x564dd5ec25a0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa10800f660 con 0x564dd5ec25a0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec5c80 con 0x564dd5ec25a0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa10800f660 con 0x564dd5ec25a0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.705+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec6550 con 0x564dd5ec25a0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa10800f660 con 0x564dd5ec25a0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5ec6e00 0x564dd5ec91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec9950 con 0x564dd5ec6e00 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5ec6e00 0x564dd5ec91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5ec6e00 0x564dd5ec91f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 20 searching for the correct realm 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa10403d060 0x7fa104023a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa11175d640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa10403d060 0x7fa104023a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa11175d640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa10403d060 0x7fa104023a10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa11175d640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa10c0c8070 0x7fa10c0a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa110f5c640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa10c0c8070 0x7fa10c0a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.709+0000 7fa110f5c640 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa10c0c8070 0x7fa10c0a4620 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10800f660 con 0x7fa10c0c8070 2024-09-12T00:19:05.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10800f660 con 0x564dd5ec25a0 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.713+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.717+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10802b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec6e00 2024-09-12T00:19:05.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10c0c8070 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x564dd5ec25a0 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecb270 con 0x7fa10403d060 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:05.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.721+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5eca360 con 0x564dd5ec25a0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecac00 con 0x564dd5ec25a0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ec9fa0 con 0x564dd5ec6e00 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:05.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 zone default found 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 4 Realm: () 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 zonegroup default 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5eca800 con 0x7fa10c0c8070 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecd610 con 0x564dd5ec6e00 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecda70 con 0x564dd5ec6e00 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 started sync module instance, tier type = 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5eccab0 con 0x7fa10403d060 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.725+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94892301536928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ece380 con 0x7fa10403d060 2024-09-12T00:19:05.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecebd0 con 0x564dd5ec25a0 2024-09-12T00:19:05.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94892301536928] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94892301541072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecec10 con 0x564dd5ec25a0 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.729+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecf6d0 con 0x564dd5ec6e00 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94892301545888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ecf690 con 0x564dd5ec6e00 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed0610 con 0x7fa10403d060 2024-09-12T00:19:05.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94892301541072] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94892301549840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed0610 con 0x7fa10403d060 2024-09-12T00:19:05.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed1050 con 0x564dd5ec25a0 2024-09-12T00:19:05.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94892301545888] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.733+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94892301549840] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94892301543200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed0ba0 con 0x564dd5ec25a0 2024-09-12T00:19:05.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed1430 con 0x7fa10c0c8070 2024-09-12T00:19:05.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94892301543200] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94892301548272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed1050 con 0x7fa10c0c8070 2024-09-12T00:19:05.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.737+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed1e40 con 0x7fa10c0c8070 2024-09-12T00:19:05.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94892301548272] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94892301552816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed1e40 con 0x7fa10c0c8070 2024-09-12T00:19:05.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed2800 con 0x7fa10c0c8070 2024-09-12T00:19:05.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94892301552816] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94892301556384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed2800 con 0x7fa10c0c8070 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=0 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=1 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=2 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=3 2024-09-12T00:19:05.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=4 2024-09-12T00:19:05.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=5 2024-09-12T00:19:05.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.741+0000 7fa113c579c0 20 add_watcher() i=6 2024-09-12T00:19:05.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94892301556384] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 20 add_watcher() i=7 2024-09-12T00:19:05.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:05.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed5b20 con 0x564dd5ec25a0 2024-09-12T00:19:05.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94892301558976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed2d90 con 0x564dd5ec25a0 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94892301558976] v31'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 5 note: GC not initialized 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7f9fc67e4640 20 reqs_thread_entry: start 2024-09-12T00:19:05.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.745+0000 7fa113c579c0 20 Filter name: none 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7f9f37fff640 20 reqs_thread_entry: start 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa113c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ef8cf0 con 0x564dd5ec25a0 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa113c579c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:05.756 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:05.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94892301558976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ef7b40 con 0x564dd5ec25a0 2024-09-12T00:19:05.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94892301558976] v31'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.749+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94892301536928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x7fa10403d060 2024-09-12T00:19:05.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94892301536928] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa113c579c0 20 remove_watcher() i=0 2024-09-12T00:19:05.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa113c579c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94892301541072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x564dd5ec25a0 2024-09-12T00:19:05.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94892301541072] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa113c579c0 20 remove_watcher() i=1 2024-09-12T00:19:05.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.753+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94892301545888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x564dd5ec6e00 2024-09-12T00:19:05.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa111f5e640 1 -- 172.21.15.66:0/359214076 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94892301545888] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10403a030 con 0x564dd5ec6e00 2024-09-12T00:19:05.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa113c579c0 20 remove_watcher() i=2 2024-09-12T00:19:05.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94892301549840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x7fa10403d060 2024-09-12T00:19:05.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa11175d640 1 -- 172.21.15.66:0/359214076 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94892301549840] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c0c5030 con 0x7fa10403d060 2024-09-12T00:19:05.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa113c579c0 20 remove_watcher() i=3 2024-09-12T00:19:05.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.757+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94892301543200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x564dd5ec25a0 2024-09-12T00:19:05.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94892301543200] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x564dd5ec25a0 2024-09-12T00:19:05.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa113c579c0 20 remove_watcher() i=4 2024-09-12T00:19:05.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94892301548272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x7fa10c0c8070 2024-09-12T00:19:05.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94892301548272] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa113c579c0 20 remove_watcher() i=5 2024-09-12T00:19:05.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.761+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94892301552816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed24c0 con 0x7fa10c0c8070 2024-09-12T00:19:05.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94892301552816] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 20 remove_watcher() i=6 2024-09-12T00:19:05.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94892301556384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564dd5ed0cb0 con 0x7fa10c0c8070 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94892301556384] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10803b040 con 0x7fa10c0c8070 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 20 remove_watcher() i=7 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa10c0c8070 msgr2=0x7fa10c0a4620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa10c0c8070 0x7fa10c0a4620 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5ec25a0 msgr2=0x564dd5ec4a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5ec25a0 0x564dd5ec4a30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa10403d060 msgr2=0x7fa104023a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa10403d060 0x7fa104023a10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5ec6e00 msgr2=0x564dd5ec91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5ec6e00 0x564dd5ec91f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fdc039a70 msgr2=0x7f9fdc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fdc039a70 0x7f9fdc03bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x564dd5e89c30 tx=0x7fa10c0e3000 comp rx=0 tx=0).stop 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 msgr2=0x564dd5eb7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/359214076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5eafb80 0x564dd5eb7000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa104018fd0 tx=0x7fa1040500b0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa110f5c640 1 -- 172.21.15.66:0/359214076 reap_dead start 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 shutdown_connections 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 >> 172.21.15.66:0/359214076 conn(0x564dd5eabfb0 msgr2=0x564dd5eaa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 shutdown_connections 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/359214076 wait complete. 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 msgr2=0x7f9fe803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 0x7f9fe803bf30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0c6ce0 tx=0x7fa10c0bfe70 comp rx=0 tx=0).stop 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 msgr2=0x564dd5ea36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x564dd5e896e0 tx=0x7fa10400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 shutdown_connections 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9fe8039a70 0x7f9fe803bf30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/3451478465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5ea32c0 0x564dd5ea36e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 >> 172.21.15.66:0/3451478465 conn(0x564dd5e98c70 msgr2=0x564dd5e99050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 shutdown_connections 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/3451478465 wait complete. 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 msgr2=0x564dd5e8f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 0x564dd5e8f940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 msgr2=0x564dd5e944a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 0x564dd5e944a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 msgr2=0x7f9ff803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 0x7f9ff803bf30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa108001e90 tx=0x7fa1080013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 msgr2=0x564dd5e88870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.765+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa10c01aec0 tx=0x7fa10c017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 shutdown_connections 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564dd5e920b0 0x564dd5e944a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564dd5d06060 0x564dd5e8f940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9ff8039a70 0x7f9ff803bf30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 --2- 172.21.15.66:0/729978670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564dd5d04a60 0x564dd5e88870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 >> 172.21.15.66:0/729978670 conn(0x564dd5d8b040 msgr2=0x564dd5e7bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 shutdown_connections 2024-09-12T00:19:05.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.769+0000 7fa113c579c0 1 -- 172.21.15.66:0/729978670 wait complete. 2024-09-12T00:19:05.783 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:05.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T00:19:05.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T00:19:05.784 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T00:19:05.860 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:05.860 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:05.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af627a9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b25c01d060 0x55b25c01d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af627a9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b25bf5a9c0 con 0x55b25c01ba60 2024-09-12T00:19:05.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af627a9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55b25bfaa6d0 con 0x55b25c01d060 2024-09-12T00:19:05.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af3d80640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b25c01d060 0x55b25c01d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af357f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55b25c01ba60 0x55b25c01be70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36190/0 (socket says 172.21.15.66:36190) 2024-09-12T00:19:05.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af3d80640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b25c01d060 0x55b25c01d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54098/0 (socket says 172.21.15.66:54098) 2024-09-12T00:19:05.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af357f640 1 -- 172.21.15.66:0/1628688939 learned_addr learned my addr 172.21.15.66:0/1628688939 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:05.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af3d80640 1 -- 172.21.15.66:0/1628688939 >> v1:172.21.15.31:6789/0 conn(0x55b25c01ba60 legacy=0x55b25c01be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.857+0000 7f3af3d80640 1 -- 172.21.15.66:0/1628688939 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25bf4eca0 con 0x55b25c01d060 2024-09-12T00:19:05.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af3d80640 1 --2- 172.21.15.66:0/1628688939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01d060 0x55b25c01d440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00a420 tx=0x7f3aec01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852e07908d2f756c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af2d7e640 1 -- 172.21.15.66:0/1628688939 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0af070 con 0x55b25c01d060 2024-09-12T00:19:05.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af2d7e640 1 -- 172.21.15.66:0/1628688939 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec0aa530 con 0x55b25c01d060 2024-09-12T00:19:05.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af2d7e640 1 -- 172.21.15.66:0/1628688939 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0aa850 con 0x55b25c01d060 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 -- 172.21.15.66:0/1628688939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01d060 msgr2=0x55b25c01d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/1628688939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01d060 0x55b25c01d440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00a420 tx=0x7f3aec01afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 -- 172.21.15.66:0/1628688939 shutdown_connections 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/1628688939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01d060 0x55b25c01d440 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 -- 172.21.15.66:0/1628688939 >> 172.21.15.66:0/1628688939 conn(0x55b25c0a2040 msgr2=0x55b25c0a4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 -- 172.21.15.66:0/1628688939 shutdown_connections 2024-09-12T00:19:05.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.861+0000 7f3af627a9c0 1 -- 172.21.15.66:0/1628688939 wait complete. 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af627a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af627a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b25bfae680 con 0x55b25c01ba60 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af3d80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af3d80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54100/0 (socket says 172.21.15.66:54100) 2024-09-12T00:19:05.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af3d80640 1 -- 172.21.15.66:0/422889524 learned_addr learned my addr 172.21.15.66:0/422889524 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af3d80640 1 -- 172.21.15.66:0/422889524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25bf29da0 con 0x55b25c01ba60 2024-09-12T00:19:05.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.877+0000 7f3af3d80640 1 --2- 172.21.15.66:0/422889524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0aa500 tx=0x7f3aec003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbcf4ae35d4640c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39e1e0b640 1 -- 172.21.15.66:0/422889524 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0af040 con 0x55b25c01ba60 2024-09-12T00:19:05.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39e1e0b640 1 -- 172.21.15.66:0/422889524 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec0aba90 con 0x55b25c01ba60 2024-09-12T00:19:05.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39e1e0b640 1 -- 172.21.15.66:0/422889524 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0abd70 con 0x55b25c01ba60 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/422889524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 msgr2=0x55b25c193d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/422889524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0aa500 tx=0x7f3aec003340 comp rx=0 tx=0).stop 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/422889524 shutdown_connections 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/422889524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c193d20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/422889524 >> 172.21.15.66:0/422889524 conn(0x55b25c0a2040 msgr2=0x55b25c18f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/422889524 shutdown_connections 2024-09-12T00:19:05.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/422889524 wait complete. 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b25bf50a50 con 0x55b25c01ba60 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af3d80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af3d80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54108/0 (socket says 172.21.15.66:54108) 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af3d80640 1 -- 172.21.15.66:0/3127701980 learned_addr learned my addr 172.21.15.66:0/3127701980 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af3d80640 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c19b6b0 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af3d80640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01b4b0 tx=0x55b25c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39dbfff640 1 -- 172.21.15.66:0/3127701980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0af040 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25c19b940 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39dbfff640 1 -- 172.21.15.66:0/3127701980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aec0c1070 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f39dbfff640 1 -- 172.21.15.66:0/3127701980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aec0b3a90 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.881+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25c19c2f0 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f39dbfff640 1 -- 172.21.15.66:0/3127701980 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3aec0b3cc0 con 0x55b25c01ba60 2024-09-12T00:19:05.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f39dbfff640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 0x7f39dc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f39dbfff640 1 -- 172.21.15.66:0/3127701980 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3aec0eaad0 con 0x55b25c01ba60 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af357f640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 0x7f39dc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 0x55b25c1a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1a2800 con 0x55b25c01d060 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af4581640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 0x55b25c1a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af357f640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 0x7f39dc03bf80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8004180 tx=0x7f3ae8001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af4581640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 0x55b25c1a22c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af4581640 1 -- 172.21.15.66:0/3127701980 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae40083f0 con 0x55b25c01d060 2024-09-12T00:19:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c19c650 con 0x55b25c01d060 2024-09-12T00:19:05.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af4581640 1 -- 172.21.15.66:0/3127701980 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ae40083f0 con 0x55b25c01d060 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 0x55b25c1a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1a75d0 con 0x55b25c1a4aa0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af3d80640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 0x55b25c1a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af3d80640 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 0x55b25c1a6e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af3d80640 1 -- 172.21.15.66:0/3127701980 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3aec0cd070 con 0x55b25c1a4aa0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1a3910 con 0x55b25c01d060 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af4581640 1 -- 172.21.15.66:0/3127701980 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ae40083f0 con 0x55b25c01d060 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.885+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1a3d80 con 0x55b25c1a4aa0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af3d80640 1 -- 172.21.15.66:0/3127701980 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3aec0cd070 con 0x55b25c1a4aa0 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b25bfbb450 con 0x55b25c1b5cc0 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54120/0 (socket says 172.21.15.66:54120) 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af4581640 1 -- 172.21.15.66:0/3162668192 learned_addr learned my addr 172.21.15.66:0/3162668192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af4581640 1 -- 172.21.15.66:0/3162668192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c1b6720 con 0x55b25c1b5cc0 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af4581640 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55b25c19c4e0 tx=0x7f3ae400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f39d97fa640 1 -- 172.21.15.66:0/3162668192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae401c020 con 0x55b25c1b5cc0 2024-09-12T00:19:05.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25c1b6f80 con 0x55b25c1b5cc0 2024-09-12T00:19:05.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f39d97fa640 1 -- 172.21.15.66:0/3162668192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4007d00 con 0x55b25c1b5cc0 2024-09-12T00:19:05.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f39d97fa640 1 -- 172.21.15.66:0/3162668192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4018440 con 0x55b25c1b5cc0 2024-09-12T00:19:05.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25c1b74f0 con 0x55b25c1b5cc0 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.889+0000 7f39d97fa640 1 -- 172.21.15.66:0/3162668192 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ae401f020 con 0x55b25c1b5cc0 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f39d97fa640 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 0x7f39cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f39d97fa640 1 -- 172.21.15.66:0/3162668192 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3ae4051d60 con 0x55b25c1b5cc0 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af3d80640 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 0x7f39cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af3d80640 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 0x7f39cc03bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55b25c19c9f0 tx=0x7f3aec0d3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b25c194490 con 0x55b25c1c3590 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54128/0 (socket says 172.21.15.66:54128) 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af4581640 1 -- 172.21.15.66:0/3508276819 learned_addr learned my addr 172.21.15.66:0/3508276819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af4581640 1 -- 172.21.15.66:0/3508276819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c1c3f80 con 0x55b25c1c3590 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af4581640 1 --2- 172.21.15.66:0/3508276819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40501a0 tx=0x7f3ae4043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2398a5cf673607b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f39d2ffd640 1 -- 172.21.15.66:0/3508276819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4016e00 con 0x55b25c1c3590 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f39d2ffd640 1 -- 172.21.15.66:0/3508276819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4021400 con 0x55b25c1c3590 2024-09-12T00:19:05.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f39d2ffd640 1 -- 172.21.15.66:0/3508276819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4018b50 con 0x55b25c1c3590 2024-09-12T00:19:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3508276819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 msgr2=0x55b25c1c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3508276819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40501a0 tx=0x7f3ae4043110 comp rx=0 tx=0).stop 2024-09-12T00:19:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3508276819 shutdown_connections 2024-09-12T00:19:05.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3508276819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c3990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3508276819 >> 172.21.15.66:0/3508276819 conn(0x55b25c1be9b0 msgr2=0x55b25c1bcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3508276819 shutdown_connections 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3508276819 wait complete. 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 Processor -- start 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- start start 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.893+0000 7f3af627a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b25c1c24e0 con 0x55b25c1c3590 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af4581640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54142/0 (socket says 172.21.15.66:54142) 2024-09-12T00:19:05.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 learned_addr learned my addr 172.21.15.66:0/2590750403 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c1c9ff0 con 0x55b25c1c3590 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af4581640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c9a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4008fd0 tx=0x7f3ae4050100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 -- 172.21.15.66:0/2590750403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4016e00 con 0x55b25c1c3590 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b25c1ca280 con 0x55b25c1c3590 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 -- 172.21.15.66:0/2590750403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4028300 con 0x55b25c1c3590 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 -- 172.21.15.66:0/2590750403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4028600 con 0x55b25c1c3590 2024-09-12T00:19:05.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25c1cac30 con 0x55b25c1c3590 2024-09-12T00:19:05.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 -- 172.21.15.66:0/2590750403 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3ae4016040 con 0x55b25c1c3590 2024-09-12T00:19:05.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39bc039a70 0x7f39bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f39d17fa640 1 -- 172.21.15.66:0/2590750403 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f3ae4032070 con 0x55b25c1c3590 2024-09-12T00:19:05.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af3d80640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39bc039a70 0x7f39bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c1d5000 0x55b25c1d7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1d7be0 con 0x55b25c1d5000 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af357f640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c1d5000 0x55b25c1d7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af3d80640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39bc039a70 0x7f39bc03bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0b24e0 tx=0x7f3aec0b3c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af357f640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c1d5000 0x55b25c1d7490 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae800e640 con 0x55b25c1d5000 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 20 realm 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.897+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1d43b0 con 0x55b25c1d5000 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae800e640 con 0x55b25c1d5000 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1d86e0 con 0x55b25c1d5000 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae800e640 con 0x55b25c1d5000 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1d8fb0 con 0x55b25c1d5000 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ae800e640 con 0x55b25c1d5000 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1d99d0 0x55b25c1dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1dc490 con 0x55b25c1d99d0 2024-09-12T00:19:05.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1d99d0 0x55b25c1dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1d99d0 0x55b25c1dbdc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 20 searching for the correct realm 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3ae4021020 0x7f3ae402a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3ae4021020 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af3d80640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3ae4021020 0x7f3ae402a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af3d80640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3ae4021020 0x7f3ae402a3e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af3d80640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3aec0ea5c0 0x7f3aec0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:05.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.901+0000 7f3af357f640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3aec0ea5c0 0x7f3aec0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:05.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3aec0ea5c0 0x7f3aec0a9570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:05.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae800e640 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae800e640 con 0x55b25c1d5000 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3ae4021020 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.905+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3ae4021020 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.909+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3ae4021020 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d5000 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddd60 con 0x55b25c1d99d0 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x7f3ae4021020 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x55b25c1d99d0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.913+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x55b25c1d5000 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3ae4065040 con 0x7f3ae4021020 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1dce10 con 0x55b25c1d5000 2024-09-12T00:19:05.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1dd6b0 con 0x55b25c1d5000 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1ddad0 con 0x55b25c1d99d0 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 zone default found 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 4 Realm: () 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:05.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 zonegroup default 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1de190 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1dff70 con 0x55b25c1d99d0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e03a0 con 0x55b25c1d99d0 2024-09-12T00:19:05.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:05.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 started sync module instance, tier type = 2024-09-12T00:19:05.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:05.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.917+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1df410 con 0x7f3ae4021020 2024-09-12T00:19:05.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94224538005344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e03a0 con 0x7f3ae4021020 2024-09-12T00:19:05.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e0c30 con 0x55b25c1d5000 2024-09-12T00:19:05.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94224538005344] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94224538007600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e0850 con 0x55b25c1d5000 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.921+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e1640 con 0x55b25c1d99d0 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94224538014096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e15b0 con 0x55b25c1d99d0 2024-09-12T00:19:05.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2590 con 0x7f3ae4021020 2024-09-12T00:19:05.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94224538007600] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94224538017920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2550 con 0x7f3ae4021020 2024-09-12T00:19:05.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2fd0 con 0x55b25c1d5000 2024-09-12T00:19:05.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94224538014096] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.925+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94224538017920] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94224538010528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2b20 con 0x55b25c1d5000 2024-09-12T00:19:05.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e33b0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94224538010528] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94224538016304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2fd0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.929+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e3dc0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94224538016304] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94224538020912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e3dc0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e4780 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94224538026704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e4ba0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=0 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=1 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=2 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=3 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=4 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=5 2024-09-12T00:19:05.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94224538020912] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.933+0000 7f3af627a9c0 20 add_watcher() i=6 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94224538026704] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 add_watcher() i=7 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e3960 con 0x55b25c1d5000 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94224538024240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e4fd0 con 0x55b25c1d5000 2024-09-12T00:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94224538024240] v31'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f39a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 5 note: GC not initialized 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f39a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 Filter name: none 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f39227fc640 20 reqs_thread_entry: start 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:05.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:05.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.937+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c20b170 con 0x55b25c1d5000 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c20dc00 con 0x7f3ae4021020 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c211820 con 0x55b25c1d5000 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94224538210960 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b25c210370 con 0x55b25c1d5000 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94224538010528 notify 133143986178 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b25bf5a9c0 con 0x55b25c1d5000 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f39d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94224538010528 notifier 4327 bl.length()=567 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f39d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f39d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify cookie 94224538210960 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f39d2ffd640 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f39b8003eb0 con 0x55b25c1d5000 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.941+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94224538210960 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3ae802d8a0 con 0x55b25c1d5000 2024-09-12T00:19:05.949 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:05.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f39a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:05.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94224538024240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c210370 con 0x55b25c1d5000 2024-09-12T00:19:05.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94224538024240] v31'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94224538005344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c210370 con 0x7f3ae4021020 2024-09-12T00:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94224538005344] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af627a9c0 20 remove_watcher() i=0 2024-09-12T00:19:05.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af627a9c0 2 removed watcher, disabling cache 2024-09-12T00:19:05.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.945+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94224538007600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c210370 con 0x55b25c1d5000 2024-09-12T00:19:05.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94224538007600] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af627a9c0 20 remove_watcher() i=1 2024-09-12T00:19:05.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94224538014096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e3930 con 0x55b25c1d99d0 2024-09-12T00:19:05.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af4581640 1 -- 172.21.15.66:0/2590750403 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94224538014096] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae403c020 con 0x55b25c1d99d0 2024-09-12T00:19:05.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af627a9c0 20 remove_watcher() i=2 2024-09-12T00:19:05.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.949+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94224538017920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e1190 con 0x7f3ae4021020 2024-09-12T00:19:05.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af3d80640 1 -- 172.21.15.66:0/2590750403 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94224538017920] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aec0cd070 con 0x7f3ae4021020 2024-09-12T00:19:05.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af627a9c0 20 remove_watcher() i=3 2024-09-12T00:19:05.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94224538010528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e3930 con 0x55b25c1d5000 2024-09-12T00:19:05.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94224538010528] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x55b25c1d5000 2024-09-12T00:19:05.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af627a9c0 20 remove_watcher() i=4 2024-09-12T00:19:05.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.953+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94224538016304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e2080 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94224538016304] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af627a9c0 20 remove_watcher() i=5 2024-09-12T00:19:05.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94224538020912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e1190 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94224538020912] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af627a9c0 20 remove_watcher() i=6 2024-09-12T00:19:05.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.957+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94224538026704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b25c1e03a0 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94224538026704] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae8029040 con 0x7f3aec0ea5c0 2024-09-12T00:19:05.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 20 remove_watcher() i=7 2024-09-12T00:19:05.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3aec0ea5c0 msgr2=0x7f3aec0a9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3aec0ea5c0 0x7f3aec0a9570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c1d5000 msgr2=0x55b25c1d7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c1d5000 0x55b25c1d7490 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3ae4021020 msgr2=0x7f3ae402a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3ae4021020 0x7f3ae402a3e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1d99d0 msgr2=0x55b25c1dbdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1d99d0 0x55b25c1dbdc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39bc039a70 msgr2=0x7f39bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39bc039a70 0x7f39bc03bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0b24e0 tx=0x7f3aec0b3c30 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 msgr2=0x55b25c1c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/2590750403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1c3590 0x55b25c1c9a90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4008fd0 tx=0x7f3ae4050100 comp rx=0 tx=0).stop 2024-09-12T00:19:05.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af357f640 1 -- 172.21.15.66:0/2590750403 reap_dead start 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 shutdown_connections 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 >> 172.21.15.66:0/2590750403 conn(0x55b25c1be9b0 msgr2=0x55b25c1bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 shutdown_connections 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/2590750403 wait complete. 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 msgr2=0x7f39cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 0x7f39cc03bf30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55b25c19c9f0 tx=0x7f3aec0d3040 comp rx=0 tx=0).stop 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 msgr2=0x55b25c1b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55b25c19c4e0 tx=0x7f3ae400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 shutdown_connections 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39cc039a70 0x7f39cc03bf30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3162668192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c1b5cc0 0x55b25c1b60e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 >> 172.21.15.66:0/3162668192 conn(0x55b25c1ab670 msgr2=0x55b25c1aba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 shutdown_connections 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3162668192 wait complete. 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 msgr2=0x55b25c1a22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 0x55b25c1a22c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 msgr2=0x55b25c1a6e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 0x55b25c1a6e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 msgr2=0x7f39dc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 0x7f39dc03bf80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8004180 tx=0x7f3ae8001340 comp rx=0 tx=0).stop 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 msgr2=0x55b25c19b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3aec01b4b0 tx=0x55b25c01c9a0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 shutdown_connections 2024-09-12T00:19:05.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b25c1a4aa0 0x55b25c1a6e90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b25c01d060 0x55b25c1a22c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39dc039ac0 0x7f39dc03bf80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 --2- 172.21.15.66:0/3127701980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b25c01ba60 0x55b25c19b150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 >> 172.21.15.66:0/3127701980 conn(0x55b25c0a2040 msgr2=0x55b25c18e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 shutdown_connections 2024-09-12T00:19:05.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:05.961+0000 7f3af627a9c0 1 -- 172.21.15.66:0/3127701980 wait complete. 2024-09-12T00:19:05.979 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:05.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:05.980 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:06.057 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:06.058 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:06.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cf3f09c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557075f94770 0x557075f94b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cf3f09c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557075e469c0 con 0x557075f978b0 2024-09-12T00:19:06.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cf3f09c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557075e966d0 con 0x557075f94770 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35ccef6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557075f94770 0x557075f94b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cc6f5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x557075f978b0 0x557075f99ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36196/0 (socket says 172.21.15.66:36196) 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35ccef6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557075f94770 0x557075f94b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54146/0 (socket says 172.21.15.66:54146) 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.053+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2905385678 learned_addr learned my addr 172.21.15.66:0/2905385678 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35ccef6640 1 -- 172.21.15.66:0/2905385678 >> v1:172.21.15.31:6789/0 conn(0x557075f978b0 legacy=0x557075f99ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35ccef6640 1 -- 172.21.15.66:0/2905385678 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557075e3aca0 con 0x557075f94770 2024-09-12T00:19:06.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2905385678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x557075f94b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00a480 tx=0x7f35bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bd11405c7dc7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cbef4640 1 -- 172.21.15.66:0/2905385678 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0b0070 con 0x557075f94770 2024-09-12T00:19:06.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cbef4640 1 -- 172.21.15.66:0/2905385678 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc0ab540 con 0x557075f94770 2024-09-12T00:19:06.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cbef4640 1 -- 172.21.15.66:0/2905385678 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0ab840 con 0x557075f94770 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2905385678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 msgr2=0x557075f94b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2905385678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x557075f94b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00a480 tx=0x7f35bc01b280 comp rx=0 tx=0).stop 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2905385678 shutdown_connections 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2905385678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x557075f94b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2905385678 >> 172.21.15.66:0/2905385678 conn(0x557075f08080 msgr2=0x557075f08490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2905385678 shutdown_connections 2024-09-12T00:19:06.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.057+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2905385678 wait complete. 2024-09-12T00:19:06.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.073+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.073+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.073+0000 7f35cf3f09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.073+0000 7f35cf3f09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557075e9a680 con 0x557075f94770 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54152/0 (socket says 172.21.15.66:54152) 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 -- 172.21.15.66:0/3921736607 learned_addr learned my addr 172.21.15.66:0/3921736607 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 -- 172.21.15.66:0/3921736607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557075e15da0 con 0x557075f94770 2024-09-12T00:19:06.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 --2- 172.21.15.66:0/3921736607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35bc018eb0 tx=0x7f35bc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a400532592bbb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f34bae0d640 1 -- 172.21.15.66:0/3921736607 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0b0070 con 0x557075f94770 2024-09-12T00:19:06.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f34bae0d640 1 -- 172.21.15.66:0/3921736607 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc0b1040 con 0x557075f94770 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f34bae0d640 1 -- 172.21.15.66:0/3921736607 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0ab6f0 con 0x557075f94770 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/3921736607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 msgr2=0x55707607fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/3921736607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f35bc018eb0 tx=0x7f35bc003030 comp rx=0 tx=0).stop 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/3921736607 shutdown_connections 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/3921736607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f94770 0x55707607fa20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/3921736607 >> 172.21.15.66:0/3921736607 conn(0x557075f08080 msgr2=0x55707607b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/3921736607 shutdown_connections 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/3921736607 wait complete. 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35cf3f09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557075e3ca50 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54168/0 (socket says 172.21.15.66:54168) 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 -- 172.21.15.66:0/2543979693 learned_addr learned my addr 172.21.15.66:0/2543979693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.077+0000 7f35ccef6640 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557076087740 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0ab510 tx=0x7f35bc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 -- 172.21.15.66:0/2543979693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0c4070 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 -- 172.21.15.66:0/2543979693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc0b75b0 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570760879d0 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 -- 172.21.15.66:0/2543979693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0b7890 con 0x557075f978b0 2024-09-12T00:19:06.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557076088290 con 0x557075f978b0 2024-09-12T00:19:06.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 -- 172.21.15.66:0/2543979693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f35bc0c7070 con 0x557075f978b0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 0x7f34b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f34b960a640 1 -- 172.21.15.66:0/2543979693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f35bc0bc070 con 0x557075f978b0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 0x7f34b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 0x55707608e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55707608eb80 con 0x55707608c250 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 0x55707608e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 0x7f34b403bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35b4004180 tx=0x7f35b4001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 0x55707608e640 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2543979693 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x55707608c250 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55707608ef60 con 0x55707608c250 2024-09-12T00:19:06.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2543979693 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35c400a4d0 con 0x55707608c250 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 0x557076093130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557076093870 con 0x557076090d40 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.081+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 0x557076093130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 0x557076093130 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35ccef6640 1 -- 172.21.15.66:0/2543979693 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f35bc0d0070 con 0x557076090d40 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55707608fbb0 con 0x55707608c250 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2543979693 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35c400a4d0 con 0x55707608c250 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557076090060 con 0x557076090d40 2024-09-12T00:19:06.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35ccef6640 1 -- 172.21.15.66:0/2543979693 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35bc0d0070 con 0x557076090d40 2024-09-12T00:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557075ea7450 con 0x5570760a1f60 2024-09-12T00:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54182/0 (socket says 172.21.15.66:54182) 2024-09-12T00:19:06.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 -- 172.21.15.66:0/4027959797 learned_addr learned my addr 172.21.15.66:0/4027959797 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 -- 172.21.15.66:0/4027959797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570760a29c0 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557076087f60 tx=0x7f35c40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f34b27fc640 1 -- 172.21.15.66:0/4027959797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c4013640 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f34b27fc640 1 -- 172.21.15.66:0/4027959797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c40137e0 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570760a3220 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f34b27fc640 1 -- 172.21.15.66:0/4027959797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c4013ae0 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.085+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570760a3790 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34b27fc640 1 -- 172.21.15.66:0/4027959797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f35c4011040 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34b27fc640 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 0x7f34a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34b27fc640 1 -- 172.21.15.66:0/4027959797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f35c400e040 con 0x5570760a1f60 2024-09-12T00:19:06.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35ccef6640 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 0x7f34a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35ccef6640 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 0x7f34a403bf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0eb0f0 tx=0x7f35bc0e94a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cf3f09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cf3f09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557076080190 con 0x5570760af910 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54192/0 (socket says 172.21.15.66:54192) 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cd6f7640 1 -- 172.21.15.66:0/4153254142 learned_addr learned my addr 172.21.15.66:0/4153254142 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cd6f7640 1 -- 172.21.15.66:0/4153254142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570760b0300 con 0x5570760af910 2024-09-12T00:19:06.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/4153254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f35c4029540 tx=0x7f35c4050bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869e595e71838672 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34a3fff640 1 -- 172.21.15.66:0/4153254142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c4041e60 con 0x5570760af910 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34a3fff640 1 -- 172.21.15.66:0/4153254142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c401f340 con 0x5570760af910 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.089+0000 7f34a3fff640 1 -- 172.21.15.66:0/4153254142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c4013c80 con 0x5570760af910 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4153254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 msgr2=0x5570760afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4153254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f35c4029540 tx=0x7f35c4050bc0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4153254142 shutdown_connections 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4153254142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760afd10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4153254142 >> 172.21.15.66:0/4153254142 conn(0x5570760aad30 msgr2=0x5570760a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4153254142 shutdown_connections 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4153254142 wait complete. 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 Processor -- start 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- start start 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5570760ae860 con 0x5570760af910 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cd6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54198/0 (socket says 172.21.15.66:54198) 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 learned_addr learned my addr 172.21.15.66:0/2268821664 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570760b62f0 con 0x5570760af910 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760b5d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c404b010 tx=0x7f35c4050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 -- 172.21.15.66:0/2268821664 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c402e070 con 0x5570760af910 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570760b62f0 con 0x5570760af910 2024-09-12T00:19:06.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 -- 172.21.15.66:0/2268821664 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c4045030 con 0x5570760af910 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 -- 172.21.15.66:0/2268821664 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35c404f2a0 con 0x5570760af910 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570760b62f0 con 0x5570760af910 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 -- 172.21.15.66:0/2268821664 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f35c40520d0 con 0x5570760af910 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3498039a70 0x7f349803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f34a27fc640 1 -- 172.21.15.66:0/2268821664 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f35c404f890 con 0x5570760af910 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3498039a70 0x7f349803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570760c0fb0 0x5570760c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.093+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c3b90 con 0x5570760c0fb0 2024-09-12T00:19:06.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570760c0fb0 0x5570760c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3498039a70 0x7f349803bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35bc01b0b0 tx=0x7f35bc0db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570760c0fb0 0x5570760c3440 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35b400e640 con 0x5570760c0fb0 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 realm 2024-09-12T00:19:06.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c0360 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35b400e640 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c4690 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35b400e640 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c4f60 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35b400e640 con 0x5570760c0fb0 2024-09-12T00:19:06.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570760c5810 0x5570760c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c8340 con 0x5570760c5810 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570760c5810 0x5570760c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570760c5810 0x5570760c7c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 20 searching for the correct realm 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f35c4033460 0x7f35c40143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f35c4033460 0x7f35c40143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f35c4033460 0x7f35c40143c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f35bc0c9070 0x7f35bc0bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.097+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f35bc0c9070 0x7f35bc0bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f35bc0c9070 0x7f35bc0bf3c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b400e640 con 0x7f35bc0c9070 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b400e640 con 0x5570760c0fb0 2024-09-12T00:19:06.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.101+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.105+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.109+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c5810 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35bc0c9070 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x5570760c0fb0 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9c60 con 0x7f35c4033460 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c8d50 con 0x5570760c0fb0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c95f0 con 0x5570760c0fb0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c8990 con 0x5570760c5810 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 zone default found 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 4 Realm: () 2024-09-12T00:19:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 zonegroup default 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760c9220 con 0x7f35bc0c9070 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.113+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760cc060 con 0x5570760c5810 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760cc4f0 con 0x5570760c5810 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 20 started sync module instance, tier type = 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:06.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb4d0 con 0x7f35c4033460 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93941505243328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cce00 con 0x7f35c4033460 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cd650 con 0x5570760c0fb0 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.117+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93941505243328] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93941505247568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cd690 con 0x5570760c0fb0 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760ce160 con 0x5570760c5810 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93941505247568] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93941505252432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760ce120 con 0x5570760c5810 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.121+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760ceba0 con 0x7f35c4033460 2024-09-12T00:19:06.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93941505255152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cf3f0 con 0x7f35c4033460 2024-09-12T00:19:06.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cfe70 con 0x5570760c0fb0 2024-09-12T00:19:06.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93941505252432] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93941505255152] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93941505257280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cd1a0 con 0x5570760c0fb0 2024-09-12T00:19:06.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.125+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0710 con 0x7f35bc0c9070 2024-09-12T00:19:06.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93941505257280] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93941505259872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0690 con 0x7f35bc0c9070 2024-09-12T00:19:06.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d1050 con 0x7f35bc0c9070 2024-09-12T00:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93941505264544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d1470 con 0x7f35bc0c9070 2024-09-12T00:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d1f60 con 0x7f35bc0c9070 2024-09-12T00:19:06.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.129+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93941505259872] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93941505264544] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93941505268272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0fc0 con 0x7f35bc0c9070 2024-09-12T00:19:06.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=0 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=1 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=2 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=3 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=4 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=5 2024-09-12T00:19:06.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=6 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93941505268272] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 20 add_watcher() i=7 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.133+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0fc0 con 0x5570760c0fb0 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93941505261968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d2750 con 0x5570760c0fb0 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93941505261968] v31'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f3482fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 5 note: GC not initialized 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f3481fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:06.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 Filter name: none 2024-09-12T00:19:06.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f33f37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:06.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5570760f7f60 con 0x5570760c0fb0 2024-09-12T00:19:06.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.143 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:06.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.137+0000 7f35cf3f09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:06.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f3482fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93941505261968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760f6dd0 con 0x5570760c0fb0 2024-09-12T00:19:06.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93941505261968] v31'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93941505243328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0190 con 0x7f35c4033460 2024-09-12T00:19:06.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93941505243328] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cf3f09c0 20 remove_watcher() i=0 2024-09-12T00:19:06.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cf3f09c0 2 removed watcher, disabling cache 2024-09-12T00:19:06.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.141+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93941505247568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x5570760c0fb0 2024-09-12T00:19:06.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93941505247568] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cf3f09c0 20 remove_watcher() i=1 2024-09-12T00:19:06.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93941505252432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x5570760c5810 2024-09-12T00:19:06.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cd6f7640 1 -- 172.21.15.66:0/2268821664 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93941505252432] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x5570760c5810 2024-09-12T00:19:06.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cf3f09c0 20 remove_watcher() i=2 2024-09-12T00:19:06.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.145+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93941505255152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x7f35c4033460 2024-09-12T00:19:06.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35ccef6640 1 -- 172.21.15.66:0/2268821664 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93941505255152] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc0d0070 con 0x7f35c4033460 2024-09-12T00:19:06.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35cf3f09c0 20 remove_watcher() i=3 2024-09-12T00:19:06.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93941505257280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x5570760c0fb0 2024-09-12T00:19:06.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93941505257280] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x5570760c0fb0 2024-09-12T00:19:06.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35cf3f09c0 20 remove_watcher() i=4 2024-09-12T00:19:06.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.149+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93941505259872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x7f35bc0c9070 2024-09-12T00:19:06.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93941505259872] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cf3f09c0 20 remove_watcher() i=5 2024-09-12T00:19:06.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93941505264544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760cb8c0 con 0x7f35bc0c9070 2024-09-12T00:19:06.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93941505264544] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cf3f09c0 20 remove_watcher() i=6 2024-09-12T00:19:06.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.153+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93941505268272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5570760d0ba0 con 0x7f35bc0c9070 2024-09-12T00:19:06.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93941505268272] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b4029040 con 0x7f35bc0c9070 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 20 remove_watcher() i=7 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f35bc0c9070 msgr2=0x7f35bc0bf3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f35bc0c9070 0x7f35bc0bf3c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570760c0fb0 msgr2=0x5570760c3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5570760c0fb0 0x5570760c3440 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f35c4033460 msgr2=0x7f35c40143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f35c4033460 0x7f35c40143c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570760c5810 msgr2=0x5570760c7c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5570760c5810 0x5570760c7c00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3498039a70 msgr2=0x7f349803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3498039a70 0x7f349803bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35bc01b0b0 tx=0x7f35bc0db000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 msgr2=0x5570760b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2268821664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760af910 0x5570760b5d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c404b010 tx=0x7f35c4050880 comp rx=0 tx=0).stop 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 reap_dead start 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cc6f5640 1 -- 172.21.15.66:0/2268821664 reap_dead start 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 shutdown_connections 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 >> 172.21.15.66:0/2268821664 conn(0x5570760aad30 msgr2=0x5570760a8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 shutdown_connections 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2268821664 wait complete. 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 msgr2=0x7f34a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 0x7f34a403bf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0eb0f0 tx=0x7f35bc0e94a0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 msgr2=0x5570760a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557076087f60 tx=0x7f35c40167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 shutdown_connections 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34a4039a70 0x7f34a403bf30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/4027959797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5570760a1f60 0x5570760a2380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 >> 172.21.15.66:0/4027959797 conn(0x557076097910 msgr2=0x557076097cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 shutdown_connections 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/4027959797 wait complete. 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 msgr2=0x55707608e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 0x55707608e640 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 msgr2=0x557076093130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 0x557076093130 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 msgr2=0x7f34b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 0x7f34b403bf30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35b4004180 tx=0x7f35b4001340 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 msgr2=0x5570760871e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0ab510 tx=0x7f35bc018020 comp rx=0 tx=0).stop 2024-09-12T00:19:06.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 shutdown_connections 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557076090d40 0x557076093130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55707608c250 0x55707608e640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f34b4039a70 0x7f34b403bf30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 --2- 172.21.15.66:0/2543979693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557075f978b0 0x5570760871e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 >> 172.21.15.66:0/2543979693 conn(0x557075f08080 msgr2=0x55707607a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 shutdown_connections 2024-09-12T00:19:06.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.157+0000 7f35cf3f09c0 1 -- 172.21.15.66:0/2543979693 wait complete. 2024-09-12T00:19:06.174 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:06.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T00:19:06.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T00:19:06.175 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-12T00:19:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:06.259 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2ab179c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563232f14850 0x563232f16c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2ab179c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563232dc29c0 con 0x563232f10700 2024-09-12T00:19:06.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2ab179c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x563232e126d0 con 0x563232f14850 2024-09-12T00:19:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563232f14850 0x563232f16c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563232f14850 0x563232f16c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54206/0 (socket says 172.21.15.66:54206) 2024-09-12T00:19:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 -- 172.21.15.66:0/595202927 learned_addr learned my addr 172.21.15.66:0/595202927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce2861d640 1 --1- 172.21.15.66:0/595202927 >> v1:172.21.15.31:6789/0 conn(0x563232f10700 0x563232f10ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:36208/0 (socket says 172.21.15.66:36208) 2024-09-12T00:19:06.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 -- 172.21.15.66:0/595202927 >> v1:172.21.15.31:6789/0 conn(0x563232f10700 legacy=0x563232f10ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 -- 172.21.15.66:0/595202927 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232db6ca0 con 0x563232f14850 2024-09-12T00:19:06.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.257+0000 7fce27e1c640 1 --2- 172.21.15.66:0/595202927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f14850 0x563232f16c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00a5c0 tx=0x7fce1c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fd2e3eb3dc01a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2761b640 1 -- 172.21.15.66:0/595202927 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c0a9590 con 0x563232f14850 2024-09-12T00:19:06.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2761b640 1 -- 172.21.15.66:0/595202927 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1c0ae070 con 0x563232f14850 2024-09-12T00:19:06.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2761b640 1 -- 172.21.15.66:0/595202927 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1c0a9880 con 0x563232f14850 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 -- 172.21.15.66:0/595202927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f14850 msgr2=0x563232f16c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/595202927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f14850 0x563232f16c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00a5c0 tx=0x7fce1c01b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 -- 172.21.15.66:0/595202927 shutdown_connections 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/595202927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f14850 0x563232f16c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 -- 172.21.15.66:0/595202927 >> 172.21.15.66:0/595202927 conn(0x563232e84010 msgr2=0x563232e84420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 -- 172.21.15.66:0/595202927 shutdown_connections 2024-09-12T00:19:06.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.261+0000 7fce2ab179c0 1 -- 172.21.15.66:0/595202927 wait complete. 2024-09-12T00:19:06.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563232e16680 con 0x563232f10700 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54208/0 (socket says 172.21.15.66:54208) 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 -- 172.21.15.66:0/4018389922 learned_addr learned my addr 172.21.15.66:0/4018389922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 -- 172.21.15.66:0/4018389922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232d91da0 con 0x563232f10700 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 --2- 172.21.15.66:0/4018389922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce18001ec0 tx=0x7fce1800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65eb0d94bde69b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fcd1660c640 1 -- 172.21.15.66:0/4018389922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1800e5d0 con 0x563232f10700 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fcd1660c640 1 -- 172.21.15.66:0/4018389922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1800e770 con 0x563232f10700 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fcd1660c640 1 -- 172.21.15.66:0/4018389922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1800ea70 con 0x563232f10700 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- 172.21.15.66:0/4018389922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 msgr2=0x563232ffba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/4018389922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce18001ec0 tx=0x7fce1800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- 172.21.15.66:0/4018389922 shutdown_connections 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/4018389922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563232ffba80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- 172.21.15.66:0/4018389922 >> 172.21.15.66:0/4018389922 conn(0x563232e84010 msgr2=0x563232ff7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- 172.21.15.66:0/4018389922 shutdown_connections 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- 172.21.15.66:0/4018389922 wait complete. 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2ab179c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563232db8a50 con 0x563232f10700 2024-09-12T00:19:06.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54216/0 (socket says 172.21.15.66:54216) 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.277+0000 7fce2861d640 1 -- 172.21.15.66:0/3020276611 learned_addr learned my addr 172.21.15.66:0/3020276611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2861d640 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632330036d0 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2861d640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563232ffca70 tx=0x7fce18000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 -- 172.21.15.66:0/3020276611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1801a7c0 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 -- 172.21.15.66:0/3020276611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1801a960 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563233003960 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 -- 172.21.15.66:0/3020276611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce1801ac80 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563233004310 con 0x563232f10700 2024-09-12T00:19:06.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 -- 172.21.15.66:0/3020276611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce18017070 con 0x563232f10700 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 0x7fcd1003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fcd14e09640 1 -- 172.21.15.66:0/3020276611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fce18015020 con 0x563232f10700 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce27e1c640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 0x7fcd1003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 0x56323300a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323300a820 con 0x563232f14850 2024-09-12T00:19:06.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce28e1e640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 0x56323300a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce27e1c640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 0x7fcd1003bf80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0ad000 tx=0x7fce1c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce28e1e640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 0x56323300a2e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce28e1e640 1 -- 172.21.15.66:0/3020276611 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce2000a4d0 con 0x563232f14850 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.281+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323300ac40 con 0x563232f14850 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 -- 172.21.15.66:0/3020276611 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce2000a4d0 con 0x563232f14850 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 0x56323300ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323300f530 con 0x56323300ca50 2024-09-12T00:19:06.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2861d640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 0x56323300ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2861d640 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 0x56323300ee40 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2861d640 1 -- 172.21.15.66:0/3020276611 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce1802e070 con 0x56323300ca50 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323300b8f0 con 0x563232f14850 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 -- 172.21.15.66:0/3020276611 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce2000a4d0 con 0x563232f14850 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323300bdd0 con 0x56323300ca50 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2861d640 1 -- 172.21.15.66:0/3020276611 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce1802e070 con 0x56323300ca50 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce2ab179c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563232e23450 con 0x56323301dc80 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54226/0 (socket says 172.21.15.66:54226) 2024-09-12T00:19:06.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 -- 172.21.15.66:0/424180409 learned_addr learned my addr 172.21.15.66:0/424180409 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 -- 172.21.15.66:0/424180409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323301e6e0 con 0x56323301dc80 2024-09-12T00:19:06.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.285+0000 7fce28e1e640 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563233004500 tx=0x7fce200163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 -- 172.21.15.66:0/424180409 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20013450 con 0x56323301dc80 2024-09-12T00:19:06.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 -- 172.21.15.66:0/424180409 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce20013610 con 0x56323301dc80 2024-09-12T00:19:06.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56323301ef40 con 0x56323301dc80 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 -- 172.21.15.66:0/424180409 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20013970 con 0x56323301dc80 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323301f4b0 con 0x56323301dc80 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 -- 172.21.15.66:0/424180409 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce20011040 con 0x56323301dc80 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 0x7fcd0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd0dffb640 1 -- 172.21.15.66:0/424180409 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fce2000e040 con 0x56323301dc80 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2861d640 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 0x7fcd0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2861d640 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 0x7fcd0003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce1804e130 tx=0x7fce1801c660 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce2ab179c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563232ffc2d0 con 0x56323302b5b0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54242/0 (socket says 172.21.15.66:54242) 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce28e1e640 1 -- 172.21.15.66:0/70419136 learned_addr learned my addr 172.21.15.66:0/70419136 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce28e1e640 1 -- 172.21.15.66:0/70419136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323302bfa0 con 0x56323302b5b0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fce28e1e640 1 --2- 172.21.15.66:0/70419136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce20020fd0 tx=0x7fce2001fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4bb0192900c235 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd077fe640 1 -- 172.21.15.66:0/70419136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce2002a440 con 0x56323302b5b0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd077fe640 1 -- 172.21.15.66:0/70419136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2002a5e0 con 0x56323302b5b0 2024-09-12T00:19:06.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.289+0000 7fcd077fe640 1 -- 172.21.15.66:0/70419136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20052200 con 0x56323302b5b0 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/70419136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 msgr2=0x56323302b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/70419136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce20020fd0 tx=0x7fce2001fdc0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/70419136 shutdown_connections 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/70419136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x56323302b9b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/70419136 >> 172.21.15.66:0/70419136 conn(0x5632330269d0 msgr2=0x563233024c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/70419136 shutdown_connections 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/70419136 wait complete. 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 Processor -- start 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- start start 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x5632330319e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56323302a500 con 0x56323302b5b0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x5632330319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce28e1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x5632330319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:54246/0 (socket says 172.21.15.66:54246) 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 learned_addr learned my addr 172.21.15.66:0/2460002579 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563233031f40 con 0x56323302b5b0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce28e1e640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x5632330319e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce2004b010 tx=0x7fce20050890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fcd05ffb640 1 -- 172.21.15.66:0/2460002579 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20037070 con 0x56323302b5b0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632330321d0 con 0x56323302b5b0 2024-09-12T00:19:06.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fcd05ffb640 1 -- 172.21.15.66:0/2460002579 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce20045070 con 0x56323302b5b0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fcd05ffb640 1 -- 172.21.15.66:0/2460002579 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce20050ce0 con 0x56323302b5b0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563233032b80 con 0x56323302b5b0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fcd05ffb640 1 -- 172.21.15.66:0/2460002579 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce2003a070 con 0x56323302b5b0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.293+0000 7fcd05ffb640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccf8039a70 0x7fccf803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fcd05ffb640 1 -- 172.21.15.66:0/2460002579 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fce20017860 con 0x56323302b5b0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2861d640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccf8039a70 0x7fccf803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56323303d160 0x56323303f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56323303fd70 con 0x56323303d160 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56323303d160 0x56323303f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2861d640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccf8039a70 0x7fccf803bf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fce1800fb60 tx=0x7fce18028000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56323303d160 0x56323303f620 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 realm 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330401a0 con 0x56323303d160 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233040a70 con 0x56323303d160 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233040e10 con 0x56323303d160 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563233041b70 0x563233043f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233044570 con 0x563233041b70 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563233041b70 0x563233043f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563233041b70 0x563233043f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 20 searching for the correct realm 2024-09-12T00:19:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fce2003c060 0x7fce2001f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.297+0000 7fce2861d640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fce2003c060 0x7fce2001f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce2861d640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fce2003c060 0x7fce2001f570 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce2861d640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fce18048220 0x7fce1804f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fce18048220 0x7fce1804f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fce18048220 0x7fce1804f760 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.301+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20039030 con 0x563233041b70 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.305+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.309+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x563233041b70 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce18048220 2024-09-12T00:19:06.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x56323303d160 2024-09-12T00:19:06.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563233045e40 con 0x7fce2003c060 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233044fc0 con 0x56323303d160 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233045810 con 0x56323303d160 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330461e0 con 0x563233041b70 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 zone default found 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 4 Realm: () 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:06.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 zonegroup default 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330465f0 con 0x7fce18048220 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233048420 con 0x563233041b70 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.313+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330488e0 con 0x563233041b70 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 20 started sync module instance, tier type = 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5632330478c0 con 0x7fce2003c060 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773604285664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233047520 con 0x7fce2003c060 2024-09-12T00:19:06.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049810 con 0x56323303d160 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773604285664] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773604291424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049c30 con 0x56323303d160 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.317+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304a500 con 0x563233041b70 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773604293680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304a050 con 0x563233041b70 2024-09-12T00:19:06.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304b480 con 0x7fce2003c060 2024-09-12T00:19:06.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773604291424] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773604298608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304b870 con 0x7fce2003c060 2024-09-12T00:19:06.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c230 con 0x56323303d160 2024-09-12T00:19:06.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.321+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773604293680] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773604298608] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773604296944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c230 con 0x56323303d160 2024-09-12T00:19:06.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304cad0 con 0x7fce18048220 2024-09-12T00:19:06.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773604296944] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773604302480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c8a0 con 0x7fce18048220 2024-09-12T00:19:06.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.325+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304d3c0 con 0x7fce18048220 2024-09-12T00:19:06.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773604306576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304d830 con 0x7fce18048220 2024-09-12T00:19:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304e300 con 0x7fce18048220 2024-09-12T00:19:06.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773604302480] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773604306576] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773604310512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304d380 con 0x7fce18048220 2024-09-12T00:19:06.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=0 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=1 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=2 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=3 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=4 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=5 2024-09-12T00:19:06.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.329+0000 7fce2ab179c0 20 add_watcher() i=6 2024-09-12T00:19:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773604310512] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 20 add_watcher() i=7 2024-09-12T00:19:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:06.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233051400 con 0x56323303d160 2024-09-12T00:19:06.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773604303600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304e880 con 0x56323303d160 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773604303600] v31'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fccde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 5 note: GC not initialized 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fccdd7e2640 20 reqs_thread_entry: start 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.333+0000 7fce2ab179c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 20 Filter name: none 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fcc4effd640 20 reqs_thread_entry: start 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330747c0 con 0x56323303d160 2024-09-12T00:19:06.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:06.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233075230 con 0x7fce18048220 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:19:06.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323307b000 con 0x56323303d160 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v31'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94773604493936 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5632330766f0 con 0x56323303d160 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94773604296944 notify 133143986179 ret 0) ==== 720+0+0 (crc 0 0 0) 0x563232db6ca0 con 0x56323303d160 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fcd077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94773604296944 notifier 4341 bl.length()=678 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fcd077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fcd077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fcd077fe640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fccec003eb0 con 0x56323303d160 2024-09-12T00:19:06.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify cookie 94773604493936 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94773604493936 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce1c0b3730 con 0x56323303d160 2024-09-12T00:19:06.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.337+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323307aa70 con 0x7fce18048220 2024-09-12T00:19:06.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce2ab179c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:06.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce2ab179c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:06.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce2ab179c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:06.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94773604493936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563233076240 con 0x563233041b70 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94773604293680 notify 133143986176 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563233032b80 con 0x563233041b70 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fcd06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94773604293680 notifier 4341 bl.length()=177 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fcd06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fcd06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 notify.2 [notify cookie 94773604493936 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fcd06ffd640 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc5c003410 con 0x563233041b70 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== watch-notify(notify_complete (2) cookie 94773604493936 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632330321d0 con 0x563233041b70 2024-09-12T00:19:06.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.341+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.348 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T00:19:06.341823Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:06.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fccde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773604303600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233076480 con 0x56323303d160 2024-09-12T00:19:06.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94773604303600] v31'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773604285664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c2f0 con 0x7fce2003c060 2024-09-12T00:19:06.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94773604285664] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2ab179c0 20 remove_watcher() i=0 2024-09-12T00:19:06.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2ab179c0 2 removed watcher, disabling cache 2024-09-12T00:19:06.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.345+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773604291424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233047ce0 con 0x56323303d160 2024-09-12T00:19:06.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94773604291424] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce2ab179c0 20 remove_watcher() i=1 2024-09-12T00:19:06.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773604293680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c2f0 con 0x563233041b70 2024-09-12T00:19:06.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce28e1e640 1 -- 172.21.15.66:0/2460002579 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94773604293680] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce20067040 con 0x563233041b70 2024-09-12T00:19:06.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce2ab179c0 20 remove_watcher() i=2 2024-09-12T00:19:06.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.349+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773604298608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049360 con 0x7fce2003c060 2024-09-12T00:19:06.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce2861d640 1 -- 172.21.15.66:0/2460002579 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94773604298608] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1802e070 con 0x7fce2003c060 2024-09-12T00:19:06.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce2ab179c0 20 remove_watcher() i=3 2024-09-12T00:19:06.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773604296944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049c30 con 0x56323303d160 2024-09-12T00:19:06.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94773604296944] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x56323303d160 2024-09-12T00:19:06.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce2ab179c0 20 remove_watcher() i=4 2024-09-12T00:19:06.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.353+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773604302480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56323304c2f0 con 0x7fce18048220 2024-09-12T00:19:06.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94773604302480] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce2ab179c0 20 remove_watcher() i=5 2024-09-12T00:19:06.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773604306576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049360 con 0x7fce18048220 2024-09-12T00:19:06.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94773604306576] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce2ab179c0 20 remove_watcher() i=6 2024-09-12T00:19:06.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.357+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773604310512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563233049c30 con 0x7fce18048220 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94773604310512] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce1c0a9a50 con 0x7fce18048220 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 20 remove_watcher() i=7 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fce18048220 msgr2=0x7fce1804f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fce18048220 0x7fce1804f760 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56323303d160 msgr2=0x56323303f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56323303d160 0x56323303f620 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fce2003c060 msgr2=0x7fce2001f570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fce2003c060 0x7fce2001f570 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563233041b70 msgr2=0x563233043f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563233041b70 0x563233043f60 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccf8039a70 msgr2=0x7fccf803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccf8039a70 0x7fccf803bf30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fce1800fb60 tx=0x7fce18028000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 msgr2=0x5632330319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/2460002579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323302b5b0 0x5632330319e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce2004b010 tx=0x7fce20050890 comp rx=0 tx=0).stop 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce27e1c640 1 -- 172.21.15.66:0/2460002579 reap_dead start 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 shutdown_connections 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 >> 172.21.15.66:0/2460002579 conn(0x5632330269d0 msgr2=0x563233024be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 shutdown_connections 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/2460002579 wait complete. 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 msgr2=0x7fcd0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 0x7fcd0003bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce1804e130 tx=0x7fce1801c660 comp rx=0 tx=0).stop 2024-09-12T00:19:06.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 msgr2=0x56323301e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x563233004500 tx=0x7fce200163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 shutdown_connections 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd00039a70 0x7fcd0003bf30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/424180409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56323301dc80 0x56323301e0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 >> 172.21.15.66:0/424180409 conn(0x563233013630 msgr2=0x563233013a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 shutdown_connections 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/424180409 wait complete. 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 msgr2=0x56323300a2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 0x56323300a2e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 msgr2=0x56323300ee40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 0x56323300ee40 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 msgr2=0x7fcd1003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 0x7fcd1003bf80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0ad000 tx=0x7fce1c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 msgr2=0x563233003170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x563232ffca70 tx=0x7fce18000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 shutdown_connections 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56323300ca50 0x56323300ee40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563232f14850 0x56323300a2e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd10039ac0 0x7fcd1003bf80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 --2- 172.21.15.66:0/3020276611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563232f10700 0x563233003170 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 >> 172.21.15.66:0/3020276611 conn(0x563232e84010 msgr2=0x563232ff61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 shutdown_connections 2024-09-12T00:19:06.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.361+0000 7fce2ab179c0 1 -- 172.21.15.66:0/3020276611 wait complete. 2024-09-12T00:19:06.379 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T00:19:06.341823Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:06.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:06.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:06.379 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:06.457 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:06.457 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e163bb9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5603b0a12520 0x5603b0a12900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e163bb9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603b08c69c0 con 0x5603b0a156b0 2024-09-12T00:19:06.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e163bb9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5603b09166d0 con 0x5603b0a12520 2024-09-12T00:19:06.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e13ec1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5603b0a12520 0x5603b0a12900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e136c0640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5603b0a156b0 0x5603b0a17aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42778/0 (socket says 172.21.15.66:42778) 2024-09-12T00:19:06.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e13ec1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5603b0a12520 0x5603b0a12900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43924/0 (socket says 172.21.15.66:43924) 2024-09-12T00:19:06.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e136c0640 1 -- 172.21.15.66:0/1196751922 learned_addr learned my addr 172.21.15.66:0/1196751922 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:06.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1196751922 >> v1:172.21.15.31:6789/0 conn(0x5603b0a156b0 legacy=0x5603b0a17aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.453+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1196751922 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b08baca0 con 0x5603b0a12520 2024-09-12T00:19:06.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1196751922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0a12900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400a420 tx=0x7f6e0401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750c28ab0e5502bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e12ebf640 1 -- 172.21.15.66:0/1196751922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040af070 con 0x5603b0a12520 2024-09-12T00:19:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e12ebf640 1 -- 172.21.15.66:0/1196751922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040aa530 con 0x5603b0a12520 2024-09-12T00:19:06.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e12ebf640 1 -- 172.21.15.66:0/1196751922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040aa850 con 0x5603b0a12520 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1196751922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 msgr2=0x5603b0a12900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1196751922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0a12900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400a420 tx=0x7f6e0401afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1196751922 shutdown_connections 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1196751922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0a12900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.457+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1196751922 >> 172.21.15.66:0/1196751922 conn(0x5603b0a0e040 msgr2=0x5603b0a10460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.461+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1196751922 shutdown_connections 2024-09-12T00:19:06.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.461+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1196751922 wait complete. 2024-09-12T00:19:06.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.473+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.473+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.473+0000 7f6e163bb9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.473+0000 7f6e163bb9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b091a680 con 0x5603b0a12520 2024-09-12T00:19:06.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43934/0 (socket says 172.21.15.66:43934) 2024-09-12T00:19:06.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 -- 172.21.15.66:0/332946725 learned_addr learned my addr 172.21.15.66:0/332946725 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 -- 172.21.15.66:0/332946725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b0895da0 con 0x5603b0a12520 2024-09-12T00:19:06.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/332946725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e04018c00 tx=0x7f6e040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2791d97914cfa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6d01e0b640 1 -- 172.21.15.66:0/332946725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040af040 con 0x5603b0a12520 2024-09-12T00:19:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6d01e0b640 1 -- 172.21.15.66:0/332946725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040aaa00 con 0x5603b0a12520 2024-09-12T00:19:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6d01e0b640 1 -- 172.21.15.66:0/332946725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040aace0 con 0x5603b0a12520 2024-09-12T00:19:06.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/332946725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 msgr2=0x5603b0afd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/332946725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e04018c00 tx=0x7f6e040033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/332946725 shutdown_connections 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/332946725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0afd7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/332946725 >> 172.21.15.66:0/332946725 conn(0x5603b0a0e040 msgr2=0x5603b0af9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/332946725 shutdown_connections 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/332946725 wait complete. 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e163bb9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b08bca50 con 0x5603b0a12520 2024-09-12T00:19:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43946/0 (socket says 172.21.15.66:43946) 2024-09-12T00:19:06.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 -- 172.21.15.66:0/2338124540 learned_addr learned my addr 172.21.15.66:0/2338124540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.477+0000 7f6e13ec1640 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b0b052c0 con 0x5603b0a12520 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e040aa500 tx=0x7f6e04017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 -- 172.21.15.66:0/2338124540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040c5070 con 0x5603b0a12520 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b0b05550 con 0x5603b0a12520 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 -- 172.21.15.66:0/2338124540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040c1690 con 0x5603b0a12520 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 -- 172.21.15.66:0/2338124540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040c1990 con 0x5603b0a12520 2024-09-12T00:19:06.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b0b05f30 con 0x5603b0a12520 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 -- 172.21.15.66:0/2338124540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e040c1c00 con 0x5603b0a12520 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 0x7f6cfc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6cfbfff640 1 -- 172.21.15.66:0/2338124540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e040bb070 con 0x5603b0a12520 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e136c0640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 0x7f6cfc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 0x5603b0b0be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b0c3c0 con 0x5603b0a156b0 2024-09-12T00:19:06.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e146c2640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 0x5603b0b0be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e136c0640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 0x7f6cfc03bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e08004180 tx=0x7f6e08001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e146c2640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 0x5603b0b0be80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e146c2640 1 -- 172.21.15.66:0/2338124540 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e0c0083f0 con 0x5603b0a156b0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b0c830 con 0x5603b0a156b0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e146c2640 1 -- 172.21.15.66:0/2338124540 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e0c0083f0 con 0x5603b0a156b0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 0x5603b0b10a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b11100 con 0x5603b0b0e640 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.481+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 0x5603b0b10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 0x5603b0b10a30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e13ec1640 1 -- 172.21.15.66:0/2338124540 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e040b2040 con 0x5603b0b0e640 2024-09-12T00:19:06.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b0d4e0 con 0x5603b0a156b0 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 -- 172.21.15.66:0/2338124540 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e0c0083f0 con 0x5603b0a156b0 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b0d9a0 con 0x5603b0b0e640 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e13ec1640 1 -- 172.21.15.66:0/2338124540 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e040b2040 con 0x5603b0b0e640 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b0927450 con 0x5603b0b1f810 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43962/0 (socket says 172.21.15.66:43962) 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 -- 172.21.15.66:0/192364284 learned_addr learned my addr 172.21.15.66:0/192364284 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 -- 172.21.15.66:0/192364284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b0b20270 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e146c2640 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5603b0b057a0 tx=0x7f6e0c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6cf97fa640 1 -- 172.21.15.66:0/192364284 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c01c020 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b0b20ad0 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6cf97fa640 1 -- 172.21.15.66:0/192364284 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c007d00 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6cf97fa640 1 -- 172.21.15.66:0/192364284 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c018440 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.485+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b0b21040 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf97fa640 1 -- 172.21.15.66:0/192364284 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e0c01f020 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf97fa640 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 0x7f6cec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf97fa640 1 -- 172.21.15.66:0/192364284 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e0c051cf0 con 0x5603b0b1f810 2024-09-12T00:19:06.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 0x7f6cec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 0x7f6cec03bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c9000 tx=0x7f6e040eb040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e163bb9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e163bb9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b0afdf10 con 0x5603b0b2d100 2024-09-12T00:19:06.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43972/0 (socket says 172.21.15.66:43972) 2024-09-12T00:19:06.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e146c2640 1 -- 172.21.15.66:0/600063263 learned_addr learned my addr 172.21.15.66:0/600063263 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e146c2640 1 -- 172.21.15.66:0/600063263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b0b2daf0 con 0x5603b0b2d100 2024-09-12T00:19:06.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6e146c2640 1 --2- 172.21.15.66:0/600063263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c050130 tx=0x7f6e0c043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688abf273823825 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf2ffd640 1 -- 172.21.15.66:0/600063263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c021400 con 0x5603b0b2d100 2024-09-12T00:19:06.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf2ffd640 1 -- 172.21.15.66:0/600063263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c029c50 con 0x5603b0b2d100 2024-09-12T00:19:06.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.489+0000 7f6cf2ffd640 1 -- 172.21.15.66:0/600063263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0215a0 con 0x5603b0b2d100 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/600063263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 msgr2=0x5603b0b2d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/600063263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c050130 tx=0x7f6e0c043110 comp rx=0 tx=0).stop 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/600063263 shutdown_connections 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/600063263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b2d500 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/600063263 >> 172.21.15.66:0/600063263 conn(0x5603b0b28540 msgr2=0x5603b0b26780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/600063263 shutdown_connections 2024-09-12T00:19:06.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/600063263 wait complete. 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 Processor -- start 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- start start 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b0b2c050 con 0x5603b0b2d100 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e146c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43976/0 (socket says 172.21.15.66:43976) 2024-09-12T00:19:06.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 learned_addr learned my addr 172.21.15.66:0/1428736592 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b0b33be0 con 0x5603b0b2d100 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e146c2640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c016a50 tx=0x7f6e0c050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6cf17fa640 1 -- 172.21.15.66:0/1428736592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c028740 con 0x5603b0b2d100 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603b0b33e70 con 0x5603b0b2d100 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6cf17fa640 1 -- 172.21.15.66:0/1428736592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0289c0 con 0x5603b0b2d100 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6cf17fa640 1 -- 172.21.15.66:0/1428736592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c028ce0 con 0x5603b0b2d100 2024-09-12T00:19:06.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b0b34820 con 0x5603b0b2d100 2024-09-12T00:19:06.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6cf17fa640 1 -- 172.21.15.66:0/1428736592 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e0c016040 con 0x5603b0b2d100 2024-09-12T00:19:06.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.493+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6cf17fa640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cdc039ac0 0x7f6cdc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6cf17fa640 1 -- 172.21.15.66:0/1428736592 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e0c032030 con 0x5603b0b2d100 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cdc039ac0 0x7f6cdc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0b3eb00 0x5603b0b40f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b416c0 con 0x5603b0b3eb00 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0b3eb00 0x5603b0b40f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cdc039ac0 0x7f6cdc03bf80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c8df0 tx=0x7f6e040b3de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0b3eb00 0x5603b0b40f70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e0800e640 con 0x5603b0b3eb00 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 realm 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b3ded0 con 0x5603b0b3eb00 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e0800e640 con 0x5603b0b3eb00 2024-09-12T00:19:06.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b421c0 con 0x5603b0b3eb00 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e0800e640 con 0x5603b0b3eb00 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b42a90 con 0x5603b0b3eb00 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e0800e640 con 0x5603b0b3eb00 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b43340 0x5603b0b45730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b45e70 con 0x5603b0b43340 2024-09-12T00:19:06.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b43340 0x5603b0b45730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b43340 0x5603b0b45730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 20 searching for the correct realm 2024-09-12T00:19:06.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e0c021020 0x7f6e0c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e0c021020 0x7f6e0c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.497+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e0c021020 0x7f6e0c036a70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e13ec1640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e040ef040 0x7f6e040c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e040ef040 0x7f6e040c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e040ef040 0x7f6e040c0920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0800e640 con 0x7f6e040ef040 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0800e640 con 0x5603b0b3eb00 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.501+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.505+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.509+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b43340 2024-09-12T00:19:06.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e040ef040 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x5603b0b3eb00 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47790 con 0x7f6e0c021020 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:06.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b468b0 con 0x5603b0b3eb00 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b47150 con 0x5603b0b3eb00 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b464f0 con 0x5603b0b43340 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 zone default found 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 4 Realm: () 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 zonegroup default 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b46d80 con 0x7f6e040ef040 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b49b90 con 0x5603b0b43340 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4a020 con 0x5603b0b43340 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.513+0000 7f6e163bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 20 started sync module instance, tier type = 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:06.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b49000 con 0x7f6e0c021020 2024-09-12T00:19:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94573849514992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b48c60 con 0x7f6e0c021020 2024-09-12T00:19:06.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4af50 con 0x5603b0b3eb00 2024-09-12T00:19:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94573849514992] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94573849520800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4aec0 con 0x5603b0b3eb00 2024-09-12T00:19:06.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.517+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4bd00 con 0x5603b0b43340 2024-09-12T00:19:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94573849520800] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94573849523008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4bcc0 con 0x5603b0b43340 2024-09-12T00:19:06.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4c710 con 0x7f6e0c021020 2024-09-12T00:19:06.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94573849526880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4cb30 con 0x7f6e0c021020 2024-09-12T00:19:06.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.521+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4d5b0 con 0x5603b0b3eb00 2024-09-12T00:19:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94573849523008] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94573849526880] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94573849530560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4c680 con 0x5603b0b3eb00 2024-09-12T00:19:06.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4de80 con 0x7f6e040ef040 2024-09-12T00:19:06.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.525+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94573849530560] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94573849524064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4c680 con 0x7f6e040ef040 2024-09-12T00:19:06.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4e3a0 con 0x7f6e040ef040 2024-09-12T00:19:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94573849524064] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94573849534096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4e810 con 0x7f6e040ef040 2024-09-12T00:19:06.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.529+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4d850 con 0x7f6e040ef040 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94573849537952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4d850 con 0x7f6e040ef040 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=0 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=1 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=2 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=3 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=4 2024-09-12T00:19:06.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=5 2024-09-12T00:19:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94573849534096] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=6 2024-09-12T00:19:06.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94573849537952] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 20 add_watcher() i=7 2024-09-12T00:19:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4e360 con 0x5603b0b3eb00 2024-09-12T00:19:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.533+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94573849535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b4f6d0 con 0x5603b0b3eb00 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94573849535328] v31'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 5 note: GC not initialized 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6cc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:06.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 Filter name: none 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6c427fc640 20 reqs_thread_entry: start 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b752b0 con 0x5603b0b3eb00 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T00:19:06.543 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T00:19:06.341823Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6cc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.537+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94573849535328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b73d80 con 0x5603b0b3eb00 2024-09-12T00:19:06.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94573849535328] v31'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94573849514992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x7f6e0c021020 2024-09-12T00:19:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94573849514992] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 20 remove_watcher() i=0 2024-09-12T00:19:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 2 removed watcher, disabling cache 2024-09-12T00:19:06.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94573849520800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x5603b0b3eb00 2024-09-12T00:19:06.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94573849520800] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 20 remove_watcher() i=1 2024-09-12T00:19:06.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.541+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94573849523008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x5603b0b43340 2024-09-12T00:19:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e146c2640 1 -- 172.21.15.66:0/1428736592 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94573849523008] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c028070 con 0x5603b0b43340 2024-09-12T00:19:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e163bb9c0 20 remove_watcher() i=2 2024-09-12T00:19:06.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94573849526880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x7f6e0c021020 2024-09-12T00:19:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e13ec1640 1 -- 172.21.15.66:0/1428736592 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94573849526880] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040dc040 con 0x7f6e0c021020 2024-09-12T00:19:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e163bb9c0 20 remove_watcher() i=3 2024-09-12T00:19:06.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.545+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94573849530560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x5603b0b3eb00 2024-09-12T00:19:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94573849530560] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x5603b0b3eb00 2024-09-12T00:19:06.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e163bb9c0 20 remove_watcher() i=4 2024-09-12T00:19:06.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94573849524064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x7f6e040ef040 2024-09-12T00:19:06.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94573849524064] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e163bb9c0 20 remove_watcher() i=5 2024-09-12T00:19:06.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.549+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94573849534096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x7f6e040ef040 2024-09-12T00:19:06.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.553+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94573849534096] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.553+0000 7f6e163bb9c0 20 remove_watcher() i=6 2024-09-12T00:19:06.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.553+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94573849537952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5603b0b730d0 con 0x7f6e040ef040 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94573849537952] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e08029040 con 0x7f6e040ef040 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 20 remove_watcher() i=7 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e040ef040 msgr2=0x7f6e040c0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e040ef040 0x7f6e040c0920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0b3eb00 msgr2=0x5603b0b40f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0b3eb00 0x5603b0b40f70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e0c021020 msgr2=0x7f6e0c036a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e0c021020 0x7f6e0c036a70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b43340 msgr2=0x5603b0b45730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b43340 0x5603b0b45730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cdc039ac0 msgr2=0x7f6cdc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cdc039ac0 0x7f6cdc03bf80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c8df0 tx=0x7f6e040b3de0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 msgr2=0x5603b0b33680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e136c0640 1 -- 172.21.15.66:0/1428736592 reap_dead start 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c016a50 tx=0x7f6e0c050090 comp rx=0 tx=0).stop 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 shutdown_connections 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/1428736592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b2d100 0x5603b0b33680 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 >> 172.21.15.66:0/1428736592 conn(0x5603b0b28540 msgr2=0x5603b0b26750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 shutdown_connections 2024-09-12T00:19:06.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/1428736592 wait complete. 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 msgr2=0x7f6cec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 0x7f6cec03bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c9000 tx=0x7f6e040eb040 comp rx=0 tx=0).stop 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 msgr2=0x5603b0b1fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5603b0b057a0 tx=0x7f6e0c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 shutdown_connections 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cec039a70 0x7f6cec03bf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/192364284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0b1f810 0x5603b0b1fc30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 >> 172.21.15.66:0/192364284 conn(0x5603b0b151c0 msgr2=0x5603b0b155a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 shutdown_connections 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/192364284 wait complete. 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 msgr2=0x5603b0b0be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 0x5603b0b0be80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 msgr2=0x5603b0b10a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 0x5603b0b10a30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 msgr2=0x7f6cfc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 0x7f6cfc03bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e08004180 tx=0x7f6e08001340 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 msgr2=0x5603b0b04d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e040aa500 tx=0x7f6e04017d70 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 shutdown_connections 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603b0b0e640 0x5603b0b10a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603b0a156b0 0x5603b0b0be80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cfc039a70 0x7f6cfc03bf30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 --2- 172.21.15.66:0/2338124540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b0a12520 0x5603b0b04d60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 >> 172.21.15.66:0/2338124540 conn(0x5603b0a0e040 msgr2=0x5603b0af7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 shutdown_connections 2024-09-12T00:19:06.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.557+0000 7f6e163bb9c0 1 -- 172.21.15.66:0/2338124540 wait complete. 2024-09-12T00:19:06.573 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T00:19:06.341823Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:06.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T00:19:06.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T00:19:06.573 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-12T00:19:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:06.657 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab8267b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c220d1fc80 0x55c220d22070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab8267b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c220bd19c0 con 0x55c220d225b0 2024-09-12T00:19:06.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab8267b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c220c216d0 con 0x55c220d1fc80 2024-09-12T00:19:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab80181640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c220d1fc80 0x55c220d22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab80181640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c220d1fc80 0x55c220d22070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:43992/0 (socket says 172.21.15.66:43992) 2024-09-12T00:19:06.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab80181640 1 -- 172.21.15.66:0/1203604797 learned_addr learned my addr 172.21.15.66:0/1203604797 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab7f980640 1 --1- 172.21.15.66:0/1203604797 >> v1:172.21.15.31:6789/0 conn(0x55c220d225b0 0x55c220d249a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42792/0 (socket says 172.21.15.66:42792) 2024-09-12T00:19:06.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab80181640 1 -- 172.21.15.66:0/1203604797 >> v1:172.21.15.31:6789/0 conn(0x55c220d225b0 legacy=0x55c220d249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.653+0000 7fab80181640 1 -- 172.21.15.66:0/1203604797 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220bc5ca0 con 0x55c220d1fc80 2024-09-12T00:19:06.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab80181640 1 --2- 172.21.15.66:0/1203604797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220d22070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab7000a4e0 tx=0x7fab7001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d761d0134fce947 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab7f17f640 1 -- 172.21.15.66:0/1203604797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700aa540 con 0x55c220d1fc80 2024-09-12T00:19:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab7f17f640 1 -- 172.21.15.66:0/1203604797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700aa6e0 con 0x55c220d1fc80 2024-09-12T00:19:06.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab7f17f640 1 -- 172.21.15.66:0/1203604797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700aaa40 con 0x55c220d1fc80 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1203604797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 msgr2=0x55c220d22070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1203604797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220d22070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab7000a4e0 tx=0x7fab7001b090 comp rx=0 tx=0).stop 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1203604797 shutdown_connections 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1203604797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220d22070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1203604797 >> 172.21.15.66:0/1203604797 conn(0x55c220c93010 msgr2=0x55c220c93420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1203604797 shutdown_connections 2024-09-12T00:19:06.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.657+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1203604797 wait complete. 2024-09-12T00:19:06.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab8267b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab8267b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c220c25680 con 0x55c220d1fc80 2024-09-12T00:19:06.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab80181640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab80181640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44008/0 (socket says 172.21.15.66:44008) 2024-09-12T00:19:06.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab80181640 1 -- 172.21.15.66:0/4089569253 learned_addr learned my addr 172.21.15.66:0/4089569253 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab80181640 1 -- 172.21.15.66:0/4089569253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220ba0da0 con 0x55c220d1fc80 2024-09-12T00:19:06.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.673+0000 7fab80181640 1 --2- 172.21.15.66:0/4089569253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab70018cc0 tx=0x7fab700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162bb494460a88d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6e60c640 1 -- 172.21.15.66:0/4089569253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700b9070 con 0x55c220d1fc80 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6e60c640 1 -- 172.21.15.66:0/4089569253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700aaa80 con 0x55c220d1fc80 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6e60c640 1 -- 172.21.15.66:0/4089569253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700aad60 con 0x55c220d1fc80 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4089569253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 msgr2=0x55c220e0aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4089569253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab70018cc0 tx=0x7fab700033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4089569253 shutdown_connections 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4089569253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e0aa40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4089569253 >> 172.21.15.66:0/4089569253 conn(0x55c220c93010 msgr2=0x55c220e066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4089569253 shutdown_connections 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4089569253 wait complete. 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c220bc7a50 con 0x55c220d1fc80 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab80181640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab80181640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44022/0 (socket says 172.21.15.66:44022) 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab80181640 1 -- 172.21.15.66:0/4262116155 learned_addr learned my addr 172.21.15.66:0/4262116155 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab80181640 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220e12490 con 0x55c220d1fc80 2024-09-12T00:19:06.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab80181640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab70018cc0 tx=0x7fab70017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6ce09640 1 -- 172.21.15.66:0/4262116155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700b9070 con 0x55c220d1fc80 2024-09-12T00:19:06.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c220e12720 con 0x55c220d1fc80 2024-09-12T00:19:06.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6ce09640 1 -- 172.21.15.66:0/4262116155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700b5a50 con 0x55c220d1fc80 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7faa6ce09640 1 -- 172.21.15.66:0/4262116155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab700b5d30 con 0x55c220d1fc80 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.677+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c220e130d0 con 0x55c220d1fc80 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7faa6ce09640 1 -- 172.21.15.66:0/4262116155 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab700b3040 con 0x55c220d1fc80 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7faa6ce09640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 0x7faa6803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7faa6ce09640 1 -- 172.21.15.66:0/4262116155 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab700c4070 con 0x55c220d1fc80 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab7f980640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 0x7faa6803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 0x55c220e190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e195e0 con 0x55c220d225b0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80982640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 0x55c220e190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab7f980640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 0x7faa6803bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e40 tx=0x7fab740013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80982640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 0x55c220e190a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80982640 1 -- 172.21.15.66:0/4262116155 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab780083f0 con 0x55c220d225b0 2024-09-12T00:19:06.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e134a0 con 0x55c220d225b0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80982640 1 -- 172.21.15.66:0/4262116155 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab780083f0 con 0x55c220d225b0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 0x55c220e1dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e1e3b0 con 0x55c220e1b8d0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80181640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 0x55c220e1dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80181640 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 0x55c220e1dcc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80181640 1 -- 172.21.15.66:0/4262116155 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab700cd060 con 0x55c220e1b8d0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e1a740 con 0x55c220d225b0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80982640 1 -- 172.21.15.66:0/4262116155 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab780083f0 con 0x55c220d225b0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e1abf0 con 0x55c220e1b8d0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.681+0000 7fab80181640 1 -- 172.21.15.66:0/4262116155 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab700cd060 con 0x55c220e1b8d0 2024-09-12T00:19:06.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c220c32450 con 0x55c220e2cac0 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44038/0 (socket says 172.21.15.66:44038) 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80982640 1 -- 172.21.15.66:0/3096126022 learned_addr learned my addr 172.21.15.66:0/3096126022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80982640 1 -- 172.21.15.66:0/3096126022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220e2d520 con 0x55c220e2cac0 2024-09-12T00:19:06.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80982640 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55c220e132c0 tx=0x7fab7800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 -- 172.21.15.66:0/3096126022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7801c020 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 -- 172.21.15.66:0/3096126022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78007c40 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c220e2dd80 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 -- 172.21.15.66:0/3096126022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78018440 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c220e2e2f0 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 -- 172.21.15.66:0/3096126022 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab7801f020 con 0x55c220e2cac0 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 0x7faa5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7faa65ffb640 1 -- 172.21.15.66:0/3096126022 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab78051e00 con 0x55c220e2cac0 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.685+0000 7fab80181640 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 0x7faa5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80181640 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 0x7faa5803bf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab700b2cd0 tx=0x7fab700a4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c220e0b1b0 con 0x55c220e3a470 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44046/0 (socket says 172.21.15.66:44046) 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 -- 172.21.15.66:0/1785121608 learned_addr learned my addr 172.21.15.66:0/1785121608 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 -- 172.21.15.66:0/1785121608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220e3ae40 con 0x55c220e3a470 2024-09-12T00:19:06.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 --2- 172.21.15.66:0/1785121608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab78021900 tx=0x7fab780431c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ecfb84bd371f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7faa5f7fe640 1 -- 172.21.15.66:0/1785121608 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78020cb0 con 0x55c220e3a470 2024-09-12T00:19:06.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7faa5f7fe640 1 -- 172.21.15.66:0/1785121608 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78020e50 con 0x55c220e3a470 2024-09-12T00:19:06.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7faa5f7fe640 1 -- 172.21.15.66:0/1785121608 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78016480 con 0x55c220e3a470 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1785121608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 msgr2=0x55c220e3a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1785121608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab78021900 tx=0x7fab780431c0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1785121608 shutdown_connections 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1785121608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e3a850 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1785121608 >> 172.21.15.66:0/1785121608 conn(0x55c220e35830 msgr2=0x55c220e33a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1785121608 shutdown_connections 2024-09-12T00:19:06.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1785121608 wait complete. 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 Processor -- start 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- start start 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab8267b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c220e39360 con 0x55c220e3a470 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44050/0 (socket says 172.21.15.66:44050) 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 learned_addr learned my addr 172.21.15.66:0/1032764725 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.689+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c220e40e30 con 0x55c220e3a470 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab80982640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab7804f020 tx=0x7fab780500e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 -- 172.21.15.66:0/1032764725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78029d90 con 0x55c220e3a470 2024-09-12T00:19:06.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 -- 172.21.15.66:0/1032764725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab78029350 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 -- 172.21.15.66:0/1032764725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab78029670 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c220e410c0 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c220e41a70 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 -- 172.21.15.66:0/1032764725 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab78016040 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa50039a70 0x7faa5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7faa5dffb640 1 -- 172.21.15.66:0/1032764725 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fab78035c70 con 0x55c220e3a470 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab80181640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa50039a70 0x7faa5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220e4be10 0x55c220e4e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e4ea20 con 0x55c220e4be10 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab7f980640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220e4be10 0x55c220e4e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab80181640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa50039a70 0x7faa5003bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fab700d0fd0 tx=0x7fab700de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab7f980640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220e4be10 0x55c220e4e2d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400f620 con 0x55c220e4be10 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 realm 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e4b160 con 0x55c220e4be10 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400f620 con 0x55c220e4be10 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e4f520 con 0x55c220e4be10 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7400f620 con 0x55c220e4be10 2024-09-12T00:19:06.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.693+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e4fdf0 con 0x55c220e4be10 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab7400f620 con 0x55c220e4be10 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e50810 0x55c220e52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e53340 con 0x55c220e50810 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e50810 0x55c220e52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e50810 0x55c220e52c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 20 searching for the correct realm 2024-09-12T00:19:06.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fab78021020 0x7fab78022a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80181640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fab78021020 0x7fab78022a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80181640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fab78021020 0x7fab78022a30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80181640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fab700f7040 0x7fab700ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab7f980640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fab700f7040 0x7fab700ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab7f980640 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fab700f7040 0x7fab700ea360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400f620 con 0x7fab700f7040 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.697+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7400f620 con 0x55c220e4be10 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x7fab700f7040 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x7fab700f7040 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x7fab700f7040 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.701+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x7fab700f7040 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x7fab700f7040 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.705+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7402b040 con 0x55c220e4be10 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e50810 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab700f7040 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.709+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x55c220e4be10 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54c10 con 0x7fab78021020 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e53d90 con 0x55c220e4be10 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e54630 con 0x55c220e4be10 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e539d0 con 0x55c220e50810 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 zone default found 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 4 Realm: () 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 zonegroup default 2024-09-12T00:19:06.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e55460 con 0x7fab700f7040 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e57190 con 0x55c220e50810 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e57620 con 0x55c220e50810 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.713+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e55f60 con 0x7fab78021020 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292263918256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e57a80 con 0x7fab78021020 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e582d0 con 0x55c220e4be10 2024-09-12T00:19:06.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292263918256] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292263927328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e586f0 con 0x55c220e4be10 2024-09-12T00:19:06.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.717+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e58f40 con 0x55c220e50810 2024-09-12T00:19:06.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292263927328] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292263928656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e58d60 con 0x55c220e50810 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e59880 con 0x7fab78021020 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292263932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5a120 con 0x7fab78021020 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5ab60 con 0x55c220e4be10 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.721+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292263928656] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292263932752] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292263937584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e59c70 con 0x55c220e4be10 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5b400 con 0x7fab700f7040 2024-09-12T00:19:06.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292263939488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5b670 con 0x7fab700f7040 2024-09-12T00:19:06.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5bec0 con 0x7fab700f7040 2024-09-12T00:19:06.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.725+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292263937584] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292263939488] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292263940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5ba90 con 0x7fab700f7040 2024-09-12T00:19:06.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5c2e0 con 0x7fab700f7040 2024-09-12T00:19:06.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292263940544] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292263942080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5c190 con 0x7fab700f7040 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=0 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=1 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=2 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=3 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=4 2024-09-12T00:19:06.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=5 2024-09-12T00:19:06.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.729+0000 7fab8267b9c0 20 add_watcher() i=6 2024-09-12T00:19:06.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292263942080] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 20 add_watcher() i=7 2024-09-12T00:19:06.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:06.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5f6d0 con 0x55c220e4be10 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292263943200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e5cbf0 con 0x55c220e4be10 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292263943200] v31'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7faa367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 5 note: GC not initialized 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7faa357e2640 20 reqs_thread_entry: start 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.733+0000 7fab8267b9c0 20 Filter name: none 2024-09-12T00:19:06.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fa9a6ffd640 20 reqs_thread_entry: start 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e82ce0 con 0x55c220e4be10 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e89790 con 0x55c220e4be10 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94292264129024 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e84ea0 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94292263937584 notify 133143986180 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fab74018040 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7faa5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94292263937584 notifier 4355 bl.length()=567 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7faa5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7faa5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(64 notify.4 [notify cookie 94292264129024 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7faa5f7fe640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faa44003eb0 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94292264129024 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c220bd19c0 con 0x55c220e4be10 2024-09-12T00:19:06.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.737+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e89200 con 0x7fab700f7040 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab8267b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94292264129024 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c220e849f0 con 0x55c220e50810 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94292263928656 notify 133143986177 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c220e410c0 con 0x55c220e50810 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7faa5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94292263928656 notifier 4355 bl.length()=170 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 notify.2 [notify cookie 94292264129024 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7faa5effd640 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa9b40032d0 con 0x55c220e50810 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== watch-notify(notify_complete (2) cookie 94292264129024 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c220e40e30 con 0x55c220e50810 2024-09-12T00:19:06.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.749 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7faa367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.741+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292263943200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e84ea0 con 0x55c220e4be10 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94292263943200] v31'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292263918256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e84ea0 con 0x7fab78021020 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94292263918256] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab8267b9c0 20 remove_watcher() i=0 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab8267b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:06.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.745+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292263927328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x55c220e4be10 2024-09-12T00:19:06.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94292263927328] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 20 remove_watcher() i=1 2024-09-12T00:19:06.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292263928656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x55c220e50810 2024-09-12T00:19:06.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab80982640 1 -- 172.21.15.66:0/1032764725 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94292263928656] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7803a020 con 0x55c220e50810 2024-09-12T00:19:06.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 20 remove_watcher() i=2 2024-09-12T00:19:06.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292263932752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x7fab78021020 2024-09-12T00:19:06.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab80181640 1 -- 172.21.15.66:0/1032764725 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94292263932752] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab700d6040 con 0x7fab78021020 2024-09-12T00:19:06.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 20 remove_watcher() i=3 2024-09-12T00:19:06.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.749+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292263937584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x55c220e4be10 2024-09-12T00:19:06.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.753+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94292263937584] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x55c220e4be10 2024-09-12T00:19:06.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.753+0000 7fab8267b9c0 20 remove_watcher() i=4 2024-09-12T00:19:06.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.753+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292263939488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x7fab700f7040 2024-09-12T00:19:06.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94292263939488] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab8267b9c0 20 remove_watcher() i=5 2024-09-12T00:19:06.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292263940544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x7fab700f7040 2024-09-12T00:19:06.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94292263940544] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab8267b9c0 20 remove_watcher() i=6 2024-09-12T00:19:06.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.757+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292263942080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c220e809f0 con 0x7fab700f7040 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94292263942080] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7403b040 con 0x7fab700f7040 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 20 remove_watcher() i=7 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fab700f7040 msgr2=0x7fab700ea360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fab700f7040 0x7fab700ea360 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220e4be10 msgr2=0x55c220e4e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220e4be10 0x55c220e4e2d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fab78021020 msgr2=0x7fab78022a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fab78021020 0x7fab78022a30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e50810 msgr2=0x55c220e52c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e50810 0x55c220e52c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa50039a70 msgr2=0x7faa5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa50039a70 0x7faa5003bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fab700d0fd0 tx=0x7fab700de000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 msgr2=0x55c220e408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab7804f020 tx=0x7fab780500e0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab7f980640 1 -- 172.21.15.66:0/1032764725 reap_dead start 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 shutdown_connections 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/1032764725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e3a470 0x55c220e408d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 >> 172.21.15.66:0/1032764725 conn(0x55c220e35830 msgr2=0x55c220e33a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 shutdown_connections 2024-09-12T00:19:06.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/1032764725 wait complete. 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 msgr2=0x7faa5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 0x7faa5803bf30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab700b2cd0 tx=0x7fab700a4000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 msgr2=0x55c220e2cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55c220e132c0 tx=0x7fab7800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 shutdown_connections 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa58039a70 0x7faa5803bf30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/3096126022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220e2cac0 0x55c220e2cee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 >> 172.21.15.66:0/3096126022 conn(0x55c220e22470 msgr2=0x55c220e22850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 shutdown_connections 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/3096126022 wait complete. 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 msgr2=0x55c220e190a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 0x55c220e190a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 msgr2=0x55c220e1dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 0x55c220e1dcc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 msgr2=0x7faa6803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 0x7faa6803bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fab74001e40 tx=0x7fab740013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 msgr2=0x55c220e11f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab70018cc0 tx=0x7fab70017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 shutdown_connections 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c220e1b8d0 0x55c220e1dcc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c220d225b0 0x55c220e190a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faa68039a70 0x7faa6803bf30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 --2- 172.21.15.66:0/4262116155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c220d1fc80 0x55c220e11f30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 >> 172.21.15.66:0/4262116155 conn(0x55c220c93010 msgr2=0x55c220e05170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 shutdown_connections 2024-09-12T00:19:06.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.761+0000 7fab8267b9c0 1 -- 172.21.15.66:0/4262116155 wait complete. 2024-09-12T00:19:06.778 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:06.778 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T00:19:06.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T00:19:06.778 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-12T00:19:06.860 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:06.860 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc84f239c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625c9125520 0x5625c9125900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc84f239c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625c8fd99c0 con 0x5625c91286b0 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc84f239c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5625c90296d0 con 0x5625c9125520 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82a29640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625c9125520 0x5625c9125900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82a29640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5625c9125520 0x5625c9125900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44052/0 (socket says 172.21.15.66:44052) 2024-09-12T00:19:06.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82228640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5625c91286b0 0x5625c912aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42798/0 (socket says 172.21.15.66:42798) 2024-09-12T00:19:06.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82a29640 1 -- 172.21.15.66:0/4099044537 learned_addr learned my addr 172.21.15.66:0/4099044537 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82a29640 1 -- 172.21.15.66:0/4099044537 >> v1:172.21.15.31:6789/0 conn(0x5625c91286b0 legacy=0x5625c912aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.857+0000 7efc82a29640 1 -- 172.21.15.66:0/4099044537 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c8fcdca0 con 0x5625c9125520 2024-09-12T00:19:06.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc82a29640 1 --2- 172.21.15.66:0/4099044537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9125900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc7400a5c0 tx=0x7efc7401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d3620c1c46d06e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc81a27640 1 -- 172.21.15.66:0/4099044537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740a6070 con 0x5625c9125520 2024-09-12T00:19:06.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc81a27640 1 -- 172.21.15.66:0/4099044537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc740af070 con 0x5625c9125520 2024-09-12T00:19:06.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc81a27640 1 -- 172.21.15.66:0/4099044537 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740aa5c0 con 0x5625c9125520 2024-09-12T00:19:06.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 -- 172.21.15.66:0/4099044537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 msgr2=0x5625c9125900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 --2- 172.21.15.66:0/4099044537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9125900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc7400a5c0 tx=0x7efc7401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:06.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 -- 172.21.15.66:0/4099044537 shutdown_connections 2024-09-12T00:19:06.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 --2- 172.21.15.66:0/4099044537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9125900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 -- 172.21.15.66:0/4099044537 >> 172.21.15.66:0/4099044537 conn(0x5625c9121040 msgr2=0x5625c9123460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 -- 172.21.15.66:0/4099044537 shutdown_connections 2024-09-12T00:19:06.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.861+0000 7efc84f239c0 1 -- 172.21.15.66:0/4099044537 wait complete. 2024-09-12T00:19:06.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625c902d680 con 0x5625c9125520 2024-09-12T00:19:06.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc82a29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc82a29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44056/0 (socket says 172.21.15.66:44056) 2024-09-12T00:19:06.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc82a29640 1 -- 172.21.15.66:0/877531718 learned_addr learned my addr 172.21.15.66:0/877531718 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc82a29640 1 -- 172.21.15.66:0/877531718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c8fa8da0 con 0x5625c9125520 2024-09-12T00:19:06.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc82a29640 1 --2- 172.21.15.66:0/877531718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efc740ac040 tx=0x7efc74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250d7e4b9d87cda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efb70e09640 1 -- 172.21.15.66:0/877531718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740aa970 con 0x5625c9125520 2024-09-12T00:19:06.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efb70e09640 1 -- 172.21.15.66:0/877531718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc740aab10 con 0x5625c9125520 2024-09-12T00:19:06.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efb70e09640 1 -- 172.21.15.66:0/877531718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740aae30 con 0x5625c9125520 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- 172.21.15.66:0/877531718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 msgr2=0x5625c9210800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 --2- 172.21.15.66:0/877531718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efc740ac040 tx=0x7efc74003030 comp rx=0 tx=0).stop 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- 172.21.15.66:0/877531718 shutdown_connections 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 --2- 172.21.15.66:0/877531718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9210800 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- 172.21.15.66:0/877531718 >> 172.21.15.66:0/877531718 conn(0x5625c9121040 msgr2=0x5625c920c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- 172.21.15.66:0/877531718 shutdown_connections 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.877+0000 7efc84f239c0 1 -- 172.21.15.66:0/877531718 wait complete. 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625c8fcfa50 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82a29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82a29640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44060/0 (socket says 172.21.15.66:44060) 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82a29640 1 -- 172.21.15.66:0/2157234084 learned_addr learned my addr 172.21.15.66:0/2157234084 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82a29640 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c92182e0 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82a29640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc7401b380 tx=0x7efc740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 -- 172.21.15.66:0/2157234084 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740c6690 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 -- 172.21.15.66:0/2157234084 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc740cc070 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c9218570 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 -- 172.21.15.66:0/2157234084 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc740c6960 con 0x5625c9125520 2024-09-12T00:19:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c9218ed0 con 0x5625c9125520 2024-09-12T00:19:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 -- 172.21.15.66:0/2157234084 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc740c6b00 con 0x5625c9125520 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 0x7efb6803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efb6f606640 1 -- 172.21.15.66:0/2157234084 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7efc740ebbe0 con 0x5625c9125520 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc82228640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 0x7efb6803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.881+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 0x5625c921eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c921f3e0 con 0x5625c91286b0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 0x5625c921eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc82228640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 0x7efb6803bf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc78001e40 tx=0x7efc780013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 0x5625c921eea0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 -- 172.21.15.66:0/2157234084 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c91286b0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c921f7e0 con 0x5625c91286b0 2024-09-12T00:19:06.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 -- 172.21.15.66:0/2157234084 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c91286b0 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 0x5625c92239e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c92240b0 con 0x5625c92215f0 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc82a29640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 0x5625c92239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc82a29640 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 0x5625c92239e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc82a29640 1 -- 172.21.15.66:0/2157234084 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc740bc580 con 0x5625c92215f0 2024-09-12T00:19:06.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9220490 con 0x5625c91286b0 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 -- 172.21.15.66:0/2157234084 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c91286b0 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9220970 con 0x5625c92215f0 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc82a29640 1 -- 172.21.15.66:0/2157234084 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc740bc580 con 0x5625c92215f0 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc84f239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625c903a450 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44064/0 (socket says 172.21.15.66:44064) 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.885+0000 7efc8322a640 1 -- 172.21.15.66:0/3247967801 learned_addr learned my addr 172.21.15.66:0/3247967801 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc8322a640 1 -- 172.21.15.66:0/3247967801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c9233280 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc8322a640 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5625c9219e60 tx=0x7efc7c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 -- 172.21.15.66:0/3247967801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c013640 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 -- 172.21.15.66:0/3247967801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c0137e0 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c9233ae0 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 -- 172.21.15.66:0/3247967801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c013ac0 con 0x5625c9232820 2024-09-12T00:19:06.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c9234050 con 0x5625c9232820 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 -- 172.21.15.66:0/3247967801 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc7c011040 con 0x5625c9232820 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 0x7efb5c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efb6ce01640 1 -- 172.21.15.66:0/3247967801 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7efc7c00e040 con 0x5625c9232820 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc82a29640 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 0x7efb5c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc82a29640 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 0x7efb5c03bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc740bc890 tx=0x7efc740e9f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc84f239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625c9210f70 con 0x5625c909aa60 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44072/0 (socket says 172.21.15.66:44072) 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.889+0000 7efc8322a640 1 -- 172.21.15.66:0/3621590947 learned_addr learned my addr 172.21.15.66:0/3621590947 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 -- 172.21.15.66:0/3621590947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c909b3a0 con 0x5625c909aa60 2024-09-12T00:19:06.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 --2- 172.21.15.66:0/3621590947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0508f0 tx=0x7efc7c0206f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e9c79b36b9000d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb667fc640 1 -- 172.21.15.66:0/3621590947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c041e60 con 0x5625c909aa60 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb667fc640 1 -- 172.21.15.66:0/3621590947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c02aa40 con 0x5625c909aa60 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb667fc640 1 -- 172.21.15.66:0/3621590947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c02a520 con 0x5625c909aa60 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/3621590947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 msgr2=0x5625c909ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3621590947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0508f0 tx=0x7efc7c0206f0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/3621590947 shutdown_connections 2024-09-12T00:19:06.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3621590947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c909ae60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/3621590947 >> 172.21.15.66:0/3621590947 conn(0x5625c923b5b0 msgr2=0x5625c92397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/3621590947 shutdown_connections 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/3621590947 wait complete. 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 Processor -- start 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- start start 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5625c909b8f0 con 0x5625c909aa60 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44084/0 (socket says 172.21.15.66:44084) 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 learned_addr learned my addr 172.21.15.66:0/2790196809 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c9248d90 con 0x5625c909aa60 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc8322a640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc7c04f770 tx=0x7efc7c050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb64ff9640 1 -- 172.21.15.66:0/2790196809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c02e070 con 0x5625c909aa60 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c9248d90 con 0x5625c909aa60 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb64ff9640 1 -- 172.21.15.66:0/2790196809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7c045030 con 0x5625c909aa60 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efb64ff9640 1 -- 172.21.15.66:0/2790196809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7c052200 con 0x5625c909aa60 2024-09-12T00:19:06.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.893+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c9248d90 con 0x5625c909aa60 2024-09-12T00:19:06.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efb64ff9640 1 -- 172.21.15.66:0/2790196809 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7efc7c03eaa0 con 0x5625c909aa60 2024-09-12T00:19:06.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efb64ff9640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb4c039a70 0x7efb4c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efb64ff9640 1 -- 172.21.15.66:0/2790196809 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7efc7c022030 con 0x5625c909aa60 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82a29640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb4c039a70 0x7efb4c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c92539f0 0x5625c9255eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9256600 con 0x5625c92539f0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c92539f0 0x5625c9255eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82a29640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb4c039a70 0x7efb4c03bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc740de3f0 tx=0x7efc740e2000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c92539f0 0x5625c9255eb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800f620 con 0x5625c92539f0 2024-09-12T00:19:06.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 realm 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9252d40 con 0x5625c92539f0 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800f620 con 0x5625c92539f0 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:06.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9257100 con 0x5625c92539f0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800f620 con 0x5625c92539f0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c92579d0 con 0x5625c92539f0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7800f620 con 0x5625c92539f0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92583f0 0x5625c925a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925af20 con 0x5625c92583f0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.897+0000 7efc8322a640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92583f0 0x5625c925a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc8322a640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92583f0 0x5625c925a7e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc84f239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc84f239c0 20 searching for the correct realm 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92583f0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc8322a640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7efc7c03ca10 0x7efc7c0515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc7c03ca10 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82a29640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7efc7c03ca10 0x7efc7c0515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82a29640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7efc7c03ca10 0x7efc7c0515e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82a29640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7efc74009040 0x7efc740b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc74009040 2024-09-12T00:19:06.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7efc74009040 0x7efc740b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:06.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7efc74009040 0x7efc740b3850 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:06.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800f620 con 0x7efc74009040 2024-09-12T00:19:06.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92539f0 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800f620 con 0x5625c92539f0 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92539f0 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.901+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc74009040 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x7efc74009040 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc74009040 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x7efc74009040 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc7c03ca10 2024-09-12T00:19:06.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92583f0 2024-09-12T00:19:06.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92539f0 2024-09-12T00:19:06.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc74009040 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x7efc74009040 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x5625c92539f0 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c7f0 con 0x7efc7c03ca10 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.905+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc74009040 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x7efc74009040 2024-09-12T00:19:06.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92539f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92539f0 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc74009040 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x7efc74009040 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc7c03ca10 2024-09-12T00:19:06.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92539f0 2024-09-12T00:19:06.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7802b040 con 0x5625c92539f0 2024-09-12T00:19:06.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.909+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc74009040 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc74009040 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc7c03ca10 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92583f0 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc74009040 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x5625c92539f0 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7efc74105060 con 0x7efc7c03ca10 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:06.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925b970 con 0x5625c92539f0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925c210 con 0x5625c92539f0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.913+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925cb90 con 0x5625c92583f0 2024-09-12T00:19:06.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 zone default found 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 4 Realm: () 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 zonegroup default 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925cf90 con 0x7efc74009040 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925ee10 con 0x5625c92583f0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c925f270 con 0x5625c92583f0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 started sync module instance, tier type = 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c925e260 con 0x7efc7c03ca10 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720288483248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c925e260 con 0x7efc7c03ca10 2024-09-12T00:19:06.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.917+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c925fd20 con 0x5625c92539f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720288483248] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720288487440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c925e260 con 0x5625c92539f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9260730 con 0x5625c92583f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720288487440] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.921+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720288490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c925e260 con 0x5625c92583f0 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9261140 con 0x7efc7c03ca10 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720288492688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9261560 con 0x7efc7c03ca10 2024-09-12T00:19:06.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9261fa0 con 0x5625c92539f0 2024-09-12T00:19:06.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720288490384] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720288492688] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720288496240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c92610b0 con 0x5625c92539f0 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.925+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9262840 con 0x7efc74009040 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.929+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720288496240] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.929+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.929+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720288480688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c92610b0 con 0x7efc74009040 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.929+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9262d50 con 0x7efc74009040 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.929+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720288480688] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720288499744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9262d10 con 0x7efc74009040 2024-09-12T00:19:06.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9263710 con 0x7efc74009040 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720288502304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9263b30 con 0x7efc74009040 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=0 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=1 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=2 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=3 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=4 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=5 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720288499744] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.933+0000 7efc84f239c0 20 add_watcher() i=6 2024-09-12T00:19:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720288502304] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 add_watcher() i=7 2024-09-12T00:19:06.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c9262200 con 0x5625c92539f0 2024-09-12T00:19:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720288498176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9264070 con 0x5625c92539f0 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720288498176] v31'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efb397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 5 note: GC not initialized 2024-09-12T00:19:06.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efab3fff640 20 reqs_thread_entry: start 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 Filter name: none 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efab1ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c928a150 con 0x5625c92539f0 2024-09-12T00:19:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.937+0000 7efc84f239c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c928abc0 con 0x5625c92539f0 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T00:19:06.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c92909d0 con 0x5625c92539f0 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v31'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94720288687168 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c928bff0 con 0x5625c92539f0 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== watch-notify(notify (1) cookie 94720288496240 notify 133143986181 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7efc78018040 con 0x5625c92539f0 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efb667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94720288496240 notifier 4362 bl.length()=732 2024-09-12T00:19:06.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efb667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efb667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify cookie 94720288687168 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efb667fc640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7efb48003eb0 con 0x5625c92539f0 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== watch-notify(notify_complete (2) cookie 94720288687168 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5625c8fd99c0 con 0x5625c92539f0 2024-09-12T00:19:06.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.941+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9290440 con 0x5625c92539f0 2024-09-12T00:19:06.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T00:19:06.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T00:19:06.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94720288687168 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5625c928bb40 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== watch-notify(notify (1) cookie 94720288483248 notify 133143986178 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7efc740ff040 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efb667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94720288483248 notifier 4362 bl.length()=166 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efb667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efb667fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(68 notify.0 [notify cookie 94720288687168 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efb667fc640 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7efb48003eb0 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== watch-notify(notify_complete (2) cookie 94720288687168 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5625c9218ed0 con 0x7efc7c03ca10 2024-09-12T00:19:06.951 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"YWDlAhqDbN4xVFFMZukgOfv6QCFYcHCYa38nMsu6","active":true,"create_date":"2024-09-12T00:19:06.944875Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:06.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efb397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:06.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720288498176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x5625c92539f0 2024-09-12T00:19:06.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94720288498176] v31'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.945+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720288483248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x7efc7c03ca10 2024-09-12T00:19:06.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94720288483248] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc84f239c0 20 remove_watcher() i=0 2024-09-12T00:19:06.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc84f239c0 2 removed watcher, disabling cache 2024-09-12T00:19:06.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720288487440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x5625c92539f0 2024-09-12T00:19:06.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94720288487440] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc84f239c0 20 remove_watcher() i=1 2024-09-12T00:19:06.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.949+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720288490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x5625c92583f0 2024-09-12T00:19:06.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc8322a640 1 -- 172.21.15.66:0/2790196809 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94720288490384] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7c00a4d0 con 0x5625c92583f0 2024-09-12T00:19:06.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc84f239c0 20 remove_watcher() i=2 2024-09-12T00:19:06.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720288492688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9260390 con 0x7efc7c03ca10 2024-09-12T00:19:06.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc82a29640 1 -- 172.21.15.66:0/2790196809 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94720288492688] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc740bc580 con 0x7efc7c03ca10 2024-09-12T00:19:06.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc84f239c0 20 remove_watcher() i=3 2024-09-12T00:19:06.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.953+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720288496240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x5625c92539f0 2024-09-12T00:19:06.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94720288496240] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x5625c92539f0 2024-09-12T00:19:06.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc84f239c0 20 remove_watcher() i=4 2024-09-12T00:19:06.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720288480688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9260c90 con 0x7efc74009040 2024-09-12T00:19:06.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94720288480688] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc84f239c0 20 remove_watcher() i=5 2024-09-12T00:19:06.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.957+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720288499744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9260390 con 0x7efc74009040 2024-09-12T00:19:06.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94720288499744] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 20 remove_watcher() i=6 2024-09-12T00:19:06.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720288502304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5625c9287e80 con 0x7efc74009040 2024-09-12T00:19:06.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94720288502304] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7803b040 con 0x7efc74009040 2024-09-12T00:19:06.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 20 remove_watcher() i=7 2024-09-12T00:19:06.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7efc74009040 msgr2=0x7efc740b3850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7efc74009040 0x7efc740b3850 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c92539f0 msgr2=0x5625c9255eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c92539f0 0x5625c9255eb0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7efc7c03ca10 msgr2=0x7efc7c0515e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7efc7c03ca10 0x7efc7c0515e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92583f0 msgr2=0x5625c925a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92583f0 0x5625c925a7e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb4c039a70 msgr2=0x7efb4c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb4c039a70 0x7efb4c03bf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc740de3f0 tx=0x7efc740e2000 comp rx=0 tx=0).stop 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc82228640 1 -- 172.21.15.66:0/2790196809 reap_dead start 2024-09-12T00:19:06.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 msgr2=0x5625c9248830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc7c04f770 tx=0x7efc7c050880 comp rx=0 tx=0).stop 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 shutdown_connections 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2790196809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c909aa60 0x5625c9248830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 >> 172.21.15.66:0/2790196809 conn(0x5625c923b5b0 msgr2=0x5625c92397c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 shutdown_connections 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/2790196809 wait complete. 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 msgr2=0x7efb5c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 0x7efb5c03bf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc740bc890 tx=0x7efc740e9f00 comp rx=0 tx=0).stop 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 msgr2=0x5625c9232c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5625c9219e60 tx=0x7efc7c0167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 shutdown_connections 2024-09-12T00:19:06.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb5c039a70 0x7efb5c03bf30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 --2- 172.21.15.66:0/3247967801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9232820 0x5625c9232c40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 >> 172.21.15.66:0/3247967801 conn(0x5625c92281d0 msgr2=0x5625c92285b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 shutdown_connections 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.961+0000 7efc84f239c0 1 -- 172.21.15.66:0/3247967801 wait complete. 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 msgr2=0x5625c921eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 0x5625c921eea0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 msgr2=0x5625c92239e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 0x5625c92239e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 msgr2=0x7efb6803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 0x7efb6803bf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc78001e40 tx=0x7efc780013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 msgr2=0x5625c9217d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc7401b380 tx=0x7efc740180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 shutdown_connections 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5625c92215f0 0x5625c92239e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5625c91286b0 0x5625c921eea0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7efb68039ac0 0x7efb6803bf80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 --2- 172.21.15.66:0/2157234084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5625c9125520 0x5625c9217d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 >> 172.21.15.66:0/2157234084 conn(0x5625c9121040 msgr2=0x5625c920af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 shutdown_connections 2024-09-12T00:19:06.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:06.965+0000 7efc84f239c0 1 -- 172.21.15.66:0/2157234084 wait complete. 2024-09-12T00:19:06.979 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'YWDlAhqDbN4xVFFMZukgOfv6QCFYcHCYa38nMsu6', 'active': True, 'create_date': '2024-09-12T00:19:06.944875Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:06.980 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T00:19:06.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T00:19:06.980 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-12T00:19:07.061 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.061 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95fbb59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56415d88f650 0x56415d891a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95fbb59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56415d73f9c0 con 0x56415d88b4b0 2024-09-12T00:19:07.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95fbb59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56415d78f6d0 con 0x56415d88f650 2024-09-12T00:19:07.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95d6bb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56415d88b4b0 0x56415d88b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42810/0 (socket says 172.21.15.66:42810) 2024-09-12T00:19:07.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95ceba640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56415d88f650 0x56415d891a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2438690155 learned_addr learned my addr 172.21.15.66:0/2438690155 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:07.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa94ffff640 1 -- 172.21.15.66:0/2438690155 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077505453 0 0) 0x56415d73f9c0 con 0x56415d88b4b0 2024-09-12T00:19:07.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa94ffff640 1 -- 172.21.15.66:0/2438690155 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa948001e20 con 0x56415d88b4b0 2024-09-12T00:19:07.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95ceba640 1 -- 172.21.15.66:0/2438690155 >> v1:172.21.15.31:6789/0 conn(0x56415d88b4b0 legacy=0x56415d88b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.057+0000 7fa95ceba640 1 -- 172.21.15.66:0/2438690155 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d733ca0 con 0x56415d88f650 2024-09-12T00:19:07.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2438690155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88f650 0x56415d891a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa95400a480 tx=0x7fa95401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85f9ef91a0018e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa94ffff640 1 -- 172.21.15.66:0/2438690155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9540aa570 con 0x56415d88f650 2024-09-12T00:19:07.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa94ffff640 1 -- 172.21.15.66:0/2438690155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9540af070 con 0x56415d88f650 2024-09-12T00:19:07.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa94ffff640 1 -- 172.21.15.66:0/2438690155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9540aa860 con 0x56415d88f650 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2438690155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88f650 msgr2=0x56415d891a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2438690155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88f650 0x56415d891a40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa95400a480 tx=0x7fa95401b310 comp rx=0 tx=0).stop 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2438690155 shutdown_connections 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2438690155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88f650 0x56415d891a40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2438690155 >> 172.21.15.66:0/2438690155 conn(0x56415d886fd0 msgr2=0x56415d8893f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2438690155 shutdown_connections 2024-09-12T00:19:07.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.061+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2438690155 wait complete. 2024-09-12T00:19:07.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95fbb59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95fbb59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56415d793680 con 0x56415d88b4b0 2024-09-12T00:19:07.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95d6bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95d6bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44092/0 (socket says 172.21.15.66:44092) 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2749228398 learned_addr learned my addr 172.21.15.66:0/2749228398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2749228398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d70eda0 con 0x56415d88b4b0 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2749228398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9580016a0 tx=0x7fa958001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d17bc6f51bc70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa84b606640 1 -- 172.21.15.66:0/2749228398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958004530 con 0x56415d88b4b0 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa84b606640 1 -- 172.21.15.66:0/2749228398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9580046d0 con 0x56415d88b4b0 2024-09-12T00:19:07.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.077+0000 7fa84b606640 1 -- 172.21.15.66:0/2749228398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9580049f0 con 0x56415d88b4b0 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2749228398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 msgr2=0x56415d801f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2749228398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa9580016a0 tx=0x7fa958001b60 comp rx=0 tx=0).stop 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2749228398 shutdown_connections 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2749228398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d801f10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2749228398 >> 172.21.15.66:0/2749228398 conn(0x56415d886fd0 msgr2=0x56415d9723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2749228398 shutdown_connections 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2749228398 wait complete. 2024-09-12T00:19:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56415d735a50 con 0x56415d88b4b0 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95d6bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95d6bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44098/0 (socket says 172.21.15.66:44098) 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2511026413 learned_addr learned my addr 172.21.15.66:0/2511026413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d980540 con 0x56415d88b4b0 2024-09-12T00:19:07.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56415d801af0 tx=0x7fa958004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa849e03640 1 -- 172.21.15.66:0/2511026413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958013760 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa849e03640 1 -- 172.21.15.66:0/2511026413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958013900 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56415d9807d0 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa849e03640 1 -- 172.21.15.66:0/2511026413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958013c00 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.081+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415d981090 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa849e03640 1 -- 172.21.15.66:0/2511026413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa958010070 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa849e03640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 0x7fa84403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa849e03640 1 -- 172.21.15.66:0/2511026413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa958018070 con 0x56415d88b4b0 2024-09-12T00:19:07.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 0x7fa84403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 0x56415d987060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9875a0 con 0x56415d88f650 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95debc640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 0x56415d987060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 0x7fa84403bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ae000 tx=0x7fa9540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95debc640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 0x56415d987060 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95debc640 1 -- 172.21.15.66:0/2511026413 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9500083f0 con 0x56415d88f650 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d981400 con 0x56415d88f650 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95debc640 1 -- 172.21.15.66:0/2511026413 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x56415d88f650 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 0x56415d98bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d98c370 con 0x56415d989890 2024-09-12T00:19:07.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 0x56415d98bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 0x56415d98bc80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2511026413 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa95801b030 con 0x56415d989890 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d988730 con 0x56415d88f650 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95debc640 1 -- 172.21.15.66:0/2511026413 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9500083f0 con 0x56415d88f650 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d988c10 con 0x56415d989890 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2511026413 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa95801b030 con 0x56415d989890 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.085+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95fbb59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95fbb59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56415d7a0450 con 0x56415d99aae0 2024-09-12T00:19:07.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44114/0 (socket says 172.21.15.66:44114) 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95debc640 1 -- 172.21.15.66:0/1802683830 learned_addr learned my addr 172.21.15.66:0/1802683830 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95debc640 1 -- 172.21.15.66:0/1802683830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d99b540 con 0x56415d99aae0 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95debc640 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56415d981280 tx=0x7fa95000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa842ffd640 1 -- 172.21.15.66:0/1802683830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95001c020 con 0x56415d99aae0 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa842ffd640 1 -- 172.21.15.66:0/1802683830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950007d20 con 0x56415d99aae0 2024-09-12T00:19:07.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa842ffd640 1 -- 172.21.15.66:0/1802683830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950018440 con 0x56415d99aae0 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56415d99bda0 con 0x56415d99aae0 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415d99c310 con 0x56415d99aae0 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.089+0000 7fa842ffd640 1 -- 172.21.15.66:0/1802683830 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa95001f020 con 0x56415d99aae0 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa842ffd640 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 0x7fa83403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa842ffd640 1 -- 172.21.15.66:0/1802683830 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa950051c50 con 0x56415d99aae0 2024-09-12T00:19:07.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 0x7fa83403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56415d802740 con 0x56415d9a8450 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 0x7fa83403bf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9580115a0 tx=0x7fa958043040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44122/0 (socket says 172.21.15.66:44122) 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 -- 172.21.15.66:0/2807443680 learned_addr learned my addr 172.21.15.66:0/2807443680 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 -- 172.21.15.66:0/2807443680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d9a8e20 con 0x56415d9a8450 2024-09-12T00:19:07.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 --2- 172.21.15.66:0/2807443680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa950008f90 tx=0x7fa950016990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a95dd315f97a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa840ff9640 1 -- 172.21.15.66:0/2807443680 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950016460 con 0x56415d9a8450 2024-09-12T00:19:07.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa840ff9640 1 -- 172.21.15.66:0/2807443680 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950029350 con 0x56415d9a8450 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa840ff9640 1 -- 172.21.15.66:0/2807443680 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950020c90 con 0x56415d9a8450 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2807443680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 msgr2=0x56415d9a8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2807443680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa950008f90 tx=0x7fa950016990 comp rx=0 tx=0).stop 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2807443680 shutdown_connections 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2807443680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9a8830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2807443680 >> 172.21.15.66:0/2807443680 conn(0x56415d9a3870 msgr2=0x56415d9a1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2807443680 shutdown_connections 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2807443680 wait complete. 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 Processor -- start 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- start start 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95fbb59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56415d9a73a0 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44124/0 (socket says 172.21.15.66:44124) 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.093+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 learned_addr learned my addr 172.21.15.66:0/2370808635 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415d9aeeb0 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95debc640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9ae950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa950016fd0 tx=0x7fa95004fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 -- 172.21.15.66:0/2370808635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9500178b0 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 -- 172.21.15.66:0/2370808635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950017a50 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56415d9af140 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 -- 172.21.15.66:0/2370808635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa950017d30 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415d9af140 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 -- 172.21.15.66:0/2370808635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa950016040 con 0x56415d9a8450 2024-09-12T00:19:07.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa828039ac0 0x7fa82803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa832ffd640 1 -- 172.21.15.66:0/2370808635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa950033070 con 0x56415d9a8450 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa828039ac0 0x7fa82803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d9b9cc0 0x56415d9bc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9bc8a0 con 0x56415d9b9cc0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d9b9cc0 0x56415d9bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa828039ac0 0x7fa82803bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa958013fd0 tx=0x7fa958033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d9b9cc0 0x56415d9bc150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 realm 2024-09-12T00:19:07.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9bccd0 con 0x56415d9b9cc0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.097+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9bd5a0 con 0x56415d9b9cc0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9bd940 con 0x56415d9b9cc0 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d9be6a0 0x56415d9c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c10a0 con 0x56415d9be6a0 2024-09-12T00:19:07.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d9be6a0 0x56415d9c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d9be6a0 0x56415d9c0a90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 20 searching for the correct realm 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa950021020 0x7fa9500187c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa950021020 0x7fa9500187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa950021020 0x7fa9500187c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95d6bb640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa95801db80 0x7fa95804d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa95801db80 0x7fa95804d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.101+0000 7fa95ceba640 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa95801db80 0x7fa95804d150 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.105+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.109+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9be6a0 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa95801db80 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x56415d9b9cc0 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2900 con 0x7fa950021020 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:07.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c19f0 con 0x56415d9b9cc0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c2240 con 0x56415d9b9cc0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c1630 con 0x56415d9be6a0 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 zone default found 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 4 Realm: () 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 zonegroup default 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.113+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c31e0 con 0x7fa95801db80 2024-09-12T00:19:07.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c5420 con 0x56415d9be6a0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c57c0 con 0x56415d9be6a0 2024-09-12T00:19:07.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 started sync module instance, tier type = 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c4860 con 0x7fa950021020 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94838743387264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c5c70 con 0x7fa950021020 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c64c0 con 0x56415d9b9cc0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.117+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94838743387264] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94838743390144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c64c0 con 0x56415d9b9cc0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c6f60 con 0x56415d9be6a0 2024-09-12T00:19:07.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94838743394864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c6f20 con 0x56415d9be6a0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c7e60 con 0x7fa950021020 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.121+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94838743390144] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838743398768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c7e60 con 0x7fa950021020 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c8870 con 0x56415d9b9cc0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94838743394864] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94838743398768] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94838743392272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c83c0 con 0x56415d9b9cc0 2024-09-12T00:19:07.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c9110 con 0x7fa95801db80 2024-09-12T00:19:07.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.125+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94838743392272] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94838743397200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c8e00 con 0x7fa95801db80 2024-09-12T00:19:07.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c9650 con 0x7fa95801db80 2024-09-12T00:19:07.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94838743397200] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94838743403104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c9470 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.129+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c9f90 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94838743407200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ca400 con 0x7fa95801db80 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=0 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=1 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=2 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=3 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=4 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=5 2024-09-12T00:19:07.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94838743403104] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=6 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94838743407200] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540a8070 con 0x7fa95801db80 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 20 add_watcher() i=7 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9c8f00 con 0x56415d9b9cc0 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9540a8070 con 0x56415d9b9cc0 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.133+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94838743404224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ca980 con 0x56415d9b9cc0 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94838743404224] v31'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:07.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 5 note: GC not initialized 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa8127e4640 20 reqs_thread_entry: start 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 Filter name: none 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa783fff640 20 reqs_thread_entry: start 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9f0a10 con 0x56415d9b9cc0 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:07.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9f75b0 con 0x56415d9b9cc0 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94838743593024 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56415d9f2d00 con 0x56415d9b9cc0 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94838743392272 notify 133143986182 ret 0) ==== 774+0+0 (crc 0 0 0) 0x56415d733ca0 con 0x56415d9b9cc0 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa840ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94838743392272 notifier 4369 bl.length()=732 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa840ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa840ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(64 notify.4 [notify cookie 94838743593024 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.137+0000 7fa840ff9640 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa820003eb0 con 0x56415d9b9cc0 2024-09-12T00:19:07.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94838743593024 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9540d77c0 con 0x56415d9b9cc0 2024-09-12T00:19:07.149 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa8137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94838743404224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9f3130 con 0x56415d9b9cc0 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94838743404224] v31'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94838743387264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x7fa950021020 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94838743387264] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95fbb59c0 20 remove_watcher() i=0 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95fbb59c0 2 removed watcher, disabling cache 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.141+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94838743390144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x56415d9b9cc0 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94838743390144] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95fbb59c0 20 remove_watcher() i=1 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94838743394864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x56415d9be6a0 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95debc640 1 -- 172.21.15.66:0/2370808635 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94838743394864] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95003d020 con 0x56415d9be6a0 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95fbb59c0 20 remove_watcher() i=2 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.145+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838743398768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x7fa950021020 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95d6bb640 1 -- 172.21.15.66:0/2370808635 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94838743398768] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa95801b030 con 0x7fa950021020 2024-09-12T00:19:07.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95fbb59c0 20 remove_watcher() i=3 2024-09-12T00:19:07.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94838743392272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x56415d9b9cc0 2024-09-12T00:19:07.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94838743392272] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x56415d9b9cc0 2024-09-12T00:19:07.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95fbb59c0 20 remove_watcher() i=4 2024-09-12T00:19:07.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.149+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94838743397200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x7fa95801db80 2024-09-12T00:19:07.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94838743397200] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x7fa95801db80 2024-09-12T00:19:07.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95fbb59c0 20 remove_watcher() i=5 2024-09-12T00:19:07.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94838743403104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x7fa95801db80 2024-09-12T00:19:07.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94838743403104] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x7fa95801db80 2024-09-12T00:19:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95fbb59c0 20 remove_watcher() i=6 2024-09-12T00:19:07.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.153+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94838743407200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56415d9ee770 con 0x7fa95801db80 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94838743407200] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9540d5040 con 0x7fa95801db80 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 20 remove_watcher() i=7 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa95801db80 msgr2=0x7fa95804d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa95801db80 0x7fa95804d150 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d9b9cc0 msgr2=0x56415d9bc150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d9b9cc0 0x56415d9bc150 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa950021020 msgr2=0x7fa9500187c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa950021020 0x7fa9500187c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d9be6a0 msgr2=0x56415d9c0a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d9be6a0 0x56415d9c0a90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa828039ac0 msgr2=0x7fa82803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa828039ac0 0x7fa82803bf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa958013fd0 tx=0x7fa958033000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 msgr2=0x56415d9ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2370808635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d9a8450 0x56415d9ae950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa950016fd0 tx=0x7fa95004fff0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 reap_dead start 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95ceba640 1 -- 172.21.15.66:0/2370808635 reap_dead start 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 shutdown_connections 2024-09-12T00:19:07.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 >> 172.21.15.66:0/2370808635 conn(0x56415d9a3870 msgr2=0x56415d9a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 shutdown_connections 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2370808635 wait complete. 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 msgr2=0x7fa83403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 0x7fa83403bf80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9580115a0 tx=0x7fa958043040 comp rx=0 tx=0).stop 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 msgr2=0x56415d99af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56415d981280 tx=0x7fa95000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 shutdown_connections 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa834039ac0 0x7fa83403bf80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/1802683830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d99aae0 0x56415d99af00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 >> 172.21.15.66:0/1802683830 conn(0x56415d990490 msgr2=0x56415d990870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 shutdown_connections 2024-09-12T00:19:07.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/1802683830 wait complete. 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 msgr2=0x56415d987060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 0x56415d987060 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 msgr2=0x56415d98bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 0x56415d98bc80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 msgr2=0x7fa84403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 0x7fa84403bf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa9540ae000 tx=0x7fa9540a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 msgr2=0x56415d97ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56415d801af0 tx=0x7fa958004470 comp rx=0 tx=0).stop 2024-09-12T00:19:07.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 shutdown_connections 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56415d989890 0x56415d98bc80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56415d88f650 0x56415d987060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa844039a70 0x7fa84403bf30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 --2- 172.21.15.66:0/2511026413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56415d88b4b0 0x56415d97ffe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 >> 172.21.15.66:0/2511026413 conn(0x56415d886fd0 msgr2=0x56415d800c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 shutdown_connections 2024-09-12T00:19:07.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.157+0000 7fa95fbb59c0 1 -- 172.21.15.66:0/2511026413 wait complete. 2024-09-12T00:19:07.171 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:07.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.171 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:07.241 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.241 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1c92c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5583c2954520 0x5583c2954900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1c92c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583c28089c0 con 0x5583c29576b0 2024-09-12T00:19:07.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1c92c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5583c28586d0 con 0x5583c2954520 2024-09-12T00:19:07.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1a432640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5583c2954520 0x5583c2954900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e19c31640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5583c29576b0 0x5583c2959aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42826/0 (socket says 172.21.15.66:42826) 2024-09-12T00:19:07.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e19c31640 1 -- 172.21.15.66:0/634924652 learned_addr learned my addr 172.21.15.66:0/634924652 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:07.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1a432640 1 -- 172.21.15.66:0/634924652 >> v1:172.21.15.31:6789/0 conn(0x5583c29576b0 legacy=0x5583c2959aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.237+0000 7f6e1a432640 1 -- 172.21.15.66:0/634924652 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c27fcca0 con 0x5583c2954520 2024-09-12T00:19:07.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1a432640 1 --2- 172.21.15.66:0/634924652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2954900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00a480 tx=0x7f6e0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ddd111b61b5cae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e19430640 1 -- 172.21.15.66:0/634924652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0b0070 con 0x5583c2954520 2024-09-12T00:19:07.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e19430640 1 -- 172.21.15.66:0/634924652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0ab540 con 0x5583c2954520 2024-09-12T00:19:07.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e19430640 1 -- 172.21.15.66:0/634924652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0ab840 con 0x5583c2954520 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/634924652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 msgr2=0x5583c2954900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/634924652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2954900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00a480 tx=0x7f6e0c01b280 comp rx=0 tx=0).stop 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/634924652 shutdown_connections 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/634924652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2954900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/634924652 >> 172.21.15.66:0/634924652 conn(0x5583c2950040 msgr2=0x5583c2952460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/634924652 shutdown_connections 2024-09-12T00:19:07.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.241+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/634924652 wait complete. 2024-09-12T00:19:07.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583c285c680 con 0x5583c2954520 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44134/0 (socket says 172.21.15.66:44134) 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 -- 172.21.15.66:0/1573716184 learned_addr learned my addr 172.21.15.66:0/1573716184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 -- 172.21.15.66:0/1573716184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c27d7da0 con 0x5583c2954520 2024-09-12T00:19:07.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 --2- 172.21.15.66:0/1573716184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ae040 tx=0x7f6e0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eac3e8621e0adf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6d08608640 1 -- 172.21.15.66:0/1573716184 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0b0070 con 0x5583c2954520 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6d08608640 1 -- 172.21.15.66:0/1573716184 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0b1040 con 0x5583c2954520 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6d08608640 1 -- 172.21.15.66:0/1573716184 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0ab6f0 con 0x5583c2954520 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/1573716184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 msgr2=0x5583c2a3f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/1573716184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ae040 tx=0x7f6e0c003030 comp rx=0 tx=0).stop 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/1573716184 shutdown_connections 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/1573716184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a3f800 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/1573716184 >> 172.21.15.66:0/1573716184 conn(0x5583c2950040 msgr2=0x5583c2a3b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/1573716184 shutdown_connections 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/1573716184 wait complete. 2024-09-12T00:19:07.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1c92c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583c27fea50 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44150/0 (socket says 172.21.15.66:44150) 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.257+0000 7f6e1a432640 1 -- 172.21.15.66:0/3744454614 learned_addr learned my addr 172.21.15.66:0/3744454614 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1a432640 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c2a47200 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ae040 tx=0x7f6e0c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 -- 172.21.15.66:0/3744454614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0b7480 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583c2a47490 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 -- 172.21.15.66:0/3744454614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c0b7620 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 -- 172.21.15.66:0/3744454614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e0c0b7920 con 0x5583c2954520 2024-09-12T00:19:07.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c2a47e40 con 0x5583c2954520 2024-09-12T00:19:07.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 -- 172.21.15.66:0/3744454614 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e0c0b7ac0 con 0x5583c2954520 2024-09-12T00:19:07.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 0x7f6d0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6d06e05640 1 -- 172.21.15.66:0/3744454614 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e0c0bc070 con 0x5583c2954520 2024-09-12T00:19:07.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 0x7f6d0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 0x5583c2a4de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a4e350 con 0x5583c29576b0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 0x5583c2a4de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 0x7f6d0003bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e10001d80 tx=0x7f6e100012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 0x5583c2a4de10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3744454614 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c29576b0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.261+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a4e730 con 0x5583c29576b0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3744454614 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c29576b0 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 0x5583c2a52930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a53000 con 0x5583c2a50540 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 0x5583c2a52930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 0x5583c2a52930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1a432640 1 -- 172.21.15.66:0/3744454614 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e0c0d0070 con 0x5583c2a50540 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a4f3e0 con 0x5583c29576b0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3744454614 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c29576b0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a4f8c0 con 0x5583c2a50540 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1a432640 1 -- 172.21.15.66:0/3744454614 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e0c0d0070 con 0x5583c2a50540 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583c2869450 con 0x5583c28cb1e0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44156/0 (socket says 172.21.15.66:44156) 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 -- 172.21.15.66:0/2844389125 learned_addr learned my addr 172.21.15.66:0/2844389125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 -- 172.21.15.66:0/2844389125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c28cb700 con 0x5583c28cb1e0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5583c2a48dc0 tx=0x7f6e140167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6cfffff640 1 -- 172.21.15.66:0/2844389125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14013640 con 0x5583c28cb1e0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6cfffff640 1 -- 172.21.15.66:0/2844389125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e140137e0 con 0x5583c28cb1e0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583c28c9fc0 con 0x5583c28cb1e0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6cfffff640 1 -- 172.21.15.66:0/2844389125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14013ac0 con 0x5583c28cb1e0 2024-09-12T00:19:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.265+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c28ca530 con 0x5583c28cb1e0 2024-09-12T00:19:07.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfffff640 1 -- 172.21.15.66:0/2844389125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e14011040 con 0x5583c28cb1e0 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfffff640 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 0x7f6cf403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfffff640 1 -- 172.21.15.66:0/2844389125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e1400e040 con 0x5583c28cb1e0 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1a432640 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 0x7f6cf403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1a432640 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 0x7f6cf403bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0b67d0 tx=0x7f6e0c0e9800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583c2a3ff70 con 0x5583c2a70280 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44162/0 (socket says 172.21.15.66:44162) 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1ac33640 1 -- 172.21.15.66:0/2709457211 learned_addr learned my addr 172.21.15.66:0/2709457211 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1ac33640 1 -- 172.21.15.66:0/2709457211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c2a70c30 con 0x5583c2a70280 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/2709457211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e140508f0 tx=0x7f6e140206f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3feba7d110ff7bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfdffb640 1 -- 172.21.15.66:0/2709457211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14041e60 con 0x5583c2a70280 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfdffb640 1 -- 172.21.15.66:0/2709457211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e14052110 con 0x5583c2a70280 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6cfdffb640 1 -- 172.21.15.66:0/2709457211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1402a3f0 con 0x5583c2a70280 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2709457211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 msgr2=0x5583c2a70660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2709457211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e140508f0 tx=0x7f6e140206f0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2709457211 shutdown_connections 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2709457211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a70660 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2709457211 >> 172.21.15.66:0/2709457211 conn(0x5583c2a6c6b0 msgr2=0x5583c2a6a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2709457211 shutdown_connections 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.269+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2709457211 wait complete. 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 Processor -- start 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 -- start start 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a77760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583c2a71290 con 0x5583c2a70280 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a77760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1ac33640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a77760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44174/0 (socket says 172.21.15.66:44174) 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 learned_addr learned my addr 172.21.15.66:0/3917111672 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c2a77cc0 con 0x5583c2a70280 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a77760 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e1404f770 tx=0x7f6e14050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 -- 172.21.15.66:0/3917111672 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1403ecb0 con 0x5583c2a70280 2024-09-12T00:19:07.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 -- 172.21.15.66:0/3917111672 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1403ee50 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 -- 172.21.15.66:0/3917111672 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e14050a30 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583c2a77f50 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c2a77f50 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 -- 172.21.15.66:0/3917111672 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6e14050bf0 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ce4039a70 0x7f6ce403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6cebfff640 1 -- 172.21.15.66:0/3917111672 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6e14034c70 con 0x5583c2a70280 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ce4039a70 0x7f6ce403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c2a82ae0 0x5583c2a84f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a856c0 con 0x5583c2a82ae0 2024-09-12T00:19:07.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.273+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c2a82ae0 0x5583c2a84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ce4039a70 0x7f6ce403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c000c10 tx=0x7f6e0c0d9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c2a82ae0 0x5583c2a84f70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1000e5a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 realm 2024-09-12T00:19:07.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a81e90 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1000e5a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a861c0 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e1000e5a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a86a90 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e1000e5a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a87390 0x5583c2a89780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a89ec0 con 0x5583c2a87390 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a87390 0x5583c2a89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a87390 0x5583c2a89780 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 20 searching for the correct realm 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e14021440 0x7f6e1401c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e14021440 0x7f6e1401c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e14021440 0x7f6e1401c1f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e0c0ab030 0x7f6e0c0073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e0c0ab030 0x7f6e0c0073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.277+0000 7f6e19c31640 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e0c0ab030 0x7f6e0c0073f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1000e5a0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1000e5a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.281+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.285+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a87390 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e0c0ab030 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x5583c2a82ae0 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b720 con 0x7f6e14021440 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.289+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8a810 con 0x5583c2a82ae0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8b0b0 con 0x5583c2a82ae0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8a450 con 0x5583c2a87390 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 zone default found 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 4 Realm: () 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 zonegroup default 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8ace0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8db10 con 0x5583c2a87390 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8dff0 con 0x5583c2a87390 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 started sync module instance, tier type = 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8cfb0 con 0x7f6e14021440 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024394920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8e900 con 0x7f6e14021440 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.293+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8f150 con 0x5583c2a82ae0 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024394920864] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024394925136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8f150 con 0x5583c2a82ae0 2024-09-12T00:19:07.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8fbe0 con 0x5583c2a87390 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024394929808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8fba0 con 0x5583c2a87390 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a90af0 con 0x7f6e14021440 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.297+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024394925136] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024394933792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a90ee0 con 0x7f6e14021440 2024-09-12T00:19:07.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a918a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024394929808] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024394933792] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024394932176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a918a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.301+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a92140 con 0x7f6e0c0ab030 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024394932176] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024394937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a91ed0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a929f0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024394941632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a92e60 con 0x7f6e0c0ab030 2024-09-12T00:19:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a93950 con 0x7f6e0c0ab030 2024-09-12T00:19:07.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.305+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024394937600] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024394945568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a93910 con 0x7f6e0c0ab030 2024-09-12T00:19:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=0 2024-09-12T00:19:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=1 2024-09-12T00:19:07.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=2 2024-09-12T00:19:07.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=3 2024-09-12T00:19:07.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=4 2024-09-12T00:19:07.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=5 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024394941632] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=6 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024394945568] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 20 add_watcher() i=7 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:07.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a929b0 con 0x5583c2a82ae0 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.309+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024394942896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a93d80 con 0x5583c2a82ae0 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024394942896] v31'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 5 note: GC not initialized 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6c4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 Filter name: none 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6c497fa640 20 reqs_thread_entry: start 2024-09-12T00:19:07.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583c2ab99a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T00:19:07.320 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6cd0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.313+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024394942896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2ab8470 con 0x5583c2a82ae0 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94024394942896] v31'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024394920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a929b0 con 0x7f6e14021440 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94024394920864] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 20 remove_watcher() i=0 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 2 removed watcher, disabling cache 2024-09-12T00:19:07.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024394925136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8d3a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94024394925136] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 20 remove_watcher() i=1 2024-09-12T00:19:07.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.317+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024394929808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8d3a0 con 0x5583c2a87390 2024-09-12T00:19:07.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1ac33640 1 -- 172.21.15.66:0/3917111672 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94024394929808] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1400a4d0 con 0x5583c2a87390 2024-09-12T00:19:07.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 20 remove_watcher() i=2 2024-09-12T00:19:07.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024394933792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8d3a0 con 0x7f6e14021440 2024-09-12T00:19:07.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1a432640 1 -- 172.21.15.66:0/3917111672 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94024394933792] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e0c0d0070 con 0x7f6e14021440 2024-09-12T00:19:07.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 20 remove_watcher() i=3 2024-09-12T00:19:07.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024394932176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8d3a0 con 0x5583c2a82ae0 2024-09-12T00:19:07.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94024394932176] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x5583c2a82ae0 2024-09-12T00:19:07.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 20 remove_watcher() i=4 2024-09-12T00:19:07.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.321+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024394937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8ffd0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94024394937600] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e1c92c9c0 20 remove_watcher() i=5 2024-09-12T00:19:07.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024394941632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a8d3a0 con 0x7f6e0c0ab030 2024-09-12T00:19:07.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94024394941632] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e1c92c9c0 20 remove_watcher() i=6 2024-09-12T00:19:07.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.325+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024394945568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583c2a91500 con 0x7f6e0c0ab030 2024-09-12T00:19:07.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94024394945568] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e10029040 con 0x7f6e0c0ab030 2024-09-12T00:19:07.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 20 remove_watcher() i=7 2024-09-12T00:19:07.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e0c0ab030 msgr2=0x7f6e0c0073f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6e0c0ab030 0x7f6e0c0073f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c2a82ae0 msgr2=0x5583c2a84f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c2a82ae0 0x5583c2a84f70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e14021440 msgr2=0x7f6e1401c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6e14021440 0x7f6e1401c1f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a87390 msgr2=0x5583c2a89780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a87390 0x5583c2a89780 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ce4039a70 msgr2=0x7f6ce403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ce4039a70 0x7f6ce403bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c000c10 tx=0x7f6e0c0d9000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 msgr2=0x5583c2a77760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3917111672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2a70280 0x5583c2a77760 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e1404f770 tx=0x7f6e14050880 comp rx=0 tx=0).stop 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e19c31640 1 -- 172.21.15.66:0/3917111672 reap_dead start 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 shutdown_connections 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 >> 172.21.15.66:0/3917111672 conn(0x5583c2a6c6b0 msgr2=0x5583c2a6a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 shutdown_connections 2024-09-12T00:19:07.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3917111672 wait complete. 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 msgr2=0x7f6cf403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 0x7f6cf403bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0b67d0 tx=0x7f6e0c0e9800 comp rx=0 tx=0).stop 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 msgr2=0x5583c28c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5583c2a48dc0 tx=0x7f6e140167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 shutdown_connections 2024-09-12T00:19:07.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6cf4039a70 0x7f6cf403bf30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/2844389125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c28cb1e0 0x5583c28c9a80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 >> 172.21.15.66:0/2844389125 conn(0x5583c2a570e0 msgr2=0x5583c2a574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 shutdown_connections 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/2844389125 wait complete. 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 msgr2=0x5583c2a4de10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 0x5583c2a4de10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 msgr2=0x5583c2a52930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 0x5583c2a52930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 msgr2=0x7f6d0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 0x7f6d0003bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6e10001d80 tx=0x7f6e100012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 msgr2=0x5583c2a46ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0ae040 tx=0x7f6e0c018020 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 shutdown_connections 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583c2a50540 0x5583c2a52930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583c29576b0 0x5583c2a4de10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6d00039a70 0x7f6d0003bf30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 --2- 172.21.15.66:0/3744454614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583c2954520 0x5583c2a46ca0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 >> 172.21.15.66:0/3744454614 conn(0x5583c2950040 msgr2=0x5583c2a39f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 shutdown_connections 2024-09-12T00:19:07.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.329+0000 7f6e1c92c9c0 1 -- 172.21.15.66:0/3744454614 wait complete. 2024-09-12T00:19:07.344 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:07.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.344 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:07.418 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.418 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7e4f89c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559cec5b2fd0 0x559cec6411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7e4f89c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559cec4f29c0 con 0x559cec6416f0 2024-09-12T00:19:07.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7e4f89c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x559cec5426d0 con 0x559cec5b2fd0 2024-09-12T00:19:07.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7bffe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559cec5b2fd0 0x559cec6411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7bffe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x559cec5b2fd0 0x559cec6411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44182/0 (socket says 172.21.15.66:44182) 2024-09-12T00:19:07.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.413+0000 7f4f7bffe640 1 -- 172.21.15.66:0/1140499347 learned_addr learned my addr 172.21.15.66:0/1140499347 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7bffe640 1 -- 172.21.15.66:0/1140499347 >> v1:172.21.15.31:6789/0 conn(0x559cec6416f0 legacy=0x559cec643ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7bffe640 1 -- 172.21.15.66:0/1140499347 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec4e6ca0 con 0x559cec5b2fd0 2024-09-12T00:19:07.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/1140499347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec6411b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400a4e0 tx=0x7f4f7401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f87c3f8b68889fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7affc640 1 -- 172.21.15.66:0/1140499347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740aa540 con 0x559cec5b2fd0 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7affc640 1 -- 172.21.15.66:0/1140499347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740aa6e0 con 0x559cec5b2fd0 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7affc640 1 -- 172.21.15.66:0/1140499347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740aaa40 con 0x559cec5b2fd0 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/1140499347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 msgr2=0x559cec6411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/1140499347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec6411b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400a4e0 tx=0x7f4f7401b090 comp rx=0 tx=0).stop 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/1140499347 shutdown_connections 2024-09-12T00:19:07.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/1140499347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec6411b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/1140499347 >> 172.21.15.66:0/1140499347 conn(0x559cec638ee0 msgr2=0x559cec63b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/1140499347 shutdown_connections 2024-09-12T00:19:07.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.417+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/1140499347 wait complete. 2024-09-12T00:19:07.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.429+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.429+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.429+0000 7f4f7e4f89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.429+0000 7f4f7e4f89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559cec546680 con 0x559cec5b2fd0 2024-09-12T00:19:07.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44190/0 (socket says 172.21.15.66:44190) 2024-09-12T00:19:07.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 -- 172.21.15.66:0/2617954744 learned_addr learned my addr 172.21.15.66:0/2617954744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 -- 172.21.15.66:0/2617954744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec4c1da0 con 0x559cec5b2fd0 2024-09-12T00:19:07.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/2617954744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f74019740 tx=0x7f4f740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34285f0bbc77dac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4e69e0b640 1 -- 172.21.15.66:0/2617954744 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740b9070 con 0x559cec5b2fd0 2024-09-12T00:19:07.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4e69e0b640 1 -- 172.21.15.66:0/2617954744 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740aaa90 con 0x559cec5b2fd0 2024-09-12T00:19:07.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4e69e0b640 1 -- 172.21.15.66:0/2617954744 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740aad70 con 0x559cec5b2fd0 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2617954744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 msgr2=0x559cec63e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2617954744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f74019740 tx=0x7f4f740033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2617954744 shutdown_connections 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2617954744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec63e690 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2617954744 >> 172.21.15.66:0/2617954744 conn(0x559cec638ee0 msgr2=0x559cec7255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2617954744 shutdown_connections 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2617954744 wait complete. 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7e4f89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559cec4e8a50 con 0x559cec5b2fd0 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44206/0 (socket says 172.21.15.66:44206) 2024-09-12T00:19:07.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3741884124 learned_addr learned my addr 172.21.15.66:0/3741884124 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec733510 con 0x559cec5b2fd0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.433+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f74018cc0 tx=0x7f4f74017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 -- 172.21.15.66:0/3741884124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740b9070 con 0x559cec5b2fd0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cec7337a0 con 0x559cec5b2fd0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 -- 172.21.15.66:0/3741884124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740b5ad0 con 0x559cec5b2fd0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 -- 172.21.15.66:0/3741884124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f740b5db0 con 0x559cec5b2fd0 2024-09-12T00:19:07.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cec734150 con 0x559cec5b2fd0 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 -- 172.21.15.66:0/3741884124 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4f740b3040 con 0x559cec5b2fd0 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 0x7f4e6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4e63fff640 1 -- 172.21.15.66:0/3741884124 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f4f740c4070 con 0x559cec5b2fd0 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 0x7f4e6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 0x559cec73a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec73a660 con 0x559cec6416f0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 0x559cec73a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 0x7f4e6403bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f70001e60 tx=0x7f4f700013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 0x559cec73a120 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3741884124 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f6c0083f0 con 0x559cec6416f0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec7344d0 con 0x559cec6416f0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3741884124 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f6c0083f0 con 0x559cec6416f0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 0x559cec73ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec73f450 con 0x559cec73c970 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 0x559cec73ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 0x559cec73ed60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3741884124 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f740c7de0 con 0x559cec73c970 2024-09-12T00:19:07.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec73b840 con 0x559cec6416f0 2024-09-12T00:19:07.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.437+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3741884124 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f6c0083f0 con 0x559cec6416f0 2024-09-12T00:19:07.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec73bca0 con 0x559cec73c970 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3741884124 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f740c7de0 con 0x559cec73c970 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559cec553450 con 0x559cec74db60 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44216/0 (socket says 172.21.15.66:44216) 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/2333578326 learned_addr learned my addr 172.21.15.66:0/2333578326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/2333578326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec74e5c0 con 0x559cec74db60 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x559cec734340 tx=0x7f4f6c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4e617fa640 1 -- 172.21.15.66:0/2333578326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c007c30 con 0x559cec74db60 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4e617fa640 1 -- 172.21.15.66:0/2333578326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c007dd0 con 0x559cec74db60 2024-09-12T00:19:07.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cec74ee20 con 0x559cec74db60 2024-09-12T00:19:07.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4e617fa640 1 -- 172.21.15.66:0/2333578326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c0195c0 con 0x559cec74db60 2024-09-12T00:19:07.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cec74f390 con 0x559cec74db60 2024-09-12T00:19:07.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.441+0000 7f4e617fa640 1 -- 172.21.15.66:0/2333578326 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4f6c016050 con 0x559cec74db60 2024-09-12T00:19:07.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4e617fa640 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 0x7f4e5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4e617fa640 1 -- 172.21.15.66:0/2333578326 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f4f6c051dc0 con 0x559cec74db60 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 0x7f4e5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 0x7f4e5403bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559cec73f820 tx=0x7f4f74005c50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559cec63ee00 con 0x559cec75b4d0 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44222/0 (socket says 172.21.15.66:44222) 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/2949280259 learned_addr learned my addr 172.21.15.66:0/2949280259 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/2949280259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec75bea0 con 0x559cec75b4d0 2024-09-12T00:19:07.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/2949280259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c024f00 tx=0x7f4f6c0431c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e88a7ab014ec277 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4e5affd640 1 -- 172.21.15.66:0/2949280259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c017a30 con 0x559cec75b4d0 2024-09-12T00:19:07.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4e5affd640 1 -- 172.21.15.66:0/2949280259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c017bd0 con 0x559cec75b4d0 2024-09-12T00:19:07.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4e5affd640 1 -- 172.21.15.66:0/2949280259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c018dc0 con 0x559cec75b4d0 2024-09-12T00:19:07.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2949280259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 msgr2=0x559cec75b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2949280259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c024f00 tx=0x7f4f6c0431c0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2949280259 shutdown_connections 2024-09-12T00:19:07.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2949280259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec75b8b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2949280259 >> 172.21.15.66:0/2949280259 conn(0x559cec756890 msgr2=0x559cec754ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2949280259 shutdown_connections 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2949280259 wait complete. 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 Processor -- start 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- start start 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7e4f89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559cec75a3c0 con 0x559cec75b4d0 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44236/0 (socket says 172.21.15.66:44236) 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 learned_addr learned my addr 172.21.15.66:0/3359314964 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.445+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cec761f10 con 0x559cec75b4d0 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c050070 tx=0x7f4f6c0500a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 -- 172.21.15.66:0/3359314964 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c033070 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559cec7621a0 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 -- 172.21.15.66:0/3359314964 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c017340 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 -- 172.21.15.66:0/3359314964 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f6c017660 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cec762b50 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 -- 172.21.15.66:0/3359314964 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4f6c036070 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e44039c10 0x7f4e4403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4e597fa640 1 -- 172.21.15.66:0/3359314964 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f4f6c039c90 con 0x559cec75b4d0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e44039c10 0x7f4e4403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec76ced0 0x559cec76f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec76fab0 con 0x559cec76ced0 2024-09-12T00:19:07.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec76ced0 0x559cec76f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e44039c10 0x7f4e4403c0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f740bdfd0 tx=0x7f4f740e4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec76ced0 0x559cec76f360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f7000d040 con 0x559cec76ced0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 realm 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec76c280 con 0x559cec76ced0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f7000d040 con 0x559cec76ced0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec7705b0 con 0x559cec76ced0 2024-09-12T00:19:07.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f7000d040 con 0x559cec76ced0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec770e80 con 0x559cec76ced0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f7000d040 con 0x559cec76ced0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec771780 0x559cec773b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec7742e0 con 0x559cec771780 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec771780 0x559cec773b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.449+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec771780 0x559cec773b70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7e4f89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7e4f89c0 20 searching for the correct realm 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7c7ff640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4f6c05a3f0 0x7f4f6c02e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4f6c05a3f0 0x7f4f6c02e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4f6c05a3f0 0x7f4f6c02e030 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7bffe640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f4f740a93c0 0x7f4f740e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f4f740a93c0 0x7f4f740e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f4f740a93c0 0x7f4f740e9940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7000d040 con 0x7f4f740a93c0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7000d040 con 0x559cec76ced0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.453+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.457+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.461+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec771780 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x559cec76ced0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559cec775bb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec774ca0 con 0x559cec76ced0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec775540 con 0x559cec76ced0 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec7748e0 con 0x559cec771780 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 zone default found 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 4 Realm: () 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 zonegroup default 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec776060 con 0x7f4f740a93c0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec777bd0 con 0x559cec771780 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec778060 con 0x559cec771780 2024-09-12T00:19:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 started sync module instance, tier type = 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.465+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec776ef0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132470508096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec7784c0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec778d10 con 0x559cec76ced0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132470508096] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132470515808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec779130 con 0x559cec76ced0 2024-09-12T00:19:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.469+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec779980 con 0x559cec771780 2024-09-12T00:19:07.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132470518336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec779d30 con 0x559cec771780 2024-09-12T00:19:07.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77a830 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132470515808] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132470522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ac50 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77b610 con 0x559cec76ced0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132470518336] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132470522656] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132470516864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77b160 con 0x559cec76ced0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.473+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ba50 con 0x7f4f740a93c0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132470516864] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132470519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77b610 con 0x7f4f740a93c0 2024-09-12T00:19:07.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77c330 con 0x7f4f740a93c0 2024-09-12T00:19:07.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132470519680] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132470529520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77b610 con 0x7f4f740a93c0 2024-09-12T00:19:07.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.477+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77cd40 con 0x7f4f740a93c0 2024-09-12T00:19:07.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132470532240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77d160 con 0x7f4f740a93c0 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=0 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=1 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=2 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=3 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=4 2024-09-12T00:19:07.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=5 2024-09-12T00:19:07.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132470529520] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=6 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132470532240] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 20 add_watcher() i=7 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec77d160 con 0x559cec76ced0 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.481+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132470533296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77d0d0 con 0x559cec76ced0 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132470533296] v31'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4e31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 5 note: GC not initialized 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4e30fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:07.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 Filter name: none 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4daa7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559cec7a3420 con 0x559cec76ced0 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T00:19:07.491 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:07.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4e31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.485+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132470533296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec7a1ed0 con 0x559cec76ced0 2024-09-12T00:19:07.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94132470533296] v31'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132470508096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ccb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94132470508096] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 20 remove_watcher() i=0 2024-09-12T00:19:07.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 2 removed watcher, disabling cache 2024-09-12T00:19:07.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132470515808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ccb0 con 0x559cec76ced0 2024-09-12T00:19:07.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94132470515808] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 20 remove_watcher() i=1 2024-09-12T00:19:07.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.489+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132470518336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec778860 con 0x559cec771780 2024-09-12T00:19:07.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7c7ff640 1 -- 172.21.15.66:0/3359314964 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94132470518336] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f6c057040 con 0x559cec771780 2024-09-12T00:19:07.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7e4f89c0 20 remove_watcher() i=2 2024-09-12T00:19:07.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132470522656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ccb0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7bffe640 1 -- 172.21.15.66:0/3359314964 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94132470522656] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f740c7de0 con 0x7f4f6c05a3f0 2024-09-12T00:19:07.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7e4f89c0 20 remove_watcher() i=3 2024-09-12T00:19:07.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.493+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132470516864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec779240 con 0x559cec76ced0 2024-09-12T00:19:07.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94132470516864] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x559cec76ced0 2024-09-12T00:19:07.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7e4f89c0 20 remove_watcher() i=4 2024-09-12T00:19:07.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132470519680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ccb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94132470519680] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7e4f89c0 20 remove_watcher() i=5 2024-09-12T00:19:07.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.497+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132470529520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec779240 con 0x7f4f740a93c0 2024-09-12T00:19:07.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94132470529520] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 20 remove_watcher() i=6 2024-09-12T00:19:07.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132470532240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559cec77ccb0 con 0x7f4f740a93c0 2024-09-12T00:19:07.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94132470532240] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f7002a040 con 0x7f4f740a93c0 2024-09-12T00:19:07.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 20 remove_watcher() i=7 2024-09-12T00:19:07.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f4f740a93c0 msgr2=0x7f4f740e9940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f4f740a93c0 0x7f4f740e9940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec76ced0 msgr2=0x559cec76f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec76ced0 0x559cec76f360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4f6c05a3f0 msgr2=0x7f4f6c02e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4f6c05a3f0 0x7f4f6c02e030 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec771780 msgr2=0x559cec773b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec771780 0x559cec773b70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e44039c10 msgr2=0x7f4e4403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e44039c10 0x7f4e4403c0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f740bdfd0 tx=0x7f4f740e4000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 msgr2=0x559cec7619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7b7fd640 1 -- 172.21.15.66:0/3359314964 reap_dead start 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c050070 tx=0x7f4f6c0500a0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 shutdown_connections 2024-09-12T00:19:07.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3359314964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec75b4d0 0x559cec7619b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 >> 172.21.15.66:0/3359314964 conn(0x559cec756890 msgr2=0x559cec754aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 shutdown_connections 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3359314964 wait complete. 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 msgr2=0x7f4e5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 0x7f4e5403bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x559cec73f820 tx=0x7f4f74005c50 comp rx=0 tx=0).stop 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 msgr2=0x559cec74df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x559cec734340 tx=0x7f4f6c00af40 comp rx=0 tx=0).stop 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 shutdown_connections 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e54039a70 0x7f4e5403bf30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/2333578326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec74db60 0x559cec74df80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 >> 172.21.15.66:0/2333578326 conn(0x559cec743510 msgr2=0x559cec7438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 shutdown_connections 2024-09-12T00:19:07.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/2333578326 wait complete. 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 msgr2=0x559cec73a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 0x559cec73a120 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 msgr2=0x559cec73ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 0x559cec73ed60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 msgr2=0x7f4e6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 0x7f4e6403bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f70001e60 tx=0x7f4f700013e0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 msgr2=0x559cec732fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f74018cc0 tx=0x7f4f74017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 shutdown_connections 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x559cec73c970 0x559cec73ed60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x559cec6416f0 0x559cec73a120 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4e64039a70 0x7f4e6403bf30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 --2- 172.21.15.66:0/3741884124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559cec5b2fd0 0x559cec732fb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.501+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 >> 172.21.15.66:0/3741884124 conn(0x559cec638ee0 msgr2=0x559cec63d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.505+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 shutdown_connections 2024-09-12T00:19:07.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.505+0000 7f4f7e4f89c0 1 -- 172.21.15.66:0/3741884124 wait complete. 2024-09-12T00:19:07.517 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:07.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T00:19:07.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T00:19:07.517 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-12T00:19:07.599 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.599 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a52ec9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56414bf01ae0 0x56414bf95c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a52ec9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56414be419c0 con 0x56414bf01700 2024-09-12T00:19:07.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a52ec9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56414be916d0 con 0x56414bf01ae0 2024-09-12T00:19:07.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56414bf01ae0 0x56414bf95c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56414bf01ae0 0x56414bf95c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44250/0 (socket says 172.21.15.66:44250) 2024-09-12T00:19:07.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 -- 172.21.15.66:0/1424341561 learned_addr learned my addr 172.21.15.66:0/1424341561 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 -- 172.21.15.66:0/1424341561 >> v1:172.21.15.31:6789/0 conn(0x56414bf01700 legacy=0x56414bf92530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 -- 172.21.15.66:0/1424341561 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414be35ca0 con 0x56414bf01ae0 2024-09-12T00:19:07.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.597+0000 7f08a25f1640 1 --2- 172.21.15.66:0/1424341561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01ae0 0x56414bf95c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f089800a5c0 tx=0x7f089801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22b0ddce88d915d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a1df0640 1 -- 172.21.15.66:0/1424341561 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08980a6070 con 0x56414bf01ae0 2024-09-12T00:19:07.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a1df0640 1 -- 172.21.15.66:0/1424341561 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08980af070 con 0x56414bf01ae0 2024-09-12T00:19:07.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a1df0640 1 -- 172.21.15.66:0/1424341561 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08980aa5c0 con 0x56414bf01ae0 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1424341561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01ae0 msgr2=0x56414bf95c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/1424341561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01ae0 0x56414bf95c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f089800a5c0 tx=0x7f089801b340 comp rx=0 tx=0).stop 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1424341561 shutdown_connections 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/1424341561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01ae0 0x56414bf95c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1424341561 >> 172.21.15.66:0/1424341561 conn(0x56414bf87e20 msgr2=0x56414bf8a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1424341561 shutdown_connections 2024-09-12T00:19:07.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.601+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1424341561 wait complete. 2024-09-12T00:19:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a52ec9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a52ec9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56414be95680 con 0x56414bf01700 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a2df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a2df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44256/0 (socket says 172.21.15.66:44256) 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a2df2640 1 -- 172.21.15.66:0/1248868347 learned_addr learned my addr 172.21.15.66:0/1248868347 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a2df2640 1 -- 172.21.15.66:0/1248868347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414be10da0 con 0x56414bf01700 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f08a2df2640 1 --2- 172.21.15.66:0/1248868347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f089400b2d0 tx=0x7f089400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764e2eb0347f921e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f0790e09640 1 -- 172.21.15.66:0/1248868347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089400a040 con 0x56414bf01700 2024-09-12T00:19:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f0790e09640 1 -- 172.21.15.66:0/1248868347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089400f750 con 0x56414bf01700 2024-09-12T00:19:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.613+0000 7f0790e09640 1 -- 172.21.15.66:0/1248868347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089400fa70 con 0x56414bf01700 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1248868347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 msgr2=0x56414c07aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/1248868347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f089400b2d0 tx=0x7f089400b790 comp rx=0 tx=0).stop 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1248868347 shutdown_connections 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/1248868347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c07aa80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1248868347 >> 172.21.15.66:0/1248868347 conn(0x56414bf87e20 msgr2=0x56414c076720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1248868347 shutdown_connections 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/1248868347 wait complete. 2024-09-12T00:19:07.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56414be37a50 con 0x56414bf01700 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a2df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a2df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44270/0 (socket says 172.21.15.66:44270) 2024-09-12T00:19:07.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a2df2640 1 -- 172.21.15.66:0/4157715074 learned_addr learned my addr 172.21.15.66:0/4157715074 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a2df2640 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414c0826d0 con 0x56414bf01700 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a2df2640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x56414c07ba70 tx=0x7f0894000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f078f606640 1 -- 172.21.15.66:0/4157715074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089401d850 con 0x56414bf01700 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f078f606640 1 -- 172.21.15.66:0/4157715074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089401d9f0 con 0x56414bf01700 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f078f606640 1 -- 172.21.15.66:0/4157715074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089401dcf0 con 0x56414bf01700 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56414c082960 con 0x56414bf01700 2024-09-12T00:19:07.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.617+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414c083390 con 0x56414bf01700 2024-09-12T00:19:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f078f606640 1 -- 172.21.15.66:0/4157715074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0894017070 con 0x56414bf01700 2024-09-12T00:19:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f078f606640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 0x7f078803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f078f606640 1 -- 172.21.15.66:0/4157715074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0894015020 con 0x56414bf01700 2024-09-12T00:19:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a25f1640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 0x7f078803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 0x56414c0892e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c089820 con 0x56414bf01ae0 2024-09-12T00:19:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a35f3640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 0x56414c0892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a35f3640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 0x56414c0892e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a25f1640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 0x7f078803bf80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08980ae000 tx=0x7f08980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a35f3640 1 -- 172.21.15.66:0/4157715074 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f089c00a4d0 con 0x56414bf01ae0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c083680 con 0x56414bf01ae0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a35f3640 1 -- 172.21.15.66:0/4157715074 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f089c00a4d0 con 0x56414bf01ae0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 0x56414c08de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c08e570 con 0x56414c08ba90 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a2df2640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 0x56414c08de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a2df2640 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 0x56414c08de80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a2df2640 1 -- 172.21.15.66:0/4157715074 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f089402e070 con 0x56414c08ba90 2024-09-12T00:19:07.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c08a930 con 0x56414bf01ae0 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a35f3640 1 -- 172.21.15.66:0/4157715074 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f089c00a4d0 con 0x56414bf01ae0 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c08ae10 con 0x56414c08ba90 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.621+0000 7f08a2df2640 1 -- 172.21.15.66:0/4157715074 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f089402e070 con 0x56414c08ba90 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56414bea2450 con 0x56414c09ccc0 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44282/0 (socket says 172.21.15.66:44282) 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a35f3640 1 -- 172.21.15.66:0/4284726510 learned_addr learned my addr 172.21.15.66:0/4284726510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a35f3640 1 -- 172.21.15.66:0/4284726510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414c09d720 con 0x56414c09ccc0 2024-09-12T00:19:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a35f3640 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56414c082bb0 tx=0x7f089c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 -- 172.21.15.66:0/4284726510 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c013450 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56414c09df80 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414c09e4f0 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 -- 172.21.15.66:0/4284726510 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c0135f0 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 -- 172.21.15.66:0/4284726510 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c013910 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 -- 172.21.15.66:0/4284726510 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f089c011040 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 0x7f077c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f078ce01640 1 -- 172.21.15.66:0/4284726510 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f089c00e040 con 0x56414c09ccc0 2024-09-12T00:19:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a2df2640 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 0x7f077c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a52ec9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56414c07b2d0 con 0x56414c0aa610 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.625+0000 7f08a2df2640 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 0x7f077c03bf80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56414c089c60 tx=0x7f089404ed40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44288/0 (socket says 172.21.15.66:44288) 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 -- 172.21.15.66:0/179806601 learned_addr learned my addr 172.21.15.66:0/179806601 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 -- 172.21.15.66:0/179806601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414c0aafc0 con 0x56414c0aa610 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- 172.21.15.66:0/179806601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f089c050a20 tx=0x7f089c052420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf835e7a1554d08c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f07867fc640 1 -- 172.21.15.66:0/179806601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c0143c0 con 0x56414c0aa610 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f07867fc640 1 -- 172.21.15.66:0/179806601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c012de0 con 0x56414c0aa610 2024-09-12T00:19:07.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f07867fc640 1 -- 172.21.15.66:0/179806601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c021960 con 0x56414c0aa610 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/179806601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 msgr2=0x56414c0aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/179806601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f089c050a20 tx=0x7f089c052420 comp rx=0 tx=0).stop 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/179806601 shutdown_connections 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/179806601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0aa9f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/179806601 >> 172.21.15.66:0/179806601 conn(0x56414c0a5a10 msgr2=0x56414c0a3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/179806601 shutdown_connections 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/179806601 wait complete. 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 Processor -- start 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- start start 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56414c0a9540 con 0x56414c0aa610 2024-09-12T00:19:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44296/0 (socket says 172.21.15.66:44296) 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 learned_addr learned my addr 172.21.15.66:0/842160475 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56414c0b0f30 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a35f3640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f089c02adb0 tx=0x7f089c050980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f0784ff9640 1 -- 172.21.15.66:0/842160475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c037070 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f0784ff9640 1 -- 172.21.15.66:0/842160475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c021440 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56414c0b11c0 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414c0b1b70 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.629+0000 7f0784ff9640 1 -- 172.21.15.66:0/842160475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c04f2d0 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f0784ff9640 1 -- 172.21.15.66:0/842160475 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f089c04f470 con 0x56414c0aa610 2024-09-12T00:19:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f0784ff9640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 0x7f076c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f0784ff9640 1 -- 172.21.15.66:0/842160475 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f089c049040 con 0x56414c0aa610 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a2df2640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 0x7f076c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 0x56414c0be600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0bed50 con 0x56414c0bc170 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 0x56414c0be600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a2df2640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 0x7f076c03bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0894017a40 tx=0x7f0894034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 0x56414c0be600 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 realm 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0bf180 con 0x56414c0bc170 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0bfa50 con 0x56414c0bc170 2024-09-12T00:19:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0bfdf0 con 0x56414c0bc170 2024-09-12T00:19:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 0x56414c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c3590 con 0x56414c0c0b50 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 0x56414c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 0x56414c0c2f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 20 searching for the correct realm 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 0x7f089c0528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.633+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a2df2640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 0x7f089c0528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a2df2640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 0x7f089c0528e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a2df2640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 0x7f0894050230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 0x7f0894050230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 0x7f0894050230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.637+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.641+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0c0b50 2024-09-12T00:19:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.645+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089401a480 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x56414c0bc170 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c4df0 con 0x7f089c013070 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:07.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c3e70 con 0x56414c0bc170 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c46c0 con 0x56414c0bc170 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c5220 con 0x56414c0c0b50 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 zone default found 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 4 Realm: () 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 zonegroup default 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c55c0 con 0x7f089401a480 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c7460 con 0x56414c0c0b50 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c7800 con 0x56414c0c0b50 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 started sync module instance, tier type = 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.649+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c6960 con 0x7f089c013070 2024-09-12T00:19:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94838448745808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c65c0 con 0x7f089c013070 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c86c0 con 0x56414c0bc170 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94838448745808] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94838448751120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c8630 con 0x56414c0bc170 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.653+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c9410 con 0x56414c0c0b50 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94838448754528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0c9830 con 0x56414c0c0b50 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0ca2e0 con 0x7f089c013070 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94838448751120] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838448753328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0ca2e0 con 0x7f089c013070 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cacf0 con 0x56414c0bc170 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94838448754528] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.657+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94838448753328] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94838448755584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0ca840 con 0x56414c0bc170 2024-09-12T00:19:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cb130 con 0x7f089401a480 2024-09-12T00:19:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94838448755584] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94838448758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cacf0 con 0x7f089401a480 2024-09-12T00:19:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.661+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cbb40 con 0x7f089401a480 2024-09-12T00:19:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94838448758208] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94838448761168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cbb40 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cc500 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94838448767056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cc920 con 0x7f089401a480 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=0 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=1 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=2 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=3 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=4 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=5 2024-09-12T00:19:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94838448761168] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.665+0000 7f08a52ec9c0 20 add_watcher() i=6 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94838448767056] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x7f089401a480 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 add_watcher() i=7 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0cb720 con 0x56414c0bc170 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94838448764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0ccdb0 con 0x56414c0bc170 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94838448764656] v31'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08980aaa20 con 0x56414c0bc170 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f07597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 5 note: GC not initialized 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f06d3fff640 20 reqs_thread_entry: start 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 Filter name: none 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f06d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f2f60 con 0x56414c0bc170 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T00:19:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f3ca0 con 0x7f089c013070 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.669+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f9dd0 con 0x56414c0bc170 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a52ec9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a52ec9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a52ec9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94838448953408 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f5530 con 0x56414c0bc170 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94838448755584 notify 133143986183 ret 0) ==== 891+0+0 (crc 0 0 0) 0x56414be35ca0 con 0x56414c0bc170 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f07867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94838448755584 notifier 4389 bl.length()=849 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f07867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f07867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify cookie 94838448953408 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f07867fc640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0768003eb0 con 0x56414c0bc170 2024-09-12T00:19:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94838448953408 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f08980bfc40 con 0x56414c0bc170 2024-09-12T00:19:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.673+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f9840 con 0x7f089c013070 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94838448953408 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f5080 con 0x7f089c013070 2024-09-12T00:19:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== watch-notify(notify (1) cookie 94838448745808 notify 133143986179 ret 0) ==== 208+0+0 (crc 0 0 0) 0x56414c083390 con 0x7f089c013070 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f0785ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94838448745808 notifier 4389 bl.length()=166 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f0785ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(68 notify.0 [notify cookie 94838448953408 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f0785ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f0785ffb640 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f06d8003410 con 0x7f089c013070 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== watch-notify(notify_complete (2) cookie 94838448953408 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56414c082960 con 0x7f089c013070 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.687 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T00:19:07.676243Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f07597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94838448764656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x56414c0bc170 2024-09-12T00:19:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94838448764656] v31'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.677+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94838448745808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x7f089c013070 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94838448745808] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 20 remove_watcher() i=0 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 2 removed watcher, disabling cache 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94838448751120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x56414c0bc170 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94838448751120] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 20 remove_watcher() i=1 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94838448754528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x56414c0c0b50 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a35f3640 1 -- 172.21.15.66:0/842160475 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94838448754528] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089c030070 con 0x56414c0c0b50 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 20 remove_watcher() i=2 2024-09-12T00:19:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.681+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838448753328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x7f089c013070 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a2df2640 1 -- 172.21.15.66:0/842160475 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94838448753328] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f089402e070 con 0x7f089c013070 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a52ec9c0 20 remove_watcher() i=3 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94838448755584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x56414c0bc170 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94838448755584] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x56414c0bc170 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a52ec9c0 20 remove_watcher() i=4 2024-09-12T00:19:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.685+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94838448758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x7f089401a480 2024-09-12T00:19:07.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94838448758208] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x7f089401a480 2024-09-12T00:19:07.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a52ec9c0 20 remove_watcher() i=5 2024-09-12T00:19:07.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94838448761168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x7f089401a480 2024-09-12T00:19:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94838448761168] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x7f089401a480 2024-09-12T00:19:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a52ec9c0 20 remove_watcher() i=6 2024-09-12T00:19:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.689+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94838448767056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56414c0f0c80 con 0x7f089401a480 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94838448767056] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08980d5040 con 0x7f089401a480 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 20 remove_watcher() i=7 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 msgr2=0x7f0894050230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 0x7f0894050230 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 msgr2=0x56414c0be600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 0x56414c0be600 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 msgr2=0x7f089c0528e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 0x7f089c0528e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 msgr2=0x56414c0c2f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 0x56414c0c2f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 msgr2=0x7f076c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 0x7f076c03bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0894017a40 tx=0x7f0894034000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 msgr2=0x56414c0b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f089c02adb0 tx=0x7f089c050980 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 shutdown_connections 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a25f1640 1 -- 172.21.15.66:0/842160475 reap_dead start 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f089401a480 0x7f0894050230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f089c013070 0x7f089c0528e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c0c0b50 0x56414c0c2f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414c0bc170 0x56414c0be600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f076c039a70 0x7f076c03bf30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/842160475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c0aa610 0x56414c0b09d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 >> 172.21.15.66:0/842160475 conn(0x56414c0a5a10 msgr2=0x56414c0a3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 shutdown_connections 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/842160475 wait complete. 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 msgr2=0x7f077c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 0x7f077c03bf80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x56414c089c60 tx=0x7f089404ed40 comp rx=0 tx=0).stop 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 msgr2=0x56414c09d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56414c082bb0 tx=0x7f089c0163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 shutdown_connections 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f077c039ac0 0x7f077c03bf80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4284726510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414c09ccc0 0x56414c09d0e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 >> 172.21.15.66:0/4284726510 conn(0x56414c092670 msgr2=0x56414c092a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 shutdown_connections 2024-09-12T00:19:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4284726510 wait complete. 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 msgr2=0x56414c0892e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 0x56414c0892e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 msgr2=0x56414c08de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 0x56414c08de80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 msgr2=0x7f078803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 0x7f078803bf80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08980ae000 tx=0x7f08980a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 msgr2=0x56414c082170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x56414c07ba70 tx=0x7f0894000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 shutdown_connections 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56414c08ba90 0x56414c08de80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56414bf01ae0 0x56414c0892e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0788039ac0 0x7f078803bf80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 --2- 172.21.15.66:0/4157715074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56414bf01700 0x56414c082170 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 >> 172.21.15.66:0/4157715074 conn(0x56414bf87e20 msgr2=0x56414c0751b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 shutdown_connections 2024-09-12T00:19:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.693+0000 7f08a52ec9c0 1 -- 172.21.15.66:0/4157715074 wait complete. 2024-09-12T00:19:07.707 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T00:19:07.676243Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:07.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:19:07.708 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:19:07.782 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.782 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a14afa9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc0f9b2770 0x55dc0fa411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a14afa9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc0f8f29c0 con 0x55dc0fa416e0 2024-09-12T00:19:07.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a14afa9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55dc0f9426d0 con 0x55dc0f9b2770 2024-09-12T00:19:07.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a12600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc0f9b2770 0x55dc0fa411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a12600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc0f9b2770 0x55dc0fa411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44300/0 (socket says 172.21.15.66:44300) 2024-09-12T00:19:07.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a12600640 1 -- 172.21.15.66:0/2262838718 learned_addr learned my addr 172.21.15.66:0/2262838718 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.777+0000 7f0a11dff640 1 --1- 172.21.15.66:0/2262838718 >> v1:172.21.15.31:6789/0 conn(0x55dc0fa416e0 0x55dc0fa43ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42858/0 (socket says 172.21.15.66:42858) 2024-09-12T00:19:07.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a12600640 1 -- 172.21.15.66:0/2262838718 >> v1:172.21.15.31:6789/0 conn(0x55dc0fa416e0 legacy=0x55dc0fa43ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a12600640 1 -- 172.21.15.66:0/2262838718 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0f8e6ca0 con 0x55dc0f9b2770 2024-09-12T00:19:07.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a12600640 1 --2- 172.21.15.66:0/2262838718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fa411a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400a5c0 tx=0x7f0a0401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bf10f126ea02c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a115fe640 1 -- 172.21.15.66:0/2262838718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040b1070 con 0x55dc0f9b2770 2024-09-12T00:19:07.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a115fe640 1 -- 172.21.15.66:0/2262838718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040a8070 con 0x55dc0f9b2770 2024-09-12T00:19:07.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a115fe640 1 -- 172.21.15.66:0/2262838718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040ac5b0 con 0x55dc0f9b2770 2024-09-12T00:19:07.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2262838718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 msgr2=0x55dc0fa411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2262838718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fa411a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400a5c0 tx=0x7f0a0401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:07.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2262838718 shutdown_connections 2024-09-12T00:19:07.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2262838718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fa411a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2262838718 >> 172.21.15.66:0/2262838718 conn(0x55dc0fa38e90 msgr2=0x55dc0fa3b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2262838718 shutdown_connections 2024-09-12T00:19:07.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.781+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2262838718 wait complete. 2024-09-12T00:19:07.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc0f946680 con 0x55dc0f9b2770 2024-09-12T00:19:07.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a12600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a12600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44314/0 (socket says 172.21.15.66:44314) 2024-09-12T00:19:07.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a12600640 1 -- 172.21.15.66:0/3516966251 learned_addr learned my addr 172.21.15.66:0/3516966251 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a12600640 1 -- 172.21.15.66:0/3516966251 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0f8c1da0 con 0x55dc0f9b2770 2024-09-12T00:19:07.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a12600640 1 --2- 172.21.15.66:0/3516966251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a040af040 tx=0x7f0a04003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626ce76f2dea604a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0900608640 1 -- 172.21.15.66:0/3516966251 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040b1040 con 0x55dc0f9b2770 2024-09-12T00:19:07.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0900608640 1 -- 172.21.15.66:0/3516966251 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040ac820 con 0x55dc0f9b2770 2024-09-12T00:19:07.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0900608640 1 -- 172.21.15.66:0/3516966251 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040acb00 con 0x55dc0f9b2770 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3516966251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 msgr2=0x55dc0fb29880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/3516966251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0a040af040 tx=0x7f0a04003030 comp rx=0 tx=0).stop 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3516966251 shutdown_connections 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/3516966251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb29880 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3516966251 >> 172.21.15.66:0/3516966251 conn(0x55dc0fa38e90 msgr2=0x55dc0fb25520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3516966251 shutdown_connections 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.797+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3516966251 wait complete. 2024-09-12T00:19:07.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc0f8e8a50 con 0x55dc0f9b2770 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a12600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a12600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44330/0 (socket says 172.21.15.66:44330) 2024-09-12T00:19:07.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a12600640 1 -- 172.21.15.66:0/199346465 learned_addr learned my addr 172.21.15.66:0/199346465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a12600640 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0fb31370 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a12600640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0a04018f70 tx=0x7f0a04019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 -- 172.21.15.66:0/199346465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040cd070 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 -- 172.21.15.66:0/199346465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040b7a20 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc0fb31600 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 -- 172.21.15.66:0/199346465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a040b1070 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0fb31fb0 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 -- 172.21.15.66:0/199346465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a040d0070 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 0x7f08f803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f08fee05640 1 -- 172.21.15.66:0/199346465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0a040eb080 con 0x55dc0f9b2770 2024-09-12T00:19:07.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a11dff640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 0x7f08f803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 0x55dc0fb37f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.801+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb384c0 con 0x55dc0fa416e0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 0x55dc0fb37f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a11dff640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 0x7f08f803bf80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001e90 tx=0x7f0a080013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 0x55dc0fb37f80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 -- 172.21.15.66:0/199346465 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a0c00a4d0 con 0x55dc0fa416e0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb38860 con 0x55dc0fa416e0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 -- 172.21.15.66:0/199346465 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a0c00a4d0 con 0x55dc0fa416e0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 0x55dc0fb3ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb3d100 con 0x55dc0fb3a640 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12600640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 0x55dc0fb3ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12600640 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 0x55dc0fb3ca30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12600640 1 -- 172.21.15.66:0/199346465 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a040cf030 con 0x55dc0fb3a640 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb394e0 con 0x55dc0fa416e0 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 -- 172.21.15.66:0/199346465 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a0c00a4d0 con 0x55dc0fa416e0 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb399c0 con 0x55dc0fb3a640 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12600640 1 -- 172.21.15.66:0/199346465 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a040cf030 con 0x55dc0fb3a640 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a14afa9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc0f953450 con 0x55dc0fb4b830 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44340/0 (socket says 172.21.15.66:44340) 2024-09-12T00:19:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.805+0000 7f0a12e01640 1 -- 172.21.15.66:0/2917813299 learned_addr learned my addr 172.21.15.66:0/2917813299 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 -- 172.21.15.66:0/2917813299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0fb4c290 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55dc0fb32ee0 tx=0x7f0a0c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 -- 172.21.15.66:0/2917813299 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c013640 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 -- 172.21.15.66:0/2917813299 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c0137e0 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc0fb4caf0 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 -- 172.21.15.66:0/2917813299 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c013ae0 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0fb4d060 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 -- 172.21.15.66:0/2917813299 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a0c011040 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 0x7f08ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f08f7fff640 1 -- 172.21.15.66:0/2917813299 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0a0c00e040 con 0x55dc0fb4b830 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12600640 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 0x7f08ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12600640 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 0x7f08ec03bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a04000c10 tx=0x7f0a040c2f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a14afa9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc0fb2a050 con 0x55dc0fa3d160 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44356/0 (socket says 172.21.15.66:44356) 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 -- 172.21.15.66:0/3720038865 learned_addr learned my addr 172.21.15.66:0/3720038865 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 -- 172.21.15.66:0/3720038865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0fa3db50 con 0x55dc0fa3d160 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.809+0000 7f0a12e01640 1 --2- 172.21.15.66:0/3720038865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c020680 tx=0x7f0a0c0203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da325e40d8d419b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08f5ffb640 1 -- 172.21.15.66:0/3720038865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c0143c0 con 0x55dc0fa3d160 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08f5ffb640 1 -- 172.21.15.66:0/3720038865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c0520d0 con 0x55dc0fa3d160 2024-09-12T00:19:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08f5ffb640 1 -- 172.21.15.66:0/3720038865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c021910 con 0x55dc0fa3d160 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3720038865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 msgr2=0x55dc0fa3d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/3720038865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c020680 tx=0x7f0a0c0203a0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3720038865 shutdown_connections 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/3720038865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fa3d560 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3720038865 >> 172.21.15.66:0/3720038865 conn(0x55dc0fb545a0 msgr2=0x55dc0fb527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3720038865 shutdown_connections 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/3720038865 wait complete. 2024-09-12T00:19:07.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 Processor -- start 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- start start 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fb61850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc0fa3e1f0 con 0x55dc0fa3d160 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fb61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a12e01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fb61850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44372/0 (socket says 172.21.15.66:44372) 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 learned_addr learned my addr 172.21.15.66:0/1358796189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0fb61db0 con 0x55dc0fa3d160 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a12e01640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fb61850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0203e0 tx=0x7f0a0c050780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08e3fff640 1 -- 172.21.15.66:0/1358796189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c0143c0 con 0x55dc0fa3d160 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc0fb62040 con 0x55dc0fa3d160 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08e3fff640 1 -- 172.21.15.66:0/1358796189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0c021910 con 0x55dc0fa3d160 2024-09-12T00:19:07.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f08e3fff640 1 -- 172.21.15.66:0/1358796189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a0c04f2b0 con 0x55dc0fa3d160 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0fb629f0 con 0x55dc0fa3d160 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.813+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f08e3fff640 1 -- 172.21.15.66:0/1358796189 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a0c03e9a0 con 0x55dc0fa3d160 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f08e3fff640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08dc039a70 0x7f08dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f08e3fff640 1 -- 172.21.15.66:0/1358796189 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0a0c034c40 con 0x55dc0fa3d160 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08dc039a70 0x7f08dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fb6cde0 0x55dc0fb6f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb6f9c0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fb6cde0 0x55dc0fb6f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08dc039a70 0x7f08dc03bf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a040ab8c0 tx=0x7f0a040ac000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fb6cde0 0x55dc0fb6f270 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a0800f660 con 0x55dc0fb6cde0 2024-09-12T00:19:07.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 realm 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb6c190 con 0x55dc0fb6cde0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a0800f660 con 0x55dc0fb6cde0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb704c0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a0800f660 con 0x55dc0fb6cde0 2024-09-12T00:19:07.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb70d90 con 0x55dc0fb6cde0 2024-09-12T00:19:07.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a0800f660 con 0x55dc0fb6cde0 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb71640 0x55dc0fb73a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb74190 con 0x55dc0fb71640 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb71640 0x55dc0fb73a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb71640 0x55dc0fb73a30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 20 searching for the correct realm 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb71640 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0a0c014ac0 0x7f0a0c049340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0a0c014ac0 0x7f0a0c049340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0a0c014ac0 0x7f0a0c049340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0a040d2060 0x7f0a040d1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.817+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a040d2060 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0a040d2060 0x7f0a040d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0a040d2060 0x7f0a040d1580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0800f660 con 0x7f0a040d2060 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0800f660 con 0x55dc0fb6cde0 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a040d2060 2024-09-12T00:19:07.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x7f0a040d2060 2024-09-12T00:19:07.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a040d2060 2024-09-12T00:19:07.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x7f0a040d2060 2024-09-12T00:19:07.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb71640 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.821+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a040d2060 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x7f0a040d2060 2024-09-12T00:19:07.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75ae0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a040d2060 2024-09-12T00:19:07.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x7f0a040d2060 2024-09-12T00:19:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb6cde0 2024-09-12T00:19:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb6cde0 2024-09-12T00:19:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a040d2060 2024-09-12T00:19:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x7f0a040d2060 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.825+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a0c014ac0 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb6cde0 2024-09-12T00:19:07.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0802b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a040d2060 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a040d2060 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a0c014ac0 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb71640 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a040d2060 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x55dc0fb6cde0 2024-09-12T00:19:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.829+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0a04103060 con 0x7f0a0c014ac0 2024-09-12T00:19:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb74bd0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb75470 con 0x55dc0fb6cde0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb74810 con 0x55dc0fb71640 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 zone default found 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 4 Realm: () 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 zonegroup default 2024-09-12T00:19:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb750a0 con 0x7f0a040d2060 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb77ee0 con 0x55dc0fb71640 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb78350 con 0x55dc0fb71640 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 started sync module instance, tier type = 2024-09-12T00:19:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb77350 con 0x7f0a0c014ac0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94403644845728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb78790 con 0x7f0a0c014ac0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.833+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb78fe0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94403644845728] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94403644853040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb79400 con 0x55dc0fb6cde0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb79c50 con 0x55dc0fb71640 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94403644855568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7a000 con 0x55dc0fb71640 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.837+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7ab20 con 0x7f0a0c014ac0 2024-09-12T00:19:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94403644853040] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94403644859888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7aae0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7b530 con 0x55dc0fb6cde0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94403644855568] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94403644859888] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94403644854096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7b080 con 0x55dc0fb6cde0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.841+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7b910 con 0x7f0a040d2060 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94403644854096] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94403644856912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7b530 con 0x7f0a040d2060 2024-09-12T00:19:07.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c350 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94403644856912] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94403644862864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c350 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.845+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7cd10 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94403644862864] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94403644866480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7cd10 con 0x7f0a040d2060 2024-09-12T00:19:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=0 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=1 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=2 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=3 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=4 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=5 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.849+0000 7f0a14afa9c0 20 add_watcher() i=6 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94403644866480] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 add_watcher() i=7 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb80050 con 0x55dc0fb6cde0 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94403644869072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7d2a0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94403644869072] v31'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f08c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 5 note: GC not initialized 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f08437fe640 20 reqs_thread_entry: start 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 Filter name: none 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f08417fa640 20 reqs_thread_entry: start 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fba3220 con 0x55dc0fb6cde0 2024-09-12T00:19:07.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T00:19:07.870 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T00:19:07.676243Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f08c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.853+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94403644869072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fba3760 con 0x55dc0fb6cde0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94403644869072] v31'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94403644845728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c9d0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94403644845728] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 20 remove_watcher() i=0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 2 removed watcher, disabling cache 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94403644853040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c9d0 con 0x55dc0fb6cde0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94403644853040] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 20 remove_watcher() i=1 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.857+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94403644855568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb78b30 con 0x55dc0fb71640 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a12e01640 1 -- 172.21.15.66:0/1358796189 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94403644855568] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0c039020 con 0x55dc0fb71640 2024-09-12T00:19:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a14afa9c0 20 remove_watcher() i=2 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94403644859888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c9d0 con 0x7f0a0c014ac0 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a12600640 1 -- 172.21.15.66:0/1358796189 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94403644859888] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a040cf030 con 0x7f0a0c014ac0 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a14afa9c0 20 remove_watcher() i=3 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.861+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94403644854096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb79510 con 0x55dc0fb6cde0 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94403644854096] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x55dc0fb6cde0 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a14afa9c0 20 remove_watcher() i=4 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94403644856912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7a5f0 con 0x7f0a040d2060 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94403644856912] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a14afa9c0 20 remove_watcher() i=5 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.865+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94403644862864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c9d0 con 0x7f0a040d2060 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94403644862864] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 20 remove_watcher() i=6 2024-09-12T00:19:07.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94403644866480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dc0fb7c9d0 con 0x7f0a040d2060 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94403644866480] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a0803b040 con 0x7f0a040d2060 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 20 remove_watcher() i=7 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0a040d2060 msgr2=0x7f0a040d1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0a040d2060 0x7f0a040d1580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fb6cde0 msgr2=0x55dc0fb6f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fb6cde0 0x55dc0fb6f270 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0a0c014ac0 msgr2=0x7f0a0c049340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0a0c014ac0 0x7f0a0c049340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb71640 msgr2=0x55dc0fb73a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb71640 0x55dc0fb73a30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08dc039a70 msgr2=0x7f08dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08dc039a70 0x7f08dc03bf30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a040ab8c0 tx=0x7f0a040ac000 comp rx=0 tx=0).stop 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 msgr2=0x55dc0fb61850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/1358796189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fa3d160 0x55dc0fb61850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0203e0 tx=0x7f0a0c050780 comp rx=0 tx=0).stop 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 reap_dead start 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a11dff640 1 -- 172.21.15.66:0/1358796189 reap_dead start 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 shutdown_connections 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 >> 172.21.15.66:0/1358796189 conn(0x55dc0fb545a0 msgr2=0x55dc0fb527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 shutdown_connections 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/1358796189 wait complete. 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 msgr2=0x7f08ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 0x7f08ec03bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a04000c10 tx=0x7f0a040c2f50 comp rx=0 tx=0).stop 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 msgr2=0x55dc0fb4bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55dc0fb32ee0 tx=0x7f0a0c0167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 shutdown_connections 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08ec039a70 0x7f08ec03bf30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/2917813299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0fb4b830 0x55dc0fb4bc50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 >> 172.21.15.66:0/2917813299 conn(0x55dc0fb411e0 msgr2=0x55dc0fb415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 shutdown_connections 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/2917813299 wait complete. 2024-09-12T00:19:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 msgr2=0x55dc0fb37f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 0x55dc0fb37f80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 msgr2=0x55dc0fb3ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 0x55dc0fb3ca30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.869+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 msgr2=0x7f08f803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 0x7f08f803bf80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001e90 tx=0x7f0a080013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 msgr2=0x55dc0fb30e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0a04018f70 tx=0x7f0a04019b80 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 shutdown_connections 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc0fb3a640 0x55dc0fb3ca30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc0fa416e0 0x55dc0fb37f80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f08f8039ac0 0x7f08f803bf80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 --2- 172.21.15.66:0/199346465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc0f9b2770 0x55dc0fb30e10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 >> 172.21.15.66:0/199346465 conn(0x55dc0fa38e90 msgr2=0x55dc0fb23fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 shutdown_connections 2024-09-12T00:19:07.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.873+0000 7f0a14afa9c0 1 -- 172.21.15.66:0/199346465 wait complete. 2024-09-12T00:19:07.885 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T00:19:07.676243Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:07.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T00:19:07.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T00:19:07.886 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-12T00:19:07.956 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:07.957 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:07.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899face9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1ee100370 0x55d1ee100750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899face9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1edfb59c0 con 0x55d1ee103550 2024-09-12T00:19:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899face9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d1ee0056d0 con 0x55d1ee100370 2024-09-12T00:19:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899d5d4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1ee100370 0x55d1ee100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899d5d4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d1ee100370 0x55d1ee100750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44378/0 (socket says 172.21.15.66:44378) 2024-09-12T00:19:07.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899d5d4640 1 -- 172.21.15.66:0/3303236563 learned_addr learned my addr 172.21.15.66:0/3303236563 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899d5d4640 1 -- 172.21.15.66:0/3303236563 >> v1:172.21.15.31:6789/0 conn(0x55d1ee103550 legacy=0x55d1ee105940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.953+0000 7f899d5d4640 1 -- 172.21.15.66:0/3303236563 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1edfa9ca0 con 0x55d1ee100370 2024-09-12T00:19:07.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899d5d4640 1 --2- 172.21.15.66:0/3303236563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee100750 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f899800a4e0 tx=0x7f899801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8943372112df5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f898ffff640 1 -- 172.21.15.66:0/3303236563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980aa540 con 0x55d1ee100370 2024-09-12T00:19:07.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f898ffff640 1 -- 172.21.15.66:0/3303236563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980aa6e0 con 0x55d1ee100370 2024-09-12T00:19:07.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f898ffff640 1 -- 172.21.15.66:0/3303236563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980aaa40 con 0x55d1ee100370 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 -- 172.21.15.66:0/3303236563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 msgr2=0x55d1ee100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 --2- 172.21.15.66:0/3303236563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee100750 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f899800a4e0 tx=0x7f899801b090 comp rx=0 tx=0).stop 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 -- 172.21.15.66:0/3303236563 shutdown_connections 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 --2- 172.21.15.66:0/3303236563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee100750 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 -- 172.21.15.66:0/3303236563 >> 172.21.15.66:0/3303236563 conn(0x55d1ee0fbe90 msgr2=0x55d1ee0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 -- 172.21.15.66:0/3303236563 shutdown_connections 2024-09-12T00:19:07.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.957+0000 7f899face9c0 1 -- 172.21.15.66:0/3303236563 wait complete. 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.969+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.969+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.969+0000 7f899face9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.969+0000 7f899face9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ee009680 con 0x55d1ee100370 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44382/0 (socket says 172.21.15.66:44382) 2024-09-12T00:19:07.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 -- 172.21.15.66:0/2015192737 learned_addr learned my addr 172.21.15.66:0/2015192737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 -- 172.21.15.66:0/2015192737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1edf84da0 con 0x55d1ee100370 2024-09-12T00:19:07.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- 172.21.15.66:0/2015192737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8998019740 tx=0x7f89980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a155d813906522d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f888b606640 1 -- 172.21.15.66:0/2015192737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980b9070 con 0x55d1ee100370 2024-09-12T00:19:07.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f888b606640 1 -- 172.21.15.66:0/2015192737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980aaa90 con 0x55d1ee100370 2024-09-12T00:19:07.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f888b606640 1 -- 172.21.15.66:0/2015192737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980aad70 con 0x55d1ee100370 2024-09-12T00:19:07.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- 172.21.15.66:0/2015192737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 msgr2=0x55d1ee1eb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 --2- 172.21.15.66:0/2015192737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8998019740 tx=0x7f89980033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- 172.21.15.66:0/2015192737 shutdown_connections 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 --2- 172.21.15.66:0/2015192737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1eb6c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- 172.21.15.66:0/2015192737 >> 172.21.15.66:0/2015192737 conn(0x55d1ee0fbe90 msgr2=0x55d1ee1e7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- 172.21.15.66:0/2015192737 shutdown_connections 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- 172.21.15.66:0/2015192737 wait complete. 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899face9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1edfaba50 con 0x55d1ee100370 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44398/0 (socket says 172.21.15.66:44398) 2024-09-12T00:19:07.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 -- 172.21.15.66:0/3800879925 learned_addr learned my addr 172.21.15.66:0/3800879925 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ee1f3230 con 0x55d1ee100370 2024-09-12T00:19:07.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.973+0000 7f899d5d4640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8998000f90 tx=0x7f8998017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 -- 172.21.15.66:0/3800879925 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980b9030 con 0x55d1ee100370 2024-09-12T00:19:07.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ee1f34c0 con 0x55d1ee100370 2024-09-12T00:19:07.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 -- 172.21.15.66:0/3800879925 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980b5b10 con 0x55d1ee100370 2024-09-12T00:19:07.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 -- 172.21.15.66:0/3800879925 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89980b5df0 con 0x55d1ee100370 2024-09-12T00:19:07.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ee1f3ef0 con 0x55d1ee100370 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 -- 172.21.15.66:0/3800879925 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f89980b3040 con 0x55d1ee100370 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 0x7f888403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f8889e03640 1 -- 172.21.15.66:0/3800879925 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f89980c4030 con 0x55d1ee100370 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899cdd3640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 0x7f888403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 0x55d1ee1f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee1fa380 con 0x55d1ee103550 2024-09-12T00:19:07.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899ddd5640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 0x55d1ee1f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899cdd3640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 0x7f888403bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8994001e60 tx=0x7f89940013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899ddd5640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 0x55d1ee1f9e40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899ddd5640 1 -- 172.21.15.66:0/3800879925 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89900083f0 con 0x55d1ee103550 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee1fac20 con 0x55d1ee103550 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899ddd5640 1 -- 172.21.15.66:0/3800879925 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89900083f0 con 0x55d1ee103550 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 0x55d1ee1fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee1ff160 con 0x55d1ee1fc530 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.977+0000 7f899d5d4640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 0x55d1ee1fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899d5d4640 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 0x55d1ee1fe9d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899d5d4640 1 -- 172.21.15.66:0/3800879925 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89980a93c0 con 0x55d1ee1fc530 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee1fb470 con 0x55d1ee103550 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 -- 172.21.15.66:0/3800879925 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89900083f0 con 0x55d1ee103550 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee1fb850 con 0x55d1ee1fc530 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899d5d4640 1 -- 172.21.15.66:0/3800879925 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89980a93c0 con 0x55d1ee1fc530 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ee016450 con 0x55d1ee075900 2024-09-12T00:19:07.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44402/0 (socket says 172.21.15.66:44402) 2024-09-12T00:19:07.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 -- 172.21.15.66:0/1714133273 learned_addr learned my addr 172.21.15.66:0/1714133273 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 -- 172.21.15.66:0/1714133273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ee075e20 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899ddd5640 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55d1ee1f3d00 tx=0x7f899000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f8882ffd640 1 -- 172.21.15.66:0/1714133273 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f899001c020 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ee211c30 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f8882ffd640 1 -- 172.21.15.66:0/1714133273 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990007d00 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f8882ffd640 1 -- 172.21.15.66:0/1714133273 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990018440 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.981+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ee2121a0 con 0x55d1ee075900 2024-09-12T00:19:07.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8882ffd640 1 -- 172.21.15.66:0/1714133273 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f899001f020 con 0x55d1ee075900 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8882ffd640 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 0x7f887403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8882ffd640 1 -- 172.21.15.66:0/1714133273 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8990051cd0 con 0x55d1ee075900 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899d5d4640 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 0x7f887403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899d5d4640 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 0x7f887403bf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89980b3dd0 tx=0x7f89980e92e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ee1ebe50 con 0x55d1ee21c2d0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44418/0 (socket says 172.21.15.66:44418) 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899ddd5640 1 -- 172.21.15.66:0/4025837655 learned_addr learned my addr 172.21.15.66:0/4025837655 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899ddd5640 1 -- 172.21.15.66:0/4025837655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ee21ccc0 con 0x55d1ee21c2d0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899ddd5640 1 --2- 172.21.15.66:0/4025837655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8990050110 tx=0x7f89900214c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff00685b6b88d4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8880ff9640 1 -- 172.21.15.66:0/4025837655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990016330 con 0x55d1ee21c2d0 2024-09-12T00:19:07.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8880ff9640 1 -- 172.21.15.66:0/4025837655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89900164d0 con 0x55d1ee21c2d0 2024-09-12T00:19:07.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f8880ff9640 1 -- 172.21.15.66:0/4025837655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990029a60 con 0x55d1ee21c2d0 2024-09-12T00:19:07.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- 172.21.15.66:0/4025837655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 msgr2=0x55d1ee21c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:07.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 --2- 172.21.15.66:0/4025837655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8990050110 tx=0x7f89900214c0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- 172.21.15.66:0/4025837655 shutdown_connections 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 --2- 172.21.15.66:0/4025837655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee21c6d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- 172.21.15.66:0/4025837655 >> 172.21.15.66:0/4025837655 conn(0x55d1ee2176f0 msgr2=0x55d1ee215930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- 172.21.15.66:0/4025837655 shutdown_connections 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- 172.21.15.66:0/4025837655 wait complete. 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 Processor -- start 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- start start 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.985+0000 7f899face9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ee21b220 con 0x55d1ee21c2d0 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899ddd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44428/0 (socket says 172.21.15.66:44428) 2024-09-12T00:19:07.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 learned_addr learned my addr 172.21.15.66:0/213703576 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ee222d10 con 0x55d1ee21c2d0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899ddd5640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8990028ff0 tx=0x7f8990050070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 -- 172.21.15.66:0/213703576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990016630 con 0x55d1ee21c2d0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ee222fa0 con 0x55d1ee21c2d0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 -- 172.21.15.66:0/213703576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990029350 con 0x55d1ee21c2d0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 -- 172.21.15.66:0/213703576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990029630 con 0x55d1ee21c2d0 2024-09-12T00:19:07.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ee223950 con 0x55d1ee21c2d0 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 -- 172.21.15.66:0/213703576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8990016040 con 0x55d1ee21c2d0 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8868039a70 0x7f886803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f8872ffd640 1 -- 172.21.15.66:0/213703576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8990032070 con 0x55d1ee21c2d0 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899d5d4640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8868039a70 0x7f886803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee22dd60 0x55d1ee2301f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee230940 con 0x55d1ee22dd60 2024-09-12T00:19:08.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899cdd3640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee22dd60 0x55d1ee2301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899d5d4640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8868039a70 0x7f886803bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89980e9410 tx=0x7f89980d73b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899cdd3640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee22dd60 0x55d1ee2301f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f899400d040 con 0x55d1ee22dd60 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 realm 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee22d130 con 0x55d1ee22dd60 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f899400d040 con 0x55d1ee22dd60 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee231440 con 0x55d1ee22dd60 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f899400d040 con 0x55d1ee22dd60 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.989+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee231d10 con 0x55d1ee22dd60 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f899400d040 con 0x55d1ee22dd60 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee232730 0x55d1ee234b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee235260 con 0x55d1ee232730 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee232730 0x55d1ee234b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee232730 0x55d1ee234b20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 20 searching for the correct realm 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f899005d040 0x7f89900178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899d5d4640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f899005d040 0x7f89900178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899d5d4640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f899005d040 0x7f89900178a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899d5d4640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89980bc360 0x7f89980d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899cdd3640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89980bc360 0x7f89980d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899cdd3640 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89980bc360 0x7f89980d7570 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899400d040 con 0x7f89980bc360 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.993+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899400d040 con 0x55d1ee22dd60 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:07.997+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.001+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee232730 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f89980bc360 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x55d1ee22dd60 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236b30 con 0x7f899005d040 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:08.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee235be0 con 0x55d1ee22dd60 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236480 con 0x55d1ee22dd60 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236480 con 0x55d1ee232730 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 zone default found 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 4 Realm: () 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 zonegroup default 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee236f60 con 0x7f89980bc360 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee238d70 con 0x55d1ee232730 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.005+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee2391e0 con 0x55d1ee232730 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 20 started sync module instance, tier type = 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:08.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee238210 con 0x7f899005d040 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94360131829088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee239640 con 0x7f899005d040 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee239e90 con 0x55d1ee22dd60 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94360131829088] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94360131831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee239f10 con 0x55d1ee22dd60 2024-09-12T00:19:08.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.009+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23aa30 con 0x55d1ee232730 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94360131839232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23a9f0 con 0x55d1ee232730 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23b990 con 0x7f899005d040 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94360131831296] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94360131836384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23bd80 con 0x7f899005d040 2024-09-12T00:19:08.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23c740 con 0x55d1ee22dd60 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94360131839232] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.013+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94360131836384] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94360131841568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23c290 con 0x55d1ee22dd60 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23cb20 con 0x7f89980bc360 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94360131841568] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94360131843184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23c740 con 0x7f89980bc360 2024-09-12T00:19:08.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.017+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23d530 con 0x7f89980bc360 2024-09-12T00:19:08.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94360131843184] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94360131847072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23d530 con 0x7f89980bc360 2024-09-12T00:19:08.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23def0 con 0x7f89980bc360 2024-09-12T00:19:08.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94360131847072] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94360131850848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23def0 con 0x7f89980bc360 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=0 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=1 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=2 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=3 2024-09-12T00:19:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=4 2024-09-12T00:19:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=5 2024-09-12T00:19:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.021+0000 7f899face9c0 20 add_watcher() i=6 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94360131850848] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 add_watcher() i=7 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee241200 con 0x55d1ee22dd60 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94360131853232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee23e480 con 0x55d1ee22dd60 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94360131853232] v31'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f88537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 5 note: GC not initialized 2024-09-12T00:19:08.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f88527e4640 20 reqs_thread_entry: start 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 Filter name: none 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f87c3fff640 20 reqs_thread_entry: start 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee2648d0 con 0x55d1ee22dd60 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.025+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee26b8b0 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94360132039456 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94360131841568 notify 133143986184 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55d1edfb59c0 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94360131841568 notifier 4403 bl.length()=758 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(64 notify.4 [notify cookie 94360132039456 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8860003eb0 con 0x55d1ee22dd60 2024-09-12T00:19:08.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94360132039456 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f899402e580 con 0x55d1ee22dd60 2024-09-12T00:19:08.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee26b320 con 0x55d1ee22dd60 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(66 foo:foo1 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94360132039456 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee266b50 con 0x7f899005d040 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== watch-notify(notify (1) cookie 94360131829088 notify 133143986180 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f89980fd040 con 0x7f899005d040 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94360131829088 notifier 4403 bl.length()=159 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [notify cookie 94360132039456 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f8880ff9640 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8860003eb0 con 0x7f899005d040 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.029+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== watch-notify(notify_complete (2) cookie 94360132039456 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f89980e8040 con 0x7f899005d040 2024-09-12T00:19:08.037 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T00:19:07.676243Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f88537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94360131853232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x55d1ee22dd60 2024-09-12T00:19:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94360131853232] v31'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94360131829088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x7f899005d040 2024-09-12T00:19:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94360131829088] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899face9c0 20 remove_watcher() i=0 2024-09-12T00:19:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899face9c0 2 removed watcher, disabling cache 2024-09-12T00:19:08.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.033+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94360131831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x55d1ee22dd60 2024-09-12T00:19:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94360131831296] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 20 remove_watcher() i=1 2024-09-12T00:19:08.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94360131839232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x55d1ee232730 2024-09-12T00:19:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899ddd5640 1 -- 172.21.15.66:0/213703576 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94360131839232] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899003c020 con 0x55d1ee232730 2024-09-12T00:19:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 20 remove_watcher() i=2 2024-09-12T00:19:08.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94360131836384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x7f899005d040 2024-09-12T00:19:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899d5d4640 1 -- 172.21.15.66:0/213703576 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94360131836384] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89980a93c0 con 0x7f899005d040 2024-09-12T00:19:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 20 remove_watcher() i=3 2024-09-12T00:19:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.037+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94360131841568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee267000 con 0x55d1ee22dd60 2024-09-12T00:19:08.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94360131841568] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x55d1ee22dd60 2024-09-12T00:19:08.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899face9c0 20 remove_watcher() i=4 2024-09-12T00:19:08.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94360131843184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee262630 con 0x7f89980bc360 2024-09-12T00:19:08.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94360131843184] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899face9c0 20 remove_watcher() i=5 2024-09-12T00:19:08.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.041+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94360131847072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee262630 con 0x7f89980bc360 2024-09-12T00:19:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.045+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94360131847072] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.045+0000 7f899face9c0 20 remove_watcher() i=6 2024-09-12T00:19:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.045+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94360131850848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d1ee262630 con 0x7f89980bc360 2024-09-12T00:19:08.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94360131850848] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f899402a040 con 0x7f89980bc360 2024-09-12T00:19:08.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 20 remove_watcher() i=7 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89980bc360 msgr2=0x7f89980d7570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89980bc360 0x7f89980d7570 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee22dd60 msgr2=0x55d1ee2301f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee22dd60 0x55d1ee2301f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f899005d040 msgr2=0x7f89900178a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f899005d040 0x7f89900178a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee232730 msgr2=0x55d1ee234b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee232730 0x55d1ee234b20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8868039a70 msgr2=0x7f886803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8868039a70 0x7f886803bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89980e9410 tx=0x7f89980d73b0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 msgr2=0x55d1ee2227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8990028ff0 tx=0x7f8990050070 comp rx=0 tx=0).stop 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899cdd3640 1 -- 172.21.15.66:0/213703576 reap_dead start 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 shutdown_connections 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/213703576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee21c2d0 0x55d1ee2227b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 >> 172.21.15.66:0/213703576 conn(0x55d1ee2176f0 msgr2=0x55d1ee215900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 shutdown_connections 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/213703576 wait complete. 2024-09-12T00:19:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 msgr2=0x7f887403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 0x7f887403bf30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89980b3dd0 tx=0x7f89980e92e0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 msgr2=0x55d1ee211630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55d1ee1f3d00 tx=0x7f899000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 shutdown_connections 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8874039a70 0x7f887403bf30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/1714133273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee075900 0x55d1ee211630 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 >> 172.21.15.66:0/1714133273 conn(0x55d1ee203240 msgr2=0x55d1ee203620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 shutdown_connections 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/1714133273 wait complete. 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 msgr2=0x55d1ee1f9e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 0x55d1ee1f9e40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 msgr2=0x55d1ee1fe9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 0x55d1ee1fe9d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 msgr2=0x7f888403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 0x7f888403bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8994001e60 tx=0x7f89940013e0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 msgr2=0x55d1ee1f2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8998000f90 tx=0x7f8998017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 shutdown_connections 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d1ee1fc530 0x55d1ee1fe9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d1ee103550 0x55d1ee1f9e40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8884039a70 0x7f888403bf30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 --2- 172.21.15.66:0/3800879925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ee100370 0x55d1ee1f2cd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 >> 172.21.15.66:0/3800879925 conn(0x55d1ee0fbe90 msgr2=0x55d1ee1e5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 shutdown_connections 2024-09-12T00:19:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.049+0000 7f899face9c0 1 -- 172.21.15.66:0/3800879925 wait complete. 2024-09-12T00:19:08.063 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T00:19:07.676243Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:08.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T00:19:08.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T00:19:08.063 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-12T00:19:08.132 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7fe7d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d556070b50 0x55d556104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7fe7d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d555fb09c0 con 0x55d556070770 2024-09-12T00:19:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7fe7d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d5560006d0 con 0x55d556070b50 2024-09-12T00:19:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d182640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d556070b50 0x55d556104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d983640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55d556070770 0x55d5561015a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42874/0 (socket says 172.21.15.66:42874) 2024-09-12T00:19:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d182640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d556070b50 0x55d556104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44436/0 (socket says 172.21.15.66:44436) 2024-09-12T00:19:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d983640 1 -- 172.21.15.66:0/2859358488 learned_addr learned my addr 172.21.15.66:0/2859358488 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d182640 1 -- 172.21.15.66:0/2859358488 >> v1:172.21.15.31:6789/0 conn(0x55d556070770 legacy=0x55d5561015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.129+0000 7fda7d182640 1 -- 172.21.15.66:0/2859358488 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d555fa4ca0 con 0x55d556070b50 2024-09-12T00:19:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7d182640 1 --2- 172.21.15.66:0/2859358488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070b50 0x55d556104cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda7000a420 tx=0x7fda7001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb7ab2389ad2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7c981640 1 -- 172.21.15.66:0/2859358488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda700af070 con 0x55d556070b50 2024-09-12T00:19:08.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7c981640 1 -- 172.21.15.66:0/2859358488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda700aa530 con 0x55d556070b50 2024-09-12T00:19:08.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7c981640 1 -- 172.21.15.66:0/2859358488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda700aa850 con 0x55d556070b50 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2859358488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070b50 msgr2=0x55d556104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/2859358488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070b50 0x55d556104cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fda7000a420 tx=0x7fda7001afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2859358488 shutdown_connections 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/2859358488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070b50 0x55d556104cd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2859358488 >> 172.21.15.66:0/2859358488 conn(0x55d5560f6e90 msgr2=0x55d5560f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2859358488 shutdown_connections 2024-09-12T00:19:08.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.133+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2859358488 wait complete. 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7fe7d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7fe7d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d556004680 con 0x55d556070770 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7d983640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7d983640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44438/0 (socket says 172.21.15.66:44438) 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7d983640 1 -- 172.21.15.66:0/134671106 learned_addr learned my addr 172.21.15.66:0/134671106 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7d983640 1 -- 172.21.15.66:0/134671106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d555f7fda0 con 0x55d556070770 2024-09-12T00:19:08.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.145+0000 7fda7d983640 1 --2- 172.21.15.66:0/134671106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda78001e00 tx=0x7fda7800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421e905240b0f81f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd96ae15640 1 -- 172.21.15.66:0/134671106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda78012020 con 0x55d556070770 2024-09-12T00:19:08.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd96ae15640 1 -- 172.21.15.66:0/134671106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7800e690 con 0x55d556070770 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd96ae15640 1 -- 172.21.15.66:0/134671106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7800ea10 con 0x55d556070770 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/134671106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 msgr2=0x55d5561e9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/134671106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fda78001e00 tx=0x7fda7800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/134671106 shutdown_connections 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/134671106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561e9a50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/134671106 >> 172.21.15.66:0/134671106 conn(0x55d5560f6e90 msgr2=0x55d5561e56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/134671106 shutdown_connections 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/134671106 wait complete. 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d555fa6a50 con 0x55d556070770 2024-09-12T00:19:08.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7d983640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7d983640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44450/0 (socket says 172.21.15.66:44450) 2024-09-12T00:19:08.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7d983640 1 -- 172.21.15.66:0/1372335632 learned_addr learned my addr 172.21.15.66:0/1372335632 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7d983640 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5561f1650 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7d983640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d5561eaa40 tx=0x7fda78000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd969612640 1 -- 172.21.15.66:0/1372335632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda78012030 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5561f18e0 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd969612640 1 -- 172.21.15.66:0/1372335632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7801a750 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fd969612640 1 -- 172.21.15.66:0/1372335632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda7801aa50 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.149+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5561f2290 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fd969612640 1 -- 172.21.15.66:0/1372335632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda78015020 con 0x55d556070770 2024-09-12T00:19:08.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fd969612640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 0x7fd96403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fd969612640 1 -- 172.21.15.66:0/1372335632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda78020030 con 0x55d556070770 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d182640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 0x7fd96403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 0x55d5561f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5561f87a0 con 0x55d556070b50 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7e184640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 0x55d5561f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d182640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 0x7fd96403bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda700ac000 tx=0x7fda700a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7e184640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 0x55d5561f8260 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7e184640 1 -- 172.21.15.66:0/1372335632 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda680083f0 con 0x55d556070b50 2024-09-12T00:19:08.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5561f2690 con 0x55d556070b50 2024-09-12T00:19:08.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7e184640 1 -- 172.21.15.66:0/1372335632 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda680083f0 con 0x55d556070b50 2024-09-12T00:19:08.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 0x55d5561fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5561fd4f0 con 0x55d5561faa10 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d983640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 0x55d5561fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d983640 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 0x55d5561fce00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d983640 1 -- 172.21.15.66:0/1372335632 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda78008030 con 0x55d5561faa10 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5561f98b0 con 0x55d556070b50 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7e184640 1 -- 172.21.15.66:0/1372335632 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda680083f0 con 0x55d556070b50 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5561f9d90 con 0x55d5561faa10 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7d983640 1 -- 172.21.15.66:0/1372335632 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda78008030 con 0x55d5561faa10 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.153+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d556011450 con 0x55d55620bc40 2024-09-12T00:19:08.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44460/0 (socket says 172.21.15.66:44460) 2024-09-12T00:19:08.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7e184640 1 -- 172.21.15.66:0/3910635011 learned_addr learned my addr 172.21.15.66:0/3910635011 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7e184640 1 -- 172.21.15.66:0/3910635011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d55620c6a0 con 0x55d55620bc40 2024-09-12T00:19:08.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7e184640 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d5561f2480 tx=0x7fda6800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 -- 172.21.15.66:0/3910635011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6801c020 con 0x55d55620bc40 2024-09-12T00:19:08.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d55620cf00 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 -- 172.21.15.66:0/3910635011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68007d20 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 -- 172.21.15.66:0/3910635011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68018440 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d55620d470 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 -- 172.21.15.66:0/3910635011 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda6801f020 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 0x7fd95403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fd9627fc640 1 -- 172.21.15.66:0/3910635011 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda68051d40 con 0x55d55620bc40 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7d983640 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 0x7fd95403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7d983640 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 0x7fd95403bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda7804ec90 tx=0x7fda78016ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.157+0000 7fda7fe7d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d5561ea280 con 0x55d5562195d0 2024-09-12T00:19:08.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44476/0 (socket says 172.21.15.66:44476) 2024-09-12T00:19:08.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 -- 172.21.15.66:0/2495749169 learned_addr learned my addr 172.21.15.66:0/2495749169 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 -- 172.21.15.66:0/2495749169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d556219fc0 con 0x55d5562195d0 2024-09-12T00:19:08.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- 172.21.15.66:0/2495749169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda68021fd0 tx=0x7fda68016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1983d241d532e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd953fff640 1 -- 172.21.15.66:0/2495749169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68029d50 con 0x55d5562195d0 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd953fff640 1 -- 172.21.15.66:0/2495749169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68021400 con 0x55d5562195d0 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd953fff640 1 -- 172.21.15.66:0/2495749169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68029350 con 0x55d5562195d0 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2495749169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 msgr2=0x55d5562199d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/2495749169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda68021fd0 tx=0x7fda68016970 comp rx=0 tx=0).stop 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2495749169 shutdown_connections 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/2495749169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d5562199d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2495749169 >> 172.21.15.66:0/2495749169 conn(0x55d5562149f0 msgr2=0x55d556212c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2495749169 shutdown_connections 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/2495749169 wait complete. 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 Processor -- start 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- start start 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d556218520 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44480/0 (socket says 172.21.15.66:44480) 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 learned_addr learned my addr 172.21.15.66:0/1344650334 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d55621ffe0 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7e184640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda68018fd0 tx=0x7fda68050020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd9527fc640 1 -- 172.21.15.66:0/1344650334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68039070 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d556220270 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd9527fc640 1 -- 172.21.15.66:0/1344650334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68020a60 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d556220c20 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.161+0000 7fd9527fc640 1 -- 172.21.15.66:0/1344650334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68020d40 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fd9527fc640 1 -- 172.21.15.66:0/1344650334 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda6803c070 con 0x55d5562195d0 2024-09-12T00:19:08.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fd9527fc640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd948039a70 0x7fd94803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fd9527fc640 1 -- 172.21.15.66:0/1344650334 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fda68031070 con 0x55d5562195d0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d983640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd948039a70 0x7fd94803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d55622b040 0x55d55622d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d55622dc20 con 0x55d55622b040 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d55622b040 0x55d55622d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d983640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd948039a70 0x7fd94803bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ec40 tx=0x7fda7802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d55622b040 0x55d55622d4d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 realm 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d55622dff0 con 0x55d55622b040 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d55622e8c0 con 0x55d55622b040 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d55622ec60 con 0x55d55622b040 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d55622f9c0 0x55d556231db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5562323c0 con 0x55d55622f9c0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7e184640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d55622f9c0 0x55d556231db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7e184640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d55622f9c0 0x55d556231db0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 20 searching for the correct realm 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.165+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622f9c0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7e184640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fda680613f0 0x7fda680029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda680613f0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d983640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fda680613f0 0x7fda680029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d983640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fda680613f0 0x7fda680029e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d983640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fda78017050 0x7fda780163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda78017050 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fda78017050 0x7fda780163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fda78017050 0x7fda780163b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622b040 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622b040 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda78017050 2024-09-12T00:19:08.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.169+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda78017050 2024-09-12T00:19:08.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda680613f0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622f9c0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622b040 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda78017050 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x55d55622b040 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d556233c90 con 0x7fda680613f0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda78017050 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.173+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622b040 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622b040 2024-09-12T00:19:08.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda78017050 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda680613f0 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622b040 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda78017050 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda78017050 2024-09-12T00:19:08.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda680613f0 2024-09-12T00:19:08.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622f9c0 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.177+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda78017050 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x55d55622b040 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fda7805c060 con 0x7fda680613f0 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:08.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556232e40 con 0x55d55622b040 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5562336e0 con 0x55d55622b040 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556234030 con 0x55d55622f9c0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:08.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 zone default found 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 4 Realm: () 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 zonegroup default 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556234430 con 0x7fda78017050 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556236260 con 0x55d55622f9c0 2024-09-12T00:19:08.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d5562362b0 con 0x55d55622f9c0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.181+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556235700 con 0x7fda680613f0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374761550416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556236780 con 0x7fda680613f0 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556236fd0 con 0x55d55622b040 2024-09-12T00:19:08.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374761550416] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374761552624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556237030 con 0x55d55622b040 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.185+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556237b40 con 0x55d55622f9c0 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374761552624] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374761559536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556237b00 con 0x55d55622f9c0 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556237b00 con 0x7fda680613f0 2024-09-12T00:19:08.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374761562320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556238a80 con 0x7fda680613f0 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556239480 con 0x55d55622b040 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374761559536] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.189+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374761562320] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374761556768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d5562385d0 con 0x55d55622b040 2024-09-12T00:19:08.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556239d20 con 0x7fda78017050 2024-09-12T00:19:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374761556768] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374761566096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d5562385d0 con 0x7fda78017050 2024-09-12T00:19:08.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.193+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55623a200 con 0x7fda78017050 2024-09-12T00:19:08.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374761569520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55623a670 con 0x7fda78017050 2024-09-12T00:19:08.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55623b160 con 0x7fda78017050 2024-09-12T00:19:08.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374761566096] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374761569520] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374761573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55623a1c0 con 0x7fda78017050 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=0 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=1 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=2 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=3 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=4 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=5 2024-09-12T00:19:08.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.197+0000 7fda7fe7d9c0 20 add_watcher() i=6 2024-09-12T00:19:08.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374761573424] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700b2040 con 0x7fda78017050 2024-09-12T00:19:08.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 add_watcher() i=7 2024-09-12T00:19:08.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:08.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d55623e260 con 0x55d55622b040 2024-09-12T00:19:08.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda700b2040 con 0x55d55622b040 2024-09-12T00:19:08.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374761567824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55623b6e0 con 0x55d55622b040 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374761567824] v31'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fd932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 5 note: GC not initialized 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fd931fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 Filter name: none 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fd8a37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556261530 con 0x55d55622b040 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.201+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d556267fb0 con 0x55d55622b040 2024-09-12T00:19:08.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94374761757216 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d556263950 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94374761556768 notify 133143986185 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55d555fa4ca0 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fd953fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94374761556768 notifier 4410 bl.length()=732 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fd953fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fd953fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fd953fff640 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd940003eb0 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(64 notify.4 [notify cookie 94374761757216 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94374761757216 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fda700aa7b0 con 0x55d55622b040 2024-09-12T00:19:08.211 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T00:19:07.676243Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:08.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fd932fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374761567824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x55d55622b040 2024-09-12T00:19:08.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94374761567824] v31'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.205+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374761550416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x7fda680613f0 2024-09-12T00:19:08.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94374761550416] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7fe7d9c0 20 remove_watcher() i=0 2024-09-12T00:19:08.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7fe7d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:08.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374761552624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x55d55622b040 2024-09-12T00:19:08.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94374761552624] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7fe7d9c0 20 remove_watcher() i=1 2024-09-12T00:19:08.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.209+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374761559536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x55d55622f9c0 2024-09-12T00:19:08.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7e184640 1 -- 172.21.15.66:0/1344650334 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94374761559536] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6805e040 con 0x55d55622f9c0 2024-09-12T00:19:08.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7fe7d9c0 20 remove_watcher() i=2 2024-09-12T00:19:08.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374761562320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x7fda680613f0 2024-09-12T00:19:08.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7d983640 1 -- 172.21.15.66:0/1344650334 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94374761562320] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda78008030 con 0x7fda680613f0 2024-09-12T00:19:08.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7fe7d9c0 20 remove_watcher() i=3 2024-09-12T00:19:08.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.213+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374761556768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x55d55622b040 2024-09-12T00:19:08.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94374761556768] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x55d55622b040 2024-09-12T00:19:08.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7fe7d9c0 20 remove_watcher() i=4 2024-09-12T00:19:08.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374761566096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x7fda78017050 2024-09-12T00:19:08.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94374761566096] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x7fda78017050 2024-09-12T00:19:08.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7fe7d9c0 20 remove_watcher() i=5 2024-09-12T00:19:08.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.217+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374761569520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x7fda78017050 2024-09-12T00:19:08.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94374761569520] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x7fda78017050 2024-09-12T00:19:08.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 20 remove_watcher() i=6 2024-09-12T00:19:08.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374761573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d55625f2d0 con 0x7fda78017050 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94374761573424] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda700d6040 con 0x7fda78017050 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 20 remove_watcher() i=7 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fda78017050 msgr2=0x7fda780163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fda78017050 0x7fda780163b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d55622b040 msgr2=0x55d55622d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d55622b040 0x55d55622d4d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fda680613f0 msgr2=0x7fda680029e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fda680613f0 0x7fda680029e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d55622f9c0 msgr2=0x55d556231db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d55622f9c0 0x55d556231db0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd948039a70 msgr2=0x7fd94803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd948039a70 0x7fd94803bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda7800ec40 tx=0x7fda7802f000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 msgr2=0x55d55621fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7d182640 1 -- 172.21.15.66:0/1344650334 reap_dead start 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda68018fd0 tx=0x7fda68050020 comp rx=0 tx=0).stop 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 shutdown_connections 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1344650334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d5562195d0 0x55d55621fa80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 >> 172.21.15.66:0/1344650334 conn(0x55d5562149f0 msgr2=0x55d556212c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 shutdown_connections 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1344650334 wait complete. 2024-09-12T00:19:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 msgr2=0x7fd95403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 0x7fd95403bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda7804ec90 tx=0x7fda78016ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 msgr2=0x55d55620c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x55d5561f2480 tx=0x7fda6800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 shutdown_connections 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd954039a70 0x7fd95403bf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/3910635011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d55620bc40 0x55d55620c060 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 >> 172.21.15.66:0/3910635011 conn(0x55d5562015f0 msgr2=0x55d5562019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 shutdown_connections 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/3910635011 wait complete. 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 msgr2=0x55d5561f8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 0x55d5561f8260 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 msgr2=0x55d5561fce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 0x55d5561fce00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 msgr2=0x7fd96403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 0x7fd96403bf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda700ac000 tx=0x7fda700a5000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 msgr2=0x55d5561f10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d5561eaa40 tx=0x7fda78000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 shutdown_connections 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d5561faa10 0x55d5561fce00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d556070b50 0x55d5561f8260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd964039ac0 0x7fd96403bf80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 --2- 172.21.15.66:0/1372335632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d556070770 0x55d5561f10f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 >> 172.21.15.66:0/1372335632 conn(0x55d5560f6e90 msgr2=0x55d5561e4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 shutdown_connections 2024-09-12T00:19:08.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.221+0000 7fda7fe7d9c0 1 -- 172.21.15.66:0/1372335632 wait complete. 2024-09-12T00:19:08.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T00:19:07.676243Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:08.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T00:19:08.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T00:19:08.237 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-12T00:19:08.309 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:08.309 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bdd709c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f66b0f700 0x560f66b0fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bdd709c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f669c19c0 con 0x560f66b12840 2024-09-12T00:19:08.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bdd709c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560f66a116d0 con 0x560f66b0f700 2024-09-12T00:19:08.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb876640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f66b0f700 0x560f66b0fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb876640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f66b0f700 0x560f66b0fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44494/0 (socket says 172.21.15.66:44494) 2024-09-12T00:19:08.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb876640 1 -- 172.21.15.66:0/1808186897 learned_addr learned my addr 172.21.15.66:0/1808186897 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb075640 1 --1- 172.21.15.66:0/1808186897 >> v1:172.21.15.31:6789/0 conn(0x560f66b12840 0x560f66b14c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42880/0 (socket says 172.21.15.66:42880) 2024-09-12T00:19:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb876640 1 -- 172.21.15.66:0/1808186897 >> v1:172.21.15.31:6789/0 conn(0x560f66b12840 legacy=0x560f66b14c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.305+0000 7f34bb876640 1 -- 172.21.15.66:0/1808186897 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f669b5ca0 con 0x560f66b0f700 2024-09-12T00:19:08.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bb876640 1 --2- 172.21.15.66:0/1808186897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66b0fae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00a4e0 tx=0x7f34ac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52987016e16d86f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34ba874640 1 -- 172.21.15.66:0/1808186897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0aa540 con 0x560f66b0f700 2024-09-12T00:19:08.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34ba874640 1 -- 172.21.15.66:0/1808186897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac0aa6e0 con 0x560f66b0f700 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34ba874640 1 -- 172.21.15.66:0/1808186897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0aaa40 con 0x560f66b0f700 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1808186897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 msgr2=0x560f66b0fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1808186897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66b0fae0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00a4e0 tx=0x7f34ac01b090 comp rx=0 tx=0).stop 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1808186897 shutdown_connections 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1808186897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66b0fae0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1808186897 >> 172.21.15.66:0/1808186897 conn(0x560f66a83010 msgr2=0x560f66a83420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1808186897 shutdown_connections 2024-09-12T00:19:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.309+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1808186897 wait complete. 2024-09-12T00:19:08.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.321+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.321+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f66a15680 con 0x560f66b0f700 2024-09-12T00:19:08.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44500/0 (socket says 172.21.15.66:44500) 2024-09-12T00:19:08.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 -- 172.21.15.66:0/683002557 learned_addr learned my addr 172.21.15.66:0/683002557 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 -- 172.21.15.66:0/683002557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f66990da0 con 0x560f66b0f700 2024-09-12T00:19:08.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 --2- 172.21.15.66:0/683002557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34ac019740 tx=0x7f34ac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c538a258fd75d384 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f33a9e0b640 1 -- 172.21.15.66:0/683002557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0b9070 con 0x560f66b0f700 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f33a9e0b640 1 -- 172.21.15.66:0/683002557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac0aaa90 con 0x560f66b0f700 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f33a9e0b640 1 -- 172.21.15.66:0/683002557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0aad70 con 0x560f66b0f700 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- 172.21.15.66:0/683002557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 msgr2=0x560f66bfa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/683002557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34ac019740 tx=0x7f34ac0033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- 172.21.15.66:0/683002557 shutdown_connections 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/683002557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66bfa990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- 172.21.15.66:0/683002557 >> 172.21.15.66:0/683002557 conn(0x560f66a83010 msgr2=0x560f66bf6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- 172.21.15.66:0/683002557 shutdown_connections 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- 172.21.15.66:0/683002557 wait complete. 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bdd709c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f669b7a50 con 0x560f66b0f700 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44508/0 (socket says 172.21.15.66:44508) 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 -- 172.21.15.66:0/157815262 learned_addr learned my addr 172.21.15.66:0/157815262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.325+0000 7f34bb876640 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f66c023a0 con 0x560f66b0f700 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bb876640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34ac018cc0 tx=0x7f34ac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 -- 172.21.15.66:0/157815262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0b9070 con 0x560f66b0f700 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f66c02630 con 0x560f66b0f700 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f66c02fe0 con 0x560f66b0f700 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 -- 172.21.15.66:0/157815262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac0b5ad0 con 0x560f66b0f700 2024-09-12T00:19:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 -- 172.21.15.66:0/157815262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34ac0b5db0 con 0x560f66b0f700 2024-09-12T00:19:08.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 -- 172.21.15.66:0/157815262 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34ac0b3040 con 0x560f66b0f700 2024-09-12T00:19:08.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 0x7f33a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f33a3fff640 1 -- 172.21.15.66:0/157815262 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f34ac0c4070 con 0x560f66b0f700 2024-09-12T00:19:08.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bb075640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 0x7f33a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 0x560f66c08fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c094f0 con 0x560f66b12840 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bc077640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 0x560f66c08fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bb075640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 0x7f33a403bf30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34a4001e90 tx=0x7f34a40013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bc077640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 0x560f66c08fb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bc077640 1 -- 172.21.15.66:0/157815262 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66b12840 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c03320 con 0x560f66b12840 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bc077640 1 -- 172.21.15.66:0/157815262 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66b12840 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 0x560f66c0db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c0e240 con 0x560f66c0b760 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bb876640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 0x560f66c0db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.329+0000 7f34bb876640 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 0x560f66c0db50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bb876640 1 -- 172.21.15.66:0/157815262 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x560f66c0b760 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c0a630 con 0x560f66b12840 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 -- 172.21.15.66:0/157815262 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66b12840 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c0aa90 con 0x560f66c0b760 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bb876640 1 -- 172.21.15.66:0/157815262 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x560f66c0b760 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f66a22450 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44522/0 (socket says 172.21.15.66:44522) 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 -- 172.21.15.66:0/496591853 learned_addr learned my addr 172.21.15.66:0/496591853 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 -- 172.21.15.66:0/496591853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f66c1d390 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bc077640 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x560f66c031d0 tx=0x7f34b400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f33a17fa640 1 -- 172.21.15.66:0/496591853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4007cb0 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f66c1dbf0 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f66c1e160 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f33a17fa640 1 -- 172.21.15.66:0/496591853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4007e50 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.333+0000 7f33a17fa640 1 -- 172.21.15.66:0/496591853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40245a0 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f33a17fa640 1 -- 172.21.15.66:0/496591853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34b4016050 con 0x560f66c1c930 2024-09-12T00:19:08.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f33a17fa640 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 0x7f339403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f33a17fa640 1 -- 172.21.15.66:0/496591853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f34b4051db0 con 0x560f66c1c930 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bb876640 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 0x7f339403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bb876640 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 0x7f339403bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34ac01b0d0 tx=0x7f34ac0c8ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f66bfb100 con 0x560f66c2a280 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44534/0 (socket says 172.21.15.66:44534) 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bc077640 1 -- 172.21.15.66:0/708429640 learned_addr learned my addr 172.21.15.66:0/708429640 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bc077640 1 -- 172.21.15.66:0/708429640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f66c2ac70 con 0x560f66c2a280 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bc077640 1 --2- 172.21.15.66:0/708429640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34b40501c0 tx=0x7f34b4014fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84223a20b5a5c1f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f339affd640 1 -- 172.21.15.66:0/708429640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4019450 con 0x560f66c2a280 2024-09-12T00:19:08.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f339affd640 1 -- 172.21.15.66:0/708429640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4024ca0 con 0x560f66c2a280 2024-09-12T00:19:08.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f339affd640 1 -- 172.21.15.66:0/708429640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40195f0 con 0x560f66c2a280 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- 172.21.15.66:0/708429640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 msgr2=0x560f66c2a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/708429640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f34b40501c0 tx=0x7f34b4014fb0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- 172.21.15.66:0/708429640 shutdown_connections 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/708429640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c2a680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- 172.21.15.66:0/708429640 >> 172.21.15.66:0/708429640 conn(0x560f66c25680 msgr2=0x560f66c238c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- 172.21.15.66:0/708429640 shutdown_connections 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- 172.21.15.66:0/708429640 wait complete. 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 Processor -- start 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- start start 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.337+0000 7f34bdd709c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f66c291b0 con 0x560f66c2a280 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bc077640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44538/0 (socket says 172.21.15.66:44538) 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 learned_addr learned my addr 172.21.15.66:0/1827679245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f66c30c20 con 0x560f66c2a280 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bc077640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f34b40186f0 tx=0x7f34b4050150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 -- 172.21.15.66:0/1827679245 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4033020 con 0x560f66c2a280 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 -- 172.21.15.66:0/1827679245 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4018b20 con 0x560f66c2a280 2024-09-12T00:19:08.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f66c30eb0 con 0x560f66c2a280 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 -- 172.21.15.66:0/1827679245 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4024740 con 0x560f66c2a280 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f66c31860 con 0x560f66c2a280 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 -- 172.21.15.66:0/1827679245 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34b4036020 con 0x560f66c2a280 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3384039a70 0x7f338403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f33997fa640 1 -- 172.21.15.66:0/1827679245 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f34b4039c40 con 0x560f66c2a280 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bb876640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3384039a70 0x7f338403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66c3bc50 0x560f66c3e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c3e860 con 0x560f66c3bc50 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bb075640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66c3bc50 0x560f66c3e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bb876640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3384039a70 0x7f338403bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0a9fd0 tx=0x7f34ac0dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bb075640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66c3bc50 0x560f66c3e110 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a400f660 con 0x560f66c3bc50 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 20 realm 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.341+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c3afa0 con 0x560f66c3bc50 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a400f660 con 0x560f66c3bc50 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c3f360 con 0x560f66c3bc50 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a400f660 con 0x560f66c3bc50 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c3fc30 con 0x560f66c3bc50 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34a400f660 con 0x560f66c3bc50 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c40650 0x560f66c42a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c43130 con 0x560f66c40650 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c40650 0x560f66c42a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c40650 0x560f66c42a40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 20 searching for the correct realm 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f34b4038020 0x7f34b402d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb876640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f34b4038020 0x7f34b402d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb876640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f34b4038020 0x7f34b402d7e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb876640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34ac0f8040 0x7f34ac0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb075640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34ac0f8040 0x7f34ac0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.345+0000 7f34bb075640 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34ac0f8040 0x7f34ac0d1930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a400f660 con 0x7f34ac0f8040 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a400f660 con 0x560f66c3bc50 2024-09-12T00:19:08.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.349+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a402b040 con 0x560f66c3bc50 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.353+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c40650 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x560f66c3bc50 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44a00 con 0x7f34b4038020 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c43a80 con 0x560f66c3bc50 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c44320 con 0x560f66c3bc50 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c436c0 con 0x560f66c40650 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 zone default found 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 4 Realm: () 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:08.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 zonegroup default 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.357+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c452e0 con 0x7f34ac0f8040 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c46ef0 con 0x560f66c40650 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c47350 con 0x560f66c40650 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 started sync module instance, tier type = 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c45cc0 con 0x7f34b4038020 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624148641808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c47350 con 0x7f34b4038020 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c47ba0 con 0x560f66c3bc50 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.361+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624148641808] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624148649712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c47b10 con 0x560f66c3bc50 2024-09-12T00:19:08.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c488f0 con 0x560f66c40650 2024-09-12T00:19:08.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624148653120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c48860 con 0x560f66c40650 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c49870 con 0x7f34b4038020 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624148649712] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624148656992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c49830 con 0x7f34b4038020 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4a280 con 0x560f66c3bc50 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624148653120] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.365+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624148656992] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624148651920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c49dd0 con 0x560f66c3bc50 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4ab20 con 0x7f34ac0f8040 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624148651920] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624148655328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4a840 con 0x7f34ac0f8040 2024-09-12T00:19:08.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.369+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4b090 con 0x7f34ac0f8040 2024-09-12T00:19:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624148662816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4b430 con 0x7f34ac0f8040 2024-09-12T00:19:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4bf50 con 0x7f34ac0f8040 2024-09-12T00:19:08.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624148655328] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624148666912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4bf10 con 0x7f34ac0f8040 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=0 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=1 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=2 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=3 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=4 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=5 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624148662816] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.373+0000 7f34bdd709c0 20 add_watcher() i=6 2024-09-12T00:19:08.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624148666912] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 add_watcher() i=7 2024-09-12T00:19:08.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:08.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4aec0 con 0x560f66c3bc50 2024-09-12T00:19:08.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624148663936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4c340 con 0x560f66c3bc50 2024-09-12T00:19:08.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624148663936] v31'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f3371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 5 note: GC not initialized 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f3370fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 Filter name: none 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f32ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c724b0 con 0x560f66c3bc50 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T00:19:08.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:08.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:08.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.377+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c79010 con 0x560f66c3bc50 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94624148851360 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x560f66c3bc50 2024-09-12T00:19:08.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94624148651920 notify 133143986186 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f34a4018040 con 0x560f66c3bc50 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94624148651920 notifier 4417 bl.length()=567 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339affd640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3380003eb0 con 0x560f66c3bc50 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(64 notify.4 [notify cookie 94624148851360 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94624148851360 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f669c19c0 con 0x560f66c3bc50 2024-09-12T00:19:08.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c78aa0 con 0x7f34b4038020 2024-09-12T00:19:08.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 foo:foo2 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94624148851360 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560f66c742f0 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== watch-notify(notify (1) cookie 94624148641808 notify 133143986181 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f34ac0e8040 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94624148641808 notifier 4417 bl.length()=159 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f339a7fc640 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f32f00032d0 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.381+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 notify.0 [notify cookie 94624148851360 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== watch-notify(notify_complete (2) cookie 94624148851360 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f66c02fe0 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.389 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f3371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624148663936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x560f66c3bc50 2024-09-12T00:19:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94624148663936] v31'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624148641808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x7f34b4038020 2024-09-12T00:19:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94624148641808] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bdd709c0 20 remove_watcher() i=0 2024-09-12T00:19:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bdd709c0 2 removed watcher, disabling cache 2024-09-12T00:19:08.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.385+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624148649712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x560f66c3bc50 2024-09-12T00:19:08.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94624148649712] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 20 remove_watcher() i=1 2024-09-12T00:19:08.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624148653120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x560f66c40650 2024-09-12T00:19:08.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bc077640 1 -- 172.21.15.66:0/1827679245 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94624148653120] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34b40083f0 con 0x560f66c40650 2024-09-12T00:19:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 20 remove_watcher() i=2 2024-09-12T00:19:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624148656992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x7f34b4038020 2024-09-12T00:19:08.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bb876640 1 -- 172.21.15.66:0/1827679245 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94624148656992] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ac0a9ce0 con 0x7f34b4038020 2024-09-12T00:19:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 20 remove_watcher() i=3 2024-09-12T00:19:08.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.389+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624148651920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c747a0 con 0x560f66c3bc50 2024-09-12T00:19:08.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94624148651920] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x560f66c3bc50 2024-09-12T00:19:08.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bdd709c0 20 remove_watcher() i=4 2024-09-12T00:19:08.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624148655328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c4ae80 con 0x7f34ac0f8040 2024-09-12T00:19:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94624148655328] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bdd709c0 20 remove_watcher() i=5 2024-09-12T00:19:08.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.393+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624148662816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c45810 con 0x7f34ac0f8040 2024-09-12T00:19:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94624148662816] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 20 remove_watcher() i=6 2024-09-12T00:19:08.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624148666912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560f66c476f0 con 0x7f34ac0f8040 2024-09-12T00:19:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94624148666912] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34a403b040 con 0x7f34ac0f8040 2024-09-12T00:19:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 20 remove_watcher() i=7 2024-09-12T00:19:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34ac0f8040 msgr2=0x7f34ac0d1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34ac0f8040 0x7f34ac0d1930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66c3bc50 msgr2=0x560f66c3e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66c3bc50 0x560f66c3e110 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f34b4038020 msgr2=0x7f34b402d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f34b4038020 0x7f34b402d7e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c40650 msgr2=0x560f66c42a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c40650 0x560f66c42a40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3384039a70 msgr2=0x7f338403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3384039a70 0x7f338403bf30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34ac0a9fd0 tx=0x7f34ac0dd000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bb075640 1 -- 172.21.15.66:0/1827679245 reap_dead start 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 msgr2=0x560f66c306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f34b40186f0 tx=0x7f34b4050150 comp rx=0 tx=0).stop 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 shutdown_connections 2024-09-12T00:19:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/1827679245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c2a280 0x560f66c306c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 >> 172.21.15.66:0/1827679245 conn(0x560f66c25680 msgr2=0x560f66c23890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 shutdown_connections 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.397+0000 7f34bdd709c0 1 -- 172.21.15.66:0/1827679245 wait complete. 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 msgr2=0x7f339403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 0x7f339403bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34ac01b0d0 tx=0x7f34ac0c8ea0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 msgr2=0x560f66c1cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x560f66c031d0 tx=0x7f34b400af40 comp rx=0 tx=0).stop 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 shutdown_connections 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3394039a70 0x7f339403bf30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/496591853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66c1c930 0x560f66c1cd50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 >> 172.21.15.66:0/496591853 conn(0x560f66c122e0 msgr2=0x560f66c126c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 shutdown_connections 2024-09-12T00:19:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/496591853 wait complete. 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 msgr2=0x560f66c08fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 0x560f66c08fb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 msgr2=0x560f66c0db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 0x560f66c0db50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 msgr2=0x7f33a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 0x7f33a403bf30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34a4001e90 tx=0x7f34a40013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 msgr2=0x560f66c01e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34ac018cc0 tx=0x7f34ac017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 shutdown_connections 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f66c0b760 0x560f66c0db50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f66b12840 0x560f66c08fb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f33a4039a70 0x7f33a403bf30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 --2- 172.21.15.66:0/157815262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f66b0f700 0x560f66c01e40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 >> 172.21.15.66:0/157815262 conn(0x560f66a83010 msgr2=0x560f66bf50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 shutdown_connections 2024-09-12T00:19:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.401+0000 7f34bdd709c0 1 -- 172.21.15.66:0/157815262 wait complete. 2024-09-12T00:19:08.414 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:08.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T00:19:08.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T00:19:08.414 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T00:19:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8be9f79c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55faae31a520 0x55faae31a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8be9f79c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55faae1ce9c0 con 0x55faae31d6b0 2024-09-12T00:19:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8be9f79c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55faae21e6d0 con 0x55faae31a520 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bc4fd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55faae31a520 0x55faae31a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bc4fd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55faae31a520 0x55faae31a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44548/0 (socket says 172.21.15.66:44548) 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/1266533699 learned_addr learned my addr 172.21.15.66:0/1266533699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bbcfc640 1 --1- 172.21.15.66:0/1266533699 >> v1:172.21.15.31:6789/0 conn(0x55faae31d6b0 0x55faae31faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42884/0 (socket says 172.21.15.66:42884) 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/1266533699 >> v1:172.21.15.31:6789/0 conn(0x55faae31d6b0 legacy=0x55faae31faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.489+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/1266533699 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae1c2ca0 con 0x55faae31a520 2024-09-12T00:19:08.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/1266533699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae31a900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00a5c0 tx=0x7fa8ac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d578d9248db6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8bb4fb640 1 -- 172.21.15.66:0/1266533699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0a6070 con 0x55faae31a520 2024-09-12T00:19:08.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8bb4fb640 1 -- 172.21.15.66:0/1266533699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0af070 con 0x55faae31a520 2024-09-12T00:19:08.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8bb4fb640 1 -- 172.21.15.66:0/1266533699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0aa5c0 con 0x55faae31a520 2024-09-12T00:19:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1266533699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 msgr2=0x55faae31a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1266533699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae31a900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00a5c0 tx=0x7fa8ac01b340 comp rx=0 tx=0).stop 2024-09-12T00:19:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1266533699 shutdown_connections 2024-09-12T00:19:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1266533699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae31a900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1266533699 >> 172.21.15.66:0/1266533699 conn(0x55faae316040 msgr2=0x55faae318460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1266533699 shutdown_connections 2024-09-12T00:19:08.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.493+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1266533699 wait complete. 2024-09-12T00:19:08.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8be9f79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8be9f79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55faae222680 con 0x55faae31a520 2024-09-12T00:19:08.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8bc4fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8bc4fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44564/0 (socket says 172.21.15.66:44564) 2024-09-12T00:19:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/1891703410 learned_addr learned my addr 172.21.15.66:0/1891703410 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.505+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/1891703410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae19dda0 con 0x55faae31a520 2024-09-12T00:19:08.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/1891703410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac018f70 tx=0x7fa8ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c3217c588bd485 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa7aa60c640 1 -- 172.21.15.66:0/1891703410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0aa8b0 con 0x55faae31a520 2024-09-12T00:19:08.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa7aa60c640 1 -- 172.21.15.66:0/1891703410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0aaa50 con 0x55faae31a520 2024-09-12T00:19:08.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa7aa60c640 1 -- 172.21.15.66:0/1891703410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0aad30 con 0x55faae31a520 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1891703410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 msgr2=0x55faae290f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1891703410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac018f70 tx=0x7fa8ac003030 comp rx=0 tx=0).stop 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1891703410 shutdown_connections 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1891703410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae290f80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1891703410 >> 172.21.15.66:0/1891703410 conn(0x55faae316040 msgr2=0x55faae401440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1891703410 shutdown_connections 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1891703410 wait complete. 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8be9f79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55faae1c4a50 con 0x55faae31a520 2024-09-12T00:19:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44580/0 (socket says 172.21.15.66:44580) 2024-09-12T00:19:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/323364605 learned_addr learned my addr 172.21.15.66:0/323364605 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae40f3b0 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.509+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac018f70 tx=0x7fa8ac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 -- 172.21.15.66:0/323364605 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0c6690 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faae40f640 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 -- 172.21.15.66:0/323364605 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0c6830 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faae40fff0 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 -- 172.21.15.66:0/323364605 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0c6b10 con 0x55faae31a520 2024-09-12T00:19:08.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 -- 172.21.15.66:0/323364605 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa8ac0ce030 con 0x55faae31a520 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 0x7fa7a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa7a8e09640 1 -- 172.21.15.66:0/323364605 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa8ac0cc020 con 0x55faae31a520 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 0x7fa7a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 0x55faae415fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae416500 con 0x55faae31d6b0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 0x55faae415fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 0x7fa7a403bf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4001e90 tx=0x7fa8a40013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 0x55faae415fc0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bccfe640 1 -- 172.21.15.66:0/323364605 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4d0 con 0x55faae31d6b0 2024-09-12T00:19:08.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae410330 con 0x55faae31d6b0 2024-09-12T00:19:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bccfe640 1 -- 172.21.15.66:0/323364605 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa8b400a4d0 con 0x55faae31d6b0 2024-09-12T00:19:08.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 0x55faae41ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae41b250 con 0x55faae418770 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 0x55faae41ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 0x55faae41ab60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/323364605 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa8ac0d0ac0 con 0x55faae418770 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.513+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae417610 con 0x55faae31d6b0 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 -- 172.21.15.66:0/323364605 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa8b400a4d0 con 0x55faae31d6b0 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae417af0 con 0x55faae418770 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/323364605 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa8ac0d0ac0 con 0x55faae418770 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55faae22f450 con 0x55faae4299c0 2024-09-12T00:19:08.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44592/0 (socket says 172.21.15.66:44592) 2024-09-12T00:19:08.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 -- 172.21.15.66:0/3848053045 learned_addr learned my addr 172.21.15.66:0/3848053045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 -- 172.21.15.66:0/3848053045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae42a420 con 0x55faae4299c0 2024-09-12T00:19:08.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55faae40fd60 tx=0x7fa8b40163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 -- 172.21.15.66:0/3848053045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b4013450 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faae42ac80 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faae42b1f0 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 -- 172.21.15.66:0/3848053045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b40135f0 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 -- 172.21.15.66:0/3848053045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b4013910 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 -- 172.21.15.66:0/3848053045 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa8b4011040 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 0x7fa79403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa7a1ffb640 1 -- 172.21.15.66:0/3848053045 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa8b400e040 con 0x55faae4299c0 2024-09-12T00:19:08.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.517+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 0x7fa79403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 0x7fa79403bf80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55faae416940 tx=0x7fa8ac0d0d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55faae2916f0 con 0x55faae437310 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44608/0 (socket says 172.21.15.66:44608) 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 -- 172.21.15.66:0/1243704743 learned_addr learned my addr 172.21.15.66:0/1243704743 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 -- 172.21.15.66:0/1243704743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae437d00 con 0x55faae437310 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/1243704743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4050a20 tx=0x7fa8b4050f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de47d98d851bbfe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa79b7fe640 1 -- 172.21.15.66:0/1243704743 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b40143c0 con 0x55faae437310 2024-09-12T00:19:08.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa79b7fe640 1 -- 172.21.15.66:0/1243704743 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b4021960 con 0x55faae437310 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa79b7fe640 1 -- 172.21.15.66:0/1243704743 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b4013c90 con 0x55faae437310 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1243704743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 msgr2=0x55faae437710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1243704743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4050a20 tx=0x7fa8b4050f00 comp rx=0 tx=0).stop 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1243704743 shutdown_connections 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/1243704743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae437710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1243704743 >> 172.21.15.66:0/1243704743 conn(0x55faae432710 msgr2=0x55faae430950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1243704743 shutdown_connections 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/1243704743 wait complete. 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 Processor -- start 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- start start 2024-09-12T00:19:08.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8be9f79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55faae436240 con 0x55faae437310 2024-09-12T00:19:08.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44618/0 (socket says 172.21.15.66:44618) 2024-09-12T00:19:08.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 learned_addr learned my addr 172.21.15.66:0/2731554939 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faae43dcc0 con 0x55faae437310 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.521+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402afd0 tx=0x7fa8b4050980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 -- 172.21.15.66:0/2731554939 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b4038070 con 0x55faae437310 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faae43df50 con 0x55faae437310 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 -- 172.21.15.66:0/2731554939 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b404f2c0 con 0x55faae437310 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faae43e900 con 0x55faae437310 2024-09-12T00:19:08.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 -- 172.21.15.66:0/2731554939 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8b404f5a0 con 0x55faae437310 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 -- 172.21.15.66:0/2731554939 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa8b4005020 con 0x55faae437310 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa78c039a70 0x7fa78c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa799ffb640 1 -- 172.21.15.66:0/2731554939 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa8b404e070 con 0x55faae437310 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa78c039a70 0x7fa78c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae448f10 0x55faae44b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae44baf0 con 0x55faae448f10 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae448f10 0x55faae44b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa78c039a70 0x7fa78c03bf30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0abe60 tx=0x7fa8ac0e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae448f10 0x55faae44b3a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8a400f660 con 0x55faae448f10 2024-09-12T00:19:08.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 realm 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae4482e0 con 0x55faae448f10 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8a400f660 con 0x55faae448f10 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae44c5f0 con 0x55faae448f10 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8a400f660 con 0x55faae448f10 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae44cec0 con 0x55faae448f10 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa8a400f660 con 0x55faae448f10 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae44d770 0x55faae44fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae4502c0 con 0x55faae44d770 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae44d770 0x55faae44fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae44d770 0x55faae44fb60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:08.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 20 searching for the correct realm 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.525+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bccfe640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa8b4013070 0x7fa8b4051050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa8b4013070 0x7fa8b4051050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa8b4013070 0x7fa8b4051050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bc4fd640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa8ac0f8040 0x7fa8ac0bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa8ac0f8040 0x7fa8ac0bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa8ac0f8040 0x7fa8ac0bc7f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a400f660 con 0x7fa8ac0f8040 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a400f660 con 0x55faae448f10 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.529+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.533+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a402b040 con 0x55faae448f10 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae44d770 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.537+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x55faae448f10 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55faae451be0 con 0x7fa8b4013070 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae450cd0 con 0x55faae448f10 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae450910 con 0x55faae448f10 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae4515f0 con 0x55faae44d770 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 zone default found 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 4 Realm: () 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:08.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 zonegroup default 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae451120 con 0x7fa8ac0f8040 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae453f30 con 0x55faae44d770 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae454390 con 0x55faae44d770 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 started sync module instance, tier type = 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae453370 con 0x7fa8b4013070 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.541+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94535153954496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae4547f0 con 0x7fa8b4013070 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae455040 con 0x55faae448f10 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94535153954496] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94535153961872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae455460 con 0x55faae448f10 2024-09-12T00:19:08.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.545+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae455cb0 con 0x55faae44d770 2024-09-12T00:19:08.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94535153961872] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94535153963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae455ad0 con 0x55faae44d770 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae4566c0 con 0x7fa8b4013070 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94535153967632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae456f10 con 0x7fa8b4013070 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae457910 con 0x55faae448f10 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94535153963200] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94535153967632] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94535153969760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae457420 con 0x55faae448f10 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.549+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae4581b0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.553+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94535153969760] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.553+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.553+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94535153964320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae458120 con 0x7fa8ac0f8040 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.553+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae458ae0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.553+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94535153964320] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94535153974656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae458ae0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae4594a0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94535153974656] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94535153977360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae4594a0 con 0x7fa8ac0f8040 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=0 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=1 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=2 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=3 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=4 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=5 2024-09-12T00:19:08.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.557+0000 7fa8be9f79c0 20 add_watcher() i=6 2024-09-12T00:19:08.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94535153977360] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 add_watcher() i=7 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae45c7c0 con 0x55faae448f10 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94535153979744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae459a30 con 0x55faae448f10 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94535153979744] v31'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa7727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 5 note: GC not initialized 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa7717e2640 20 reqs_thread_entry: start 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 Filter name: none 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa6e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:19:08.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae47f980 con 0x55faae448f10 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae480370 con 0x55faae448f10 2024-09-12T00:19:08.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.561+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55faae481380 con 0x7fa8b4013070 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa7727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94535153979744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x55faae448f10 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94535153979744] v31'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94535153954496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x7fa8b4013070 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94535153954496] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8be9f79c0 20 remove_watcher() i=0 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8be9f79c0 2 removed watcher, disabling cache 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.565+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94535153961872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x55faae448f10 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94535153961872] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8be9f79c0 20 remove_watcher() i=1 2024-09-12T00:19:08.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94535153963200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x55faae44d770 2024-09-12T00:19:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8bccfe640 1 -- 172.21.15.66:0/2731554939 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94535153963200] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8b405b040 con 0x55faae44d770 2024-09-12T00:19:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8be9f79c0 20 remove_watcher() i=2 2024-09-12T00:19:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94535153967632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x7fa8b4013070 2024-09-12T00:19:08.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8bc4fd640 1 -- 172.21.15.66:0/2731554939 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94535153967632] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8ac0de050 con 0x7fa8b4013070 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.569+0000 7fa8be9f79c0 20 remove_watcher() i=3 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.573+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94535153969760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x55faae448f10 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.573+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94535153969760] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x55faae448f10 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.573+0000 7fa8be9f79c0 20 remove_watcher() i=4 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.573+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94535153964320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x7fa8ac0f8040 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94535153964320] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8be9f79c0 20 remove_watcher() i=5 2024-09-12T00:19:08.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94535153974656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae455570 con 0x7fa8ac0f8040 2024-09-12T00:19:08.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94535153974656] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8be9f79c0 20 remove_watcher() i=6 2024-09-12T00:19:08.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.577+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94535153977360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55faae47d740 con 0x7fa8ac0f8040 2024-09-12T00:19:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94535153977360] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8a403b040 con 0x7fa8ac0f8040 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 20 remove_watcher() i=7 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa8ac0f8040 msgr2=0x7fa8ac0bc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa8ac0f8040 0x7fa8ac0bc7f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae448f10 msgr2=0x55faae44b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae448f10 0x55faae44b3a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa8b4013070 msgr2=0x7fa8b4051050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa8b4013070 0x7fa8b4051050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae44d770 msgr2=0x55faae44fb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae44d770 0x55faae44fb60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa78c039a70 msgr2=0x7fa78c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa78c039a70 0x7fa78c03bf30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0abe60 tx=0x7fa8ac0e6000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 msgr2=0x55faae43d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8bbcfc640 1 -- 172.21.15.66:0/2731554939 reap_dead start 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa8b402afd0 tx=0x7fa8b4050980 comp rx=0 tx=0).stop 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 shutdown_connections 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/2731554939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae437310 0x55faae43d760 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 >> 172.21.15.66:0/2731554939 conn(0x55faae432710 msgr2=0x55faae430920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 shutdown_connections 2024-09-12T00:19:08.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/2731554939 wait complete. 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 msgr2=0x7fa79403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 0x7fa79403bf80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55faae416940 tx=0x7fa8ac0d0d50 comp rx=0 tx=0).stop 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 msgr2=0x55faae429de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55faae40fd60 tx=0x7fa8b40163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 shutdown_connections 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa794039ac0 0x7fa79403bf80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/3848053045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae4299c0 0x55faae429de0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 >> 172.21.15.66:0/3848053045 conn(0x55faae41f370 msgr2=0x55faae41f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 shutdown_connections 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/3848053045 wait complete. 2024-09-12T00:19:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 msgr2=0x55faae415fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 0x55faae415fc0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 msgr2=0x55faae41ab60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 0x55faae41ab60 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 msgr2=0x7fa7a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 0x7fa7a403bf30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4001e90 tx=0x7fa8a40013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 msgr2=0x55faae40ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac018f70 tx=0x7fa8ac0180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 shutdown_connections 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55faae418770 0x55faae41ab60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55faae31d6b0 0x55faae415fc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa7a4039a70 0x7fa7a403bf30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 --2- 172.21.15.66:0/323364605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55faae31a520 0x55faae40ee50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 >> 172.21.15.66:0/323364605 conn(0x55faae316040 msgr2=0x55faae28fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 shutdown_connections 2024-09-12T00:19:08.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.581+0000 7fa8be9f79c0 1 -- 172.21.15.66:0/323364605 wait complete. 2024-09-12T00:19:08.595 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-12T00:19:08.595 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:19:08.595 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T00:19:08.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T00:19:08.595 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T00:19:08.665 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:08.665 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f926085c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55851000b8c0 0x55851000dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f926085c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55850feb99c0 con 0x558510007770 2024-09-12T00:19:08.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f926085c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55850ff096d0 con 0x55851000b8c0 2024-09-12T00:19:08.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f925db61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55851000b8c0 0x55851000dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f925e362640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x558510007770 0x558510007b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42886/0 (socket says 172.21.15.66:42886) 2024-09-12T00:19:08.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f925e362640 1 -- 172.21.15.66:0/71847598 learned_addr learned my addr 172.21.15.66:0/71847598 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:08.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f925db61640 1 -- 172.21.15.66:0/71847598 >> v1:172.21.15.31:6789/0 conn(0x558510007770 legacy=0x558510007b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.661+0000 7f925db61640 1 -- 172.21.15.66:0/71847598 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850feadca0 con 0x55851000b8c0 2024-09-12T00:19:08.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f925db61640 1 --2- 172.21.15.66:0/71847598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851000b8c0 0x55851000dcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f924800a420 tx=0x7f924801b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe329b67e02afaf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f925d360640 1 -- 172.21.15.66:0/71847598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92480af070 con 0x55851000b8c0 2024-09-12T00:19:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f925d360640 1 -- 172.21.15.66:0/71847598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92480aa530 con 0x55851000b8c0 2024-09-12T00:19:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f925d360640 1 -- 172.21.15.66:0/71847598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92480aa850 con 0x55851000b8c0 2024-09-12T00:19:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 -- 172.21.15.66:0/71847598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851000b8c0 msgr2=0x55851000dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 --2- 172.21.15.66:0/71847598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851000b8c0 0x55851000dcb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f924800a420 tx=0x7f924801b060 comp rx=0 tx=0).stop 2024-09-12T00:19:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 -- 172.21.15.66:0/71847598 shutdown_connections 2024-09-12T00:19:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 --2- 172.21.15.66:0/71847598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851000b8c0 0x55851000dcb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 -- 172.21.15.66:0/71847598 >> 172.21.15.66:0/71847598 conn(0x55850ff7b080 msgr2=0x55850ff7b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 -- 172.21.15.66:0/71847598 shutdown_connections 2024-09-12T00:19:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.665+0000 7f926085c9c0 1 -- 172.21.15.66:0/71847598 wait complete. 2024-09-12T00:19:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.677+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.677+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55850ff0d680 con 0x558510007770 2024-09-12T00:19:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44646/0 (socket says 172.21.15.66:44646) 2024-09-12T00:19:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 -- 172.21.15.66:0/1937239192 learned_addr learned my addr 172.21.15.66:0/1937239192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 -- 172.21.15.66:0/1937239192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850fe88da0 con 0x558510007770 2024-09-12T00:19:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 --2- 172.21.15.66:0/1937239192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9250001e00 tx=0x7f925000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454243b4edce7ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f914c608640 1 -- 172.21.15.66:0/1937239192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9250012020 con 0x558510007770 2024-09-12T00:19:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f914c608640 1 -- 172.21.15.66:0/1937239192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925000e690 con 0x558510007770 2024-09-12T00:19:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f914c608640 1 -- 172.21.15.66:0/1937239192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925000ea10 con 0x558510007770 2024-09-12T00:19:08.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- 172.21.15.66:0/1937239192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 msgr2=0x5585100f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 --2- 172.21.15.66:0/1937239192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9250001e00 tx=0x7f925000b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- 172.21.15.66:0/1937239192 shutdown_connections 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 --2- 172.21.15.66:0/1937239192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100f29b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- 172.21.15.66:0/1937239192 >> 172.21.15.66:0/1937239192 conn(0x55850ff7b080 msgr2=0x5585100ee650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- 172.21.15.66:0/1937239192 shutdown_connections 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- 172.21.15.66:0/1937239192 wait complete. 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f926085c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55850feafa50 con 0x558510007770 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44648/0 (socket says 172.21.15.66:44648) 2024-09-12T00:19:08.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.681+0000 7f925e362640 1 -- 172.21.15.66:0/609783595 learned_addr learned my addr 172.21.15.66:0/609783595 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925e362640 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585100fa5b0 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925e362640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5585100f39a0 tx=0x7f9250000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 -- 172.21.15.66:0/609783595 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9250012030 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585100fa840 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 -- 172.21.15.66:0/609783595 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925001a750 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 -- 172.21.15.66:0/609783595 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925001aa50 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585100fb1f0 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 -- 172.21.15.66:0/609783595 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9250015020 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 0x7f914403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f914ae05640 1 -- 172.21.15.66:0/609783595 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9250020030 con 0x558510007770 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925db61640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 0x7f914403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 0x5585101011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510101700 con 0x55851000b8c0 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925eb63640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 0x5585101011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925db61640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 0x7f914403bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92480ac000 tx=0x7f92480a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925eb63640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 0x5585101011c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925eb63640 1 -- 172.21.15.66:0/609783595 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92580083f0 con 0x55851000b8c0 2024-09-12T00:19:08.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510101b50 con 0x55851000b8c0 2024-09-12T00:19:08.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925eb63640 1 -- 172.21.15.66:0/609783595 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92580083f0 con 0x55851000b8c0 2024-09-12T00:19:08.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 0x558510105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510106420 con 0x558510103960 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.685+0000 7f925e362640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 0x558510105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925e362640 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 0x558510105d50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925e362640 1 -- 172.21.15.66:0/609783595 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9250008030 con 0x558510103960 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510102800 con 0x55851000b8c0 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 -- 172.21.15.66:0/609783595 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92580083f0 con 0x55851000b8c0 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510102ce0 con 0x558510103960 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925e362640 1 -- 172.21.15.66:0/609783595 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9250008030 con 0x558510103960 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55850ff1a450 con 0x558510114b90 2024-09-12T00:19:08.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44658/0 (socket says 172.21.15.66:44658) 2024-09-12T00:19:08.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 -- 172.21.15.66:0/2176722349 learned_addr learned my addr 172.21.15.66:0/2176722349 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 -- 172.21.15.66:0/2176722349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585101155f0 con 0x558510114b90 2024-09-12T00:19:08.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f925eb63640 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5585100fb080 tx=0x7f925800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f9143fff640 1 -- 172.21.15.66:0/2176722349 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f925801c020 con 0x558510114b90 2024-09-12T00:19:08.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558510115e50 con 0x558510114b90 2024-09-12T00:19:08.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f9143fff640 1 -- 172.21.15.66:0/2176722349 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258007d00 con 0x558510114b90 2024-09-12T00:19:08.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f9143fff640 1 -- 172.21.15.66:0/2176722349 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9258018440 con 0x558510114b90 2024-09-12T00:19:08.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.689+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585101163c0 con 0x558510114b90 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9143fff640 1 -- 172.21.15.66:0/2176722349 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f925801f020 con 0x558510114b90 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9143fff640 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 0x7f913803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9143fff640 1 -- 172.21.15.66:0/2176722349 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9258051dd0 con 0x558510114b90 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925e362640 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 0x7f913803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925e362640 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 0x7f913803bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f925004ece0 tx=0x7f925002c950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585100f3200 con 0x558510122440 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44664/0 (socket says 172.21.15.66:44664) 2024-09-12T00:19:08.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925eb63640 1 -- 172.21.15.66:0/4062514993 learned_addr learned my addr 172.21.15.66:0/4062514993 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925eb63640 1 -- 172.21.15.66:0/4062514993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558510122e30 con 0x558510122440 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f925eb63640 1 --2- 172.21.15.66:0/4062514993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9258050150 tx=0x7f9258050320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8a957a1e90079d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9141ffb640 1 -- 172.21.15.66:0/4062514993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9258021400 con 0x558510122440 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9141ffb640 1 -- 172.21.15.66:0/4062514993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258018b50 con 0x558510122440 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f9141ffb640 1 -- 172.21.15.66:0/4062514993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92580215a0 con 0x558510122440 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- 172.21.15.66:0/4062514993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 msgr2=0x558510122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 --2- 172.21.15.66:0/4062514993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9258050150 tx=0x7f9258050320 comp rx=0 tx=0).stop 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- 172.21.15.66:0/4062514993 shutdown_connections 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 --2- 172.21.15.66:0/4062514993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x558510122840 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- 172.21.15.66:0/4062514993 >> 172.21.15.66:0/4062514993 conn(0x55851011d860 msgr2=0x55851011baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- 172.21.15.66:0/4062514993 shutdown_connections 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- 172.21.15.66:0/4062514993 wait complete. 2024-09-12T00:19:08.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 Processor -- start 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- start start 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.693+0000 7f926085c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558510121390 con 0x558510122440 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925eb63640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44674/0 (socket says 172.21.15.66:44674) 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 learned_addr learned my addr 172.21.15.66:0/2401387092 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558510128e50 con 0x558510122440 2024-09-12T00:19:08.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925eb63640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9258050360 tx=0x7f92580500b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 -- 172.21.15.66:0/2401387092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9258038070 con 0x558510122440 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585101290e0 con 0x558510122440 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558510129a90 con 0x558510122440 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 -- 172.21.15.66:0/2401387092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258029c70 con 0x558510122440 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 -- 172.21.15.66:0/2401387092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9258016b10 con 0x558510122440 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 -- 172.21.15.66:0/2401387092 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f925803b070 con 0x558510122440 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9128039a20 0x7f912803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f912ffff640 1 -- 172.21.15.66:0/2401387092 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f9258034c30 con 0x558510122440 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925e362640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9128039a20 0x7f912803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558510133ef0 0x558510136380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510136ad0 con 0x558510133ef0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925db61640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558510133ef0 0x558510136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925e362640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9128039a20 0x7f912803bee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9250018790 tx=0x7f925004c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925db61640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558510133ef0 0x558510136380 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 realm 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510136f00 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585101377d0 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.697+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510137b70 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585101388d0 0x55851013acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013b200 con 0x5585101388d0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585101388d0 0x55851013acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585101388d0 0x55851013acc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 20 searching for the correct realm 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x5585101388d0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f925803d060 0x7f925802d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f925803d060 2024-09-12T00:19:08.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925e362640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f925803d060 0x7f925802d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925e362640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f925803d060 0x7f925802d9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925e362640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9250017050 0x7f92500509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f9250017050 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9250017050 0x7f92500509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9250017050 0x7f92500509f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x558510133ef0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.701+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x558510133ef0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f9250017050 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f9250017050 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f925803d060 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x5585101388d0 2024-09-12T00:19:08.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x558510133ef0 2024-09-12T00:19:08.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f9250017050 2024-09-12T00:19:08.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x558510133ef0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55851013ca60 con 0x7f925803d060 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.705+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f9250017050 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x558510133ef0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x558510133ef0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f9250017050 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f925803d060 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x558510133ef0 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f9250017050 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.709+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f9250017050 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f925803d060 2024-09-12T00:19:08.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x5585101388d0 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f9250017050 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x558510133ef0 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f925005d060 con 0x7f925803d060 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:08.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013bb50 con 0x558510133ef0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013c3f0 con 0x558510133ef0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:08.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013b790 con 0x5585101388d0 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 zone default found 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 4 Realm: () 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 zonegroup default 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013c020 con 0x7f9250017050 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013f2e0 con 0x5585101388d0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.713+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851013f680 con 0x5585101388d0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 20 started sync module instance, tier type = 2024-09-12T00:19:08.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:08.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55851013e720 con 0x7f925803d060 2024-09-12T00:19:08.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94029988749936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55851013fae0 con 0x7f925803d060 2024-09-12T00:19:08.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510140330 con 0x558510133ef0 2024-09-12T00:19:08.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94029988749936] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94029988757120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510140750 con 0x558510133ef0 2024-09-12T00:19:08.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.717+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510140fe0 con 0x5585101388d0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94029988757120] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94029988758176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510140b70 con 0x5585101388d0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585101419f0 con 0x7f925803d060 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94029988762944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510141e10 con 0x7f925803d060 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510142890 con 0x558510133ef0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94029988758176] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.721+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94029988762944] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94029988766592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510141960 con 0x558510133ef0 2024-09-12T00:19:08.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510143130 con 0x7f9250017050 2024-09-12T00:19:08.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94029988766592] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94029988759232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510141960 con 0x7f9250017050 2024-09-12T00:19:08.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.725+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510143620 con 0x7f9250017050 2024-09-12T00:19:08.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.729+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94029988759232] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.729+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.729+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94029988770064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585101435e0 con 0x7f9250017050 2024-09-12T00:19:08.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.729+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510144030 con 0x7f9250017050 2024-09-12T00:19:08.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.729+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94029988770064] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94029988768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510144030 con 0x7f9250017050 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=0 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=1 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=2 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=3 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=4 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=5 2024-09-12T00:19:08.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=6 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94029988768416] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480b2070 con 0x7f9250017050 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 add_watcher() i=7 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558510147430 con 0x558510133ef0 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f92480b2070 con 0x558510133ef0 2024-09-12T00:19:08.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94029988773200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510144980 con 0x558510133ef0 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94029988773200] v31'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f9114fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.733+0000 7f926085c9c0 5 note: GC not initialized 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f908f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 Filter name: none 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f908d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:08.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851016a540 con 0x558510133ef0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851016af30 con 0x558510133ef0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55851016bf40 con 0x7f925803d060 2024-09-12T00:19:08.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f9114fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:08.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94029988773200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x558510133ef0 2024-09-12T00:19:08.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94029988773200] v31'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.737+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94029988749936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x7f925803d060 2024-09-12T00:19:08.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94029988749936] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f926085c9c0 20 remove_watcher() i=0 2024-09-12T00:19:08.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f926085c9c0 2 removed watcher, disabling cache 2024-09-12T00:19:08.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94029988757120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x558510133ef0 2024-09-12T00:19:08.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94029988757120] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f926085c9c0 20 remove_watcher() i=1 2024-09-12T00:19:08.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.741+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94029988758176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x5585101388d0 2024-09-12T00:19:08.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f925eb63640 1 -- 172.21.15.66:0/2401387092 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94029988758176] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f925803a030 con 0x5585101388d0 2024-09-12T00:19:08.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 20 remove_watcher() i=2 2024-09-12T00:19:08.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94029988762944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x7f925803d060 2024-09-12T00:19:08.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f925e362640 1 -- 172.21.15.66:0/2401387092 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94029988762944] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9250008030 con 0x7f925803d060 2024-09-12T00:19:08.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 20 remove_watcher() i=3 2024-09-12T00:19:08.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94029988766592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x558510133ef0 2024-09-12T00:19:08.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94029988766592] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x558510133ef0 2024-09-12T00:19:08.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 20 remove_watcher() i=4 2024-09-12T00:19:08.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.745+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94029988759232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x7f9250017050 2024-09-12T00:19:08.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94029988759232] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x7f9250017050 2024-09-12T00:19:08.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f926085c9c0 20 remove_watcher() i=5 2024-09-12T00:19:08.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94029988770064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x7f9250017050 2024-09-12T00:19:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94029988770064] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x7f9250017050 2024-09-12T00:19:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f926085c9c0 20 remove_watcher() i=6 2024-09-12T00:19:08.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.749+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94029988768416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558510168340 con 0x7f9250017050 2024-09-12T00:19:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94029988768416] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92480d6040 con 0x7f9250017050 2024-09-12T00:19:08.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 20 remove_watcher() i=7 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9250017050 msgr2=0x7f92500509f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9250017050 0x7f92500509f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558510133ef0 msgr2=0x558510136380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558510133ef0 0x558510136380 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f925803d060 msgr2=0x7f925802d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f925803d060 0x7f925802d9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585101388d0 msgr2=0x55851013acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585101388d0 0x55851013acc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9128039a20 msgr2=0x7f912803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9128039a20 0x7f912803bee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9250018790 tx=0x7f925004c000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f925db61640 1 -- 172.21.15.66:0/2401387092 reap_dead start 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 msgr2=0x5585101288f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9258050360 tx=0x7f92580500b0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 shutdown_connections 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2401387092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510122440 0x5585101288f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 >> 172.21.15.66:0/2401387092 conn(0x55851011d860 msgr2=0x55851011ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 shutdown_connections 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2401387092 wait complete. 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 msgr2=0x7f913803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 0x7f913803bf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f925004ece0 tx=0x7f925002c950 comp rx=0 tx=0).stop 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 msgr2=0x558510114fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5585100fb080 tx=0x7f925800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 shutdown_connections 2024-09-12T00:19:08.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9138039a70 0x7f913803bf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/2176722349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510114b90 0x558510114fb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 >> 172.21.15.66:0/2176722349 conn(0x55851010a540 msgr2=0x55851010a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 shutdown_connections 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/2176722349 wait complete. 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 msgr2=0x5585101011c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 0x5585101011c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 msgr2=0x558510105d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 0x558510105d50 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 msgr2=0x7f914403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 0x7f914403bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f92480ac000 tx=0x7f92480a5000 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 msgr2=0x5585100fa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5585100f39a0 tx=0x7f9250000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 shutdown_connections 2024-09-12T00:19:08.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558510103960 0x558510105d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851000b8c0 0x5585101011c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9144039a70 0x7f914403bf30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 --2- 172.21.15.66:0/609783595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558510007770 0x5585100fa050 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 >> 172.21.15.66:0/609783595 conn(0x55850ff7b080 msgr2=0x5585100ed0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 shutdown_connections 2024-09-12T00:19:08.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.753+0000 7f926085c9c0 1 -- 172.21.15.66:0/609783595 wait complete. 2024-09-12T00:19:08.767 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-12T00:19:08.768 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:19:08.925 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:08.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T00:19:08.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T00:19:08.925 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T00:19:08.962 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.957+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.957+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55f06cd9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55bdb37a1880 0x55bdb37a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55f06cd9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bdb36519c0 con 0x55bdb37117b0 2024-09-12T00:19:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55f06cd9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55bdb36a16d0 con 0x55bdb37a1880 2024-09-12T00:19:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ee1d3640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55bdb37117b0 0x55bdb37a0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42890/0 (socket says 172.21.15.66:42890) 2024-09-12T00:19:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ee1d3640 1 -- 172.21.15.66:0/70312366 learned_addr learned my addr 172.21.15.66:0/70312366 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/70312366 >> v2:172.21.15.31:3300/0 conn(0x55bdb37a1880 0x55bdb37a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed9d2640 1 -- 172.21.15.66:0/70312366 >> v1:172.21.15.31:6789/0 conn(0x55bdb37117b0 legacy=0x55bdb37a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed1d1640 1 -- 172.21.15.66:0/70312366 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281156702 0 0) 0x55bdb36519c0 con 0x55bdb37117b0 2024-09-12T00:19:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed9d2640 1 -- 172.21.15.66:0/70312366 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb3645ca0 con 0x55bdb37a1880 2024-09-12T00:19:08.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/70312366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37a1880 0x55bdb37a3c70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f55e000a480 tx=0x7f55e001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac35dbf7573de06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed1d1640 1 -- 172.21.15.66:0/70312366 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e00af070 con 0x55bdb37a1880 2024-09-12T00:19:08.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed1d1640 1 -- 172.21.15.66:0/70312366 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e00aa530 con 0x55bdb37a1880 2024-09-12T00:19:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.961+0000 7f55ed1d1640 1 -- 172.21.15.66:0/70312366 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e00aa830 con 0x55bdb37a1880 2024-09-12T00:19:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/70312366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37a1880 msgr2=0x55bdb37a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/70312366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37a1880 0x55bdb37a3c70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f55e000a480 tx=0x7f55e001b280 comp rx=0 tx=0).stop 2024-09-12T00:19:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/70312366 shutdown_connections 2024-09-12T00:19:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/70312366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37a1880 0x55bdb37a3c70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/70312366 >> 172.21.15.66:0/70312366 conn(0x55bdb3797e90 msgr2=0x55bdb379a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/70312366 shutdown_connections 2024-09-12T00:19:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.965+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/70312366 wait complete. 2024-09-12T00:19:08.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:08.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:08.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55f06cd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:08.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55f06cd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bdb36a5680 con 0x55bdb37117b0 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55ee1d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55ee1d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44682/0 (socket says 172.21.15.66:44682) 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.977+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2598712435 learned_addr learned my addr 172.21.15.66:0/2598712435 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2598712435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb3620da0 con 0x55bdb37117b0 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/2598712435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f55d8006fb0 tx=0x7f55d8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428d3361fe1d4b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f54db616640 1 -- 172.21.15.66:0/2598712435 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8003460 con 0x55bdb37117b0 2024-09-12T00:19:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f54db616640 1 -- 172.21.15.66:0/2598712435 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d8003600 con 0x55bdb37117b0 2024-09-12T00:19:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f54db616640 1 -- 172.21.15.66:0/2598712435 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8003920 con 0x55bdb37117b0 2024-09-12T00:19:08.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2598712435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 msgr2=0x55bdb38887d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:08.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2598712435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f55d8006fb0 tx=0x7f55d8001b10 comp rx=0 tx=0).stop 2024-09-12T00:19:08.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2598712435 shutdown_connections 2024-09-12T00:19:08.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2598712435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb38887d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:08.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2598712435 >> 172.21.15.66:0/2598712435 conn(0x55bdb3797e90 msgr2=0x55bdb3884410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:08.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2598712435 shutdown_connections 2024-09-12T00:19:08.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2598712435 wait complete. 2024-09-12T00:19:08.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:08.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:08.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55f06cd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bdb3647a50 con 0x55bdb37117b0 2024-09-12T00:19:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44690/0 (socket says 172.21.15.66:44690) 2024-09-12T00:19:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2639694852 learned_addr learned my addr 172.21.15.66:0/2639694852 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb379dda0 con 0x55bdb37117b0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.981+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55bdb3889760 tx=0x7f55d8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 -- 172.21.15.66:0/2639694852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8025070 con 0x55bdb37117b0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdb379c180 con 0x55bdb37117b0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdb379c710 con 0x55bdb37117b0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 -- 172.21.15.66:0/2639694852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d8019040 con 0x55bdb37117b0 2024-09-12T00:19:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 -- 172.21.15.66:0/2639694852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55d8013760 con 0x55bdb37117b0 2024-09-12T00:19:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 -- 172.21.15.66:0/2639694852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f55d8028070 con 0x55bdb37117b0 2024-09-12T00:19:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 0x7f54d403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f54d9e13640 1 -- 172.21.15.66:0/2639694852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55d804fcc0 con 0x55bdb37117b0 2024-09-12T00:19:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 0x7f54d403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 0x55bdb3899220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3899760 con 0x55bdb37a1880 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 0x55bdb3899220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 0x7f54d403bf80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55e00ac000 tx=0x7f55e00a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 0x55bdb3899220 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ee9d4640 1 -- 172.21.15.66:0/2639694852 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55e80083f0 con 0x55bdb37a1880 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3899b40 con 0x55bdb37a1880 2024-09-12T00:19:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ee9d4640 1 -- 172.21.15.66:0/2639694852 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55e80083f0 con 0x55bdb37a1880 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 0x55bdb389dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb389e430 con 0x55bdb389b950 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.985+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 0x55bdb389dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 0x55bdb389dd40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2639694852 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55d8027030 con 0x55bdb389b950 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb389a7c0 con 0x55bdb37a1880 2024-09-12T00:19:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 -- 172.21.15.66:0/2639694852 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55e80083f0 con 0x55bdb37a1880 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb389ac70 con 0x55bdb389b950 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee1d3640 1 -- 172.21.15.66:0/2639694852 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55d8027030 con 0x55bdb389b950 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bdb36b2450 con 0x55bdb38acb40 2024-09-12T00:19:09.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44694/0 (socket says 172.21.15.66:44694) 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 -- 172.21.15.66:0/1783210309 learned_addr learned my addr 172.21.15.66:0/1783210309 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 -- 172.21.15.66:0/1783210309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb38ad5a0 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55bdb379c900 tx=0x7f55e800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f54d2ffd640 1 -- 172.21.15.66:0/1783210309 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e801c020 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdb38ade00 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f54d2ffd640 1 -- 172.21.15.66:0/1783210309 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e8007d00 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdb38ae370 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.989+0000 7f54d2ffd640 1 -- 172.21.15.66:0/1783210309 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e8018440 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d2ffd640 1 -- 172.21.15.66:0/1783210309 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f55e801f020 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d2ffd640 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 0x7f54c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d2ffd640 1 -- 172.21.15.66:0/1783210309 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55e8051dd0 con 0x55bdb38acb40 2024-09-12T00:19:09.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 0x7f54c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 0x7f54c403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55d8028520 tx=0x7f55d80283e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bdb3889020 con 0x55bdb38ba510 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44706/0 (socket says 172.21.15.66:44706) 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee9d4640 1 -- 172.21.15.66:0/1834438969 learned_addr learned my addr 172.21.15.66:0/1834438969 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee9d4640 1 -- 172.21.15.66:0/1834438969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb38baf00 con 0x55bdb38ba510 2024-09-12T00:19:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/1834438969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55e8050120 tx=0x7f55e8016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549f807d94dcba2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d0ff9640 1 -- 172.21.15.66:0/1834438969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e8021530 con 0x55bdb38ba510 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d0ff9640 1 -- 172.21.15.66:0/1834438969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e8017a40 con 0x55bdb38ba510 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f54d0ff9640 1 -- 172.21.15.66:0/1834438969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e8017d60 con 0x55bdb38ba510 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1834438969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 msgr2=0x55bdb38ba910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1834438969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55e8050120 tx=0x7f55e8016640 comp rx=0 tx=0).stop 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1834438969 shutdown_connections 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1834438969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38ba910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1834438969 >> 172.21.15.66:0/1834438969 conn(0x55bdb38b5910 msgr2=0x55bdb38b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1834438969 shutdown_connections 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.993+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1834438969 wait complete. 2024-09-12T00:19:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 Processor -- start 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 -- start start 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bdb38b9440 con 0x55bdb38ba510 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee9d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44710/0 (socket says 172.21.15.66:44710) 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 learned_addr learned my addr 172.21.15.66:0/469134979 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdb38c0e70 con 0x55bdb38ba510 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38c0910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f55e8016aa0 tx=0x7f55e80500b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 -- 172.21.15.66:0/469134979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e8038070 con 0x55bdb38ba510 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdb38c1100 con 0x55bdb38ba510 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdb38c1ab0 con 0x55bdb38ba510 2024-09-12T00:19:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 -- 172.21.15.66:0/469134979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e80289c0 con 0x55bdb38ba510 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 -- 172.21.15.66:0/469134979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e8028d20 con 0x55bdb38ba510 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 -- 172.21.15.66:0/469134979 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f55e803b070 con 0x55bdb38ba510 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54b8039a70 0x7f54b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f54c2ffd640 1 -- 172.21.15.66:0/469134979 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f55e802c040 con 0x55bdb38ba510 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54b8039a70 0x7f54b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb38cbf10 0x55bdb38ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38ceaf0 con 0x55bdb38cbf10 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb38cbf10 0x55bdb38ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:08.997+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54b8039a70 0x7f54b803bf30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003c90 tx=0x7f55d802b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb38cbf10 0x55bdb38ce3a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 realm 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38ceec0 con 0x55bdb38cbf10 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38cf790 con 0x55bdb38cbf10 2024-09-12T00:19:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38cfb30 con 0x55bdb38cbf10 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb38d0620 0x55bdb38d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d3170 con 0x55bdb38d0620 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb38d0620 0x55bdb38d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb38d0620 0x55bdb38d2a10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 20 searching for the correct realm 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f55e803d060 0x7f55e80479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f55e803d060 0x7f55e80479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f55e803d060 0x7f55e80479f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee1d3640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f55d802a060 0x7f55d80123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.001+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f55d802a060 0x7f55d80123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f55d802a060 0x7f55d80123c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.005+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.009+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38d0620 2024-09-12T00:19:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55d802a060 2024-09-12T00:19:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x55bdb38cbf10 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4a40 con 0x7f55e803d060 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:09.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d3b30 con 0x55bdb38cbf10 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.013+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d43d0 con 0x55bdb38cbf10 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d3770 con 0x55bdb38d0620 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 zone default found 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 4 Realm: () 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 zonegroup default 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d4000 con 0x7f55d802a060 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d6e40 con 0x55bdb38d0620 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d72b0 con 0x55bdb38d0620 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 started sync module instance, tier type = 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d62b0 con 0x7f55e803d060 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94273249566208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d76f0 con 0x7f55e803d060 2024-09-12T00:19:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.017+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d7f40 con 0x55bdb38cbf10 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94273249566208] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94273249573520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d8360 con 0x55bdb38cbf10 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d8bb0 con 0x55bdb38d0620 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94273249573520] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94273249574848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d89f0 con 0x55bdb38d0620 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.021+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d9510 con 0x7f55e803d060 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94273249578976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d9db0 con 0x7f55e803d060 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38da7d0 con 0x55bdb38cbf10 2024-09-12T00:19:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94273249574848] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94273249578976] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94273249583808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d9900 con 0x55bdb38cbf10 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.025+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38db070 con 0x7f55d802a060 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94273249583808] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94273249576000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38d9900 con 0x7f55d802a060 2024-09-12T00:19:09.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38db520 con 0x7f55d802a060 2024-09-12T00:19:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94273249587248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38db960 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.029+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38dc460 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94273249576000] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94273249587248] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94273249588304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38daa10 con 0x7f55d802a060 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=0 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=1 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=2 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=3 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=4 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=5 2024-09-12T00:19:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=6 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94273249588304] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00b2040 con 0x7f55d802a060 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 20 add_watcher() i=7 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.033+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38df450 con 0x55bdb38cbf10 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55e00b2040 con 0x55bdb38cbf10 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94273249591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb38dc8d0 con 0x55bdb38cbf10 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94273249591120] v31'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f54a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 5 note: GC not initialized 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f54a27e4640 20 reqs_thread_entry: start 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 Filter name: none 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f5413fff640 20 reqs_thread_entry: start 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3902490 con 0x55bdb38cbf10 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3902e80 con 0x55bdb38cbf10 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3903e90 con 0x7f55e803d060 2024-09-12T00:19:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.037+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f54a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94273249591120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x55bdb38cbf10 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94273249591120] v31'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94273249566208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x7f55e803d060 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94273249566208] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55f06cd9c0 20 remove_watcher() i=0 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55f06cd9c0 2 removed watcher, disabling cache 2024-09-12T00:19:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.041+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94273249573520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x55bdb38cbf10 2024-09-12T00:19:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.045+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94273249573520] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.045+0000 7f55f06cd9c0 20 remove_watcher() i=1 2024-09-12T00:19:09.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.045+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94273249574848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x55bdb38d0620 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55ee9d4640 1 -- 172.21.15.66:0/469134979 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94273249574848] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e803a030 con 0x55bdb38d0620 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 20 remove_watcher() i=2 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94273249578976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x7f55e803d060 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55ee1d3640 1 -- 172.21.15.66:0/469134979 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94273249578976] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55d8027030 con 0x7f55e803d060 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 20 remove_watcher() i=3 2024-09-12T00:19:09.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94273249583808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x55bdb38cbf10 2024-09-12T00:19:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94273249583808] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x55bdb38cbf10 2024-09-12T00:19:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 20 remove_watcher() i=4 2024-09-12T00:19:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.049+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94273249576000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x7f55d802a060 2024-09-12T00:19:09.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94273249576000] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x7f55d802a060 2024-09-12T00:19:09.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55f06cd9c0 20 remove_watcher() i=5 2024-09-12T00:19:09.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94273249587248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x7f55d802a060 2024-09-12T00:19:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94273249587248] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x7f55d802a060 2024-09-12T00:19:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55f06cd9c0 20 remove_watcher() i=6 2024-09-12T00:19:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.053+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94273249588304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bdb3900290 con 0x7f55d802a060 2024-09-12T00:19:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94273249588304] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e00d6040 con 0x7f55d802a060 2024-09-12T00:19:09.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 20 remove_watcher() i=7 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f55d802a060 msgr2=0x7f55d80123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f55d802a060 0x7f55d80123c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb38cbf10 msgr2=0x55bdb38ce3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb38cbf10 0x55bdb38ce3a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f55e803d060 msgr2=0x7f55e80479f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f55e803d060 0x7f55e80479f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb38d0620 msgr2=0x55bdb38d2a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb38d0620 0x55bdb38d2a10 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54b8039a70 msgr2=0x7f54b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54b8039a70 0x7f54b803bf30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003c90 tx=0x7f55d802b000 comp rx=0 tx=0).stop 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 msgr2=0x55bdb38c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/469134979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38ba510 0x55bdb38c0910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f55e8016aa0 tx=0x7f55e80500b0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 reap_dead start 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55ed9d2640 1 -- 172.21.15.66:0/469134979 reap_dead start 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 shutdown_connections 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 >> 172.21.15.66:0/469134979 conn(0x55bdb38b5910 msgr2=0x55bdb38b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 shutdown_connections 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/469134979 wait complete. 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 msgr2=0x7f54c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 0x7f54c403bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55d8028520 tx=0x7f55d80283e0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 msgr2=0x55bdb38acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55bdb379c900 tx=0x7f55e800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 shutdown_connections 2024-09-12T00:19:09.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54c4039a70 0x7f54c403bf30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/1783210309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb38acb40 0x55bdb38acf60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 >> 172.21.15.66:0/1783210309 conn(0x55bdb38a24f0 msgr2=0x55bdb38a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 shutdown_connections 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/1783210309 wait complete. 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 msgr2=0x55bdb3899220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 0x55bdb3899220 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 msgr2=0x55bdb389dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 0x55bdb389dd40 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 msgr2=0x7f54d403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 0x7f54d403bf80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f55e00ac000 tx=0x7f55e00a5000 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 msgr2=0x55bdb379d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55bdb3889760 tx=0x7f55d8001260 comp rx=0 tx=0).stop 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 shutdown_connections 2024-09-12T00:19:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55bdb389b950 0x55bdb389dd40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55bdb37a1880 0x55bdb3899220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f54d4039ac0 0x7f54d403bf80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 --2- 172.21.15.66:0/2639694852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bdb37117b0 0x55bdb379d840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 >> 172.21.15.66:0/2639694852 conn(0x55bdb3797e90 msgr2=0x55bdb3882ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 shutdown_connections 2024-09-12T00:19:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.057+0000 7f55f06cd9c0 1 -- 172.21.15.66:0/2639694852 wait complete. 2024-09-12T00:19:09.071 INFO:teuthology.orchestra.run.smithi066.stdout:["myfoo"] 2024-09-12T00:19:09.072 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T00:19:09.119 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T00:19:09.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T00:19:09.119 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T00:19:09.153 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:09.153 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fc23819c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5572c6d7a750 0x5572c6d7ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fc23819c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572c6c2c9c0 con 0x5572c6d7d890 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fc23819c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5572c6c7c6d0 con 0x5572c6d7a750 2024-09-12T00:19:09.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fbfe87640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5572c6d7a750 0x5572c6d7ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fbf686640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5572c6d7d890 0x5572c6d7fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42902/0 (socket says 172.21.15.66:42902) 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fbf686640 1 -- 172.21.15.66:0/3541871841 learned_addr learned my addr 172.21.15.66:0/3541871841 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3541871841 >> v1:172.21.15.31:6789/0 conn(0x5572c6d7d890 legacy=0x5572c6d7fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.149+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3541871841 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6c20ca0 con 0x5572c6d7a750 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/3541871841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6d7ab30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a480 tx=0x7f7fa801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b67a5cf560beee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fbee85640 1 -- 172.21.15.66:0/3541871841 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80b0070 con 0x5572c6d7a750 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fbee85640 1 -- 172.21.15.66:0/3541871841 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80ab540 con 0x5572c6d7a750 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fbee85640 1 -- 172.21.15.66:0/3541871841 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80ab840 con 0x5572c6d7a750 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3541871841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 msgr2=0x5572c6d7ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3541871841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6d7ab30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a480 tx=0x7f7fa801b280 comp rx=0 tx=0).stop 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3541871841 shutdown_connections 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3541871841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6d7ab30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3541871841 >> 172.21.15.66:0/3541871841 conn(0x5572c6cee060 msgr2=0x5572c6cee470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3541871841 shutdown_connections 2024-09-12T00:19:09.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.153+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3541871841 wait complete. 2024-09-12T00:19:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.165+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.165+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.165+0000 7f7fc23819c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.165+0000 7f7fc23819c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5572c6c80680 con 0x5572c6d7a750 2024-09-12T00:19:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44732/0 (socket says 172.21.15.66:44732) 2024-09-12T00:19:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2798349960 learned_addr learned my addr 172.21.15.66:0/2798349960 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2798349960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6bfbda0 con 0x5572c6d7a750 2024-09-12T00:19:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2798349960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ae040 tx=0x7f7fa8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb4cb5f1059c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7eade0b640 1 -- 172.21.15.66:0/2798349960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80b0070 con 0x5572c6d7a750 2024-09-12T00:19:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7eade0b640 1 -- 172.21.15.66:0/2798349960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80b1040 con 0x5572c6d7a750 2024-09-12T00:19:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7eade0b640 1 -- 172.21.15.66:0/2798349960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80ab6f0 con 0x5572c6d7a750 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2798349960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 msgr2=0x5572c6e659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2798349960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ae040 tx=0x7f7fa8003030 comp rx=0 tx=0).stop 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2798349960 shutdown_connections 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2798349960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e659c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2798349960 >> 172.21.15.66:0/2798349960 conn(0x5572c6cee060 msgr2=0x5572c6e61660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2798349960 shutdown_connections 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2798349960 wait complete. 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fc23819c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5572c6c22a50 con 0x5572c6d7a750 2024-09-12T00:19:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44746/0 (socket says 172.21.15.66:44746) 2024-09-12T00:19:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3975037525 learned_addr learned my addr 172.21.15.66:0/3975037525 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.169+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6e6d510 con 0x5572c6d7a750 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ab510 tx=0x7f7fa8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 -- 172.21.15.66:0/3975037525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80b75b0 con 0x5572c6d7a750 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572c6e6d7a0 con 0x5572c6d7a750 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 -- 172.21.15.66:0/3975037525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80b7750 con 0x5572c6d7a750 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 -- 172.21.15.66:0/3975037525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80b7a30 con 0x5572c6d7a750 2024-09-12T00:19:09.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c6e6e150 con 0x5572c6d7a750 2024-09-12T00:19:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 -- 172.21.15.66:0/3975037525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fa80c1470 con 0x5572c6d7a750 2024-09-12T00:19:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 0x7f7ea803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7ea7fff640 1 -- 172.21.15.66:0/3975037525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f7fa80bc070 con 0x5572c6d7a750 2024-09-12T00:19:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbf686640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 0x7f7ea803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 0x5572c6e74120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6e74660 con 0x5572c6d7d890 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc0688640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 0x5572c6e74120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbf686640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 0x7f7ea803bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0001650 tx=0x7f7fb0006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc0688640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 0x5572c6e74120 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc0688640 1 -- 172.21.15.66:0/3975037525 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb80083f0 con 0x5572c6d7d890 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6e74aa0 con 0x5572c6d7d890 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc0688640 1 -- 172.21.15.66:0/3975037525 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fb80083f0 con 0x5572c6d7d890 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 0x5572c6e78ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6e79340 con 0x5572c6e768b0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 0x5572c6e78ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 0x5572c6e78ca0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3975037525 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7fa80097a0 con 0x5572c6e768b0 2024-09-12T00:19:09.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.173+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6e75720 con 0x5572c6d7d890 2024-09-12T00:19:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 -- 172.21.15.66:0/3975037525 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fb80083f0 con 0x5572c6d7d890 2024-09-12T00:19:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6e75c50 con 0x5572c6e768b0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fbfe87640 1 -- 172.21.15.66:0/3975037525 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7fa80097a0 con 0x5572c6e768b0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5572c6c8d450 con 0x5572c6e87ab0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44750/0 (socket says 172.21.15.66:44750) 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 -- 172.21.15.66:0/1653841313 learned_addr learned my addr 172.21.15.66:0/1653841313 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 -- 172.21.15.66:0/1653841313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6e88510 con 0x5572c6e87ab0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc0688640 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5572c6e6dd30 tx=0x7f7fb800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7ea57fa640 1 -- 172.21.15.66:0/1653841313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb801c020 con 0x5572c6e87ab0 2024-09-12T00:19:09.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572c6e88d70 con 0x5572c6e87ab0 2024-09-12T00:19:09.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7ea57fa640 1 -- 172.21.15.66:0/1653841313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8007d00 con 0x5572c6e87ab0 2024-09-12T00:19:09.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c6e892e0 con 0x5572c6e87ab0 2024-09-12T00:19:09.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7ea57fa640 1 -- 172.21.15.66:0/1653841313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8018440 con 0x5572c6e87ab0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.177+0000 7f7ea57fa640 1 -- 172.21.15.66:0/1653841313 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fb801f020 con 0x5572c6e87ab0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7ea57fa640 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7ea57fa640 1 -- 172.21.15.66:0/1653841313 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f7fb8051cf0 con 0x5572c6e87ab0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 0x7f7e9803bf80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009ab0 tx=0x7f7fa80b65f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5572c6e66130 con 0x5572c6e95480 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44764/0 (socket says 172.21.15.66:44764) 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 -- 172.21.15.66:0/742927569 learned_addr learned my addr 172.21.15.66:0/742927569 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 -- 172.21.15.66:0/742927569 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6e95e50 con 0x5572c6e95480 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 --2- 172.21.15.66:0/742927569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8050040 tx=0x7f7fb80163f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e60ee0b81d66b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7e9effd640 1 -- 172.21.15.66:0/742927569 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8021400 con 0x5572c6e95480 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7e9effd640 1 -- 172.21.15.66:0/742927569 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8029350 con 0x5572c6e95480 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7e9effd640 1 -- 172.21.15.66:0/742927569 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80215a0 con 0x5572c6e95480 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- 172.21.15.66:0/742927569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 msgr2=0x5572c6e95880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/742927569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8050040 tx=0x7f7fb80163f0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- 172.21.15.66:0/742927569 shutdown_connections 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/742927569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e95880 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- 172.21.15.66:0/742927569 >> 172.21.15.66:0/742927569 conn(0x5572c6e908a0 msgr2=0x5572c6e8eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- 172.21.15.66:0/742927569 shutdown_connections 2024-09-12T00:19:09.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- 172.21.15.66:0/742927569 wait complete. 2024-09-12T00:19:09.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 Processor -- start 2024-09-12T00:19:09.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- start start 2024-09-12T00:19:09.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc23819c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5572c6e943d0 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44774/0 (socket says 172.21.15.66:44774) 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.181+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 learned_addr learned my addr 172.21.15.66:0/2928719247 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c6e9beb0 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc0688640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8016a50 tx=0x7f7fb804ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 -- 172.21.15.66:0/2928719247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8039070 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572c6e9c140 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 -- 172.21.15.66:0/2928719247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8021530 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c6e9caf0 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 -- 172.21.15.66:0/2928719247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8028af0 con 0x5572c6e95480 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 -- 172.21.15.66:0/2928719247 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fb803c070 con 0x5572c6e95480 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e88039a70 0x7f7e8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7e9d7fa640 1 -- 172.21.15.66:0/2928719247 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f7fb8031070 con 0x5572c6e95480 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e88039a70 0x7f7e8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6ea6df0 0x5572c6ea9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6ea99d0 con 0x5572c6ea6df0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6ea6df0 0x5572c6ea9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e88039a70 0x7f7e8803bf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b67b0 tx=0x7f7fa80d3000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6ea6df0 0x5572c6ea9280 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 realm 2024-09-12T00:19:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6ea61c0 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaa4d0 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaaa00 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6eab800 0x5572c6eadbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.185+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eae1b0 con 0x5572c6eab800 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6eab800 0x5572c6eadbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6eab800 0x5572c6eadbf0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc23819c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc23819c0 20 searching for the correct realm 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7fb8021020 0x7f7fb8049a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7fb8021020 0x7f7fb8049a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7fb8021020 0x7f7fb8049a30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbfe87640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7fa80d4040 0x7f7fa80e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7fa80d4040 0x7f7fa80e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7fa80d4040 0x7f7fa80e81b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.189+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.193+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.197+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6eab800 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fa80d4040 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x5572c6ea6df0 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafa10 con 0x7f7fb8021020 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaeb00 con 0x5572c6ea6df0 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaef80 con 0x5572c6ea6df0 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fb000f070 con 0x5572c6ea6df0 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaf3a0 con 0x5572c6eab800 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 zone default found 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 4 Realm: () 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:09.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 zonegroup default 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fa80d4040 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7fb000f070 con 0x7f7fa80d4040 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb21c0 con 0x5572c6eab800 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb21c0 con 0x5572c6eab800 2024-09-12T00:19:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 started sync module instance, tier type = 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.201+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb1650 con 0x7f7fb8021020 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951451929152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb2620 con 0x7f7fb8021020 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb2e70 con 0x5572c6ea6df0 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951451929152] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951451930208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb2f50 con 0x5572c6ea6df0 2024-09-12T00:19:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.205+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb3a50 con 0x5572c6eab800 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951451930208] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951451936064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb3a10 con 0x5572c6eab800 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fb8021020 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951451938784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4ce0 con 0x7f7fb8021020 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb56e0 con 0x5572c6ea6df0 2024-09-12T00:19:09.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951451936064] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.209+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951451938784] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951451933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4830 con 0x5572c6ea6df0 2024-09-12T00:19:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb5f80 con 0x7f7fa80d4040 2024-09-12T00:19:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951451933120] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951451943408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4830 con 0x7f7fa80d4040 2024-09-12T00:19:09.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.213+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb64b0 con 0x7f7fa80d4040 2024-09-12T00:19:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951451946912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb6470 con 0x7f7fa80d4040 2024-09-12T00:19:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb7400 con 0x7f7fa80d4040 2024-09-12T00:19:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951451943408] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951451946912] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951451950832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb6880 con 0x7f7fa80d4040 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=0 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=1 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=2 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=3 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=4 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=5 2024-09-12T00:19:09.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.217+0000 7f7fc23819c0 20 add_watcher() i=6 2024-09-12T00:19:09.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951451950832] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 20 add_watcher() i=7 2024-09-12T00:19:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eba3f0 con 0x5572c6ea6df0 2024-09-12T00:19:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951451945248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb7870 con 0x5572c6ea6df0 2024-09-12T00:19:09.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951451945248] v31'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7e75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:09.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:09.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 5 note: GC not initialized 2024-09-12T00:19:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7e74fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 20 Filter name: none 2024-09-12T00:19:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7dee7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6edcff0 con 0x5572c6eab800 2024-09-12T00:19:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaf3a0 con 0x5572c6eab800 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaf3a0 con 0x5572c6ea6df0 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x5572c6ea6df0 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.221+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fb8021020 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fb8021020 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(75 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.225+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fb8021020 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fb8021020 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fa80d4040 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x5572c6eab800 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.229+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x7f7fb8021020 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x7f7fa80d4040 2024-09-12T00:19:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x5572c6ea6df0 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x5572c6eab800 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f7fb004b040 con 0x7f7fb8021020 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc23819c0 20 RGWRados::pool_iterate: got myfoo 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7e75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951451945248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eaf3a0 con 0x5572c6ea6df0 2024-09-12T00:19:09.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93951451945248] v31'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.233+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951451929152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x7f7fb8021020 2024-09-12T00:19:09.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93951451929152] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc23819c0 20 remove_watcher() i=0 2024-09-12T00:19:09.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc23819c0 2 removed watcher, disabling cache 2024-09-12T00:19:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951451930208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6ea6df0 2024-09-12T00:19:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93951451930208] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc23819c0 20 remove_watcher() i=1 2024-09-12T00:19:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951451936064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eb4490 con 0x5572c6eab800 2024-09-12T00:19:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.237+0000 7f7fc0688640 1 -- 172.21.15.66:0/2928719247 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93951451936064] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb803b030 con 0x5572c6eab800 2024-09-12T00:19:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 20 remove_watcher() i=2 2024-09-12T00:19:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951451938784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fb8021020 2024-09-12T00:19:09.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fbfe87640 1 -- 172.21.15.66:0/2928719247 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93951451938784] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa80f2040 con 0x7f7fb8021020 2024-09-12T00:19:09.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 20 remove_watcher() i=3 2024-09-12T00:19:09.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951451933120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x5572c6ea6df0 2024-09-12T00:19:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93951451933120] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x5572c6ea6df0 2024-09-12T00:19:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 20 remove_watcher() i=4 2024-09-12T00:19:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.241+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951451943408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fa80d4040 2024-09-12T00:19:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93951451943408] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fc23819c0 20 remove_watcher() i=5 2024-09-12T00:19:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951451946912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fa80d4040 2024-09-12T00:19:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93951451946912] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fc23819c0 20 remove_watcher() i=6 2024-09-12T00:19:09.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.245+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951451950832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5572c6eafee0 con 0x7f7fa80d4040 2024-09-12T00:19:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93951451950832] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb003c040 con 0x7f7fa80d4040 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 20 remove_watcher() i=7 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7fa80d4040 msgr2=0x7f7fa80e81b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7fa80d4040 0x7f7fa80e81b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6ea6df0 msgr2=0x5572c6ea9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6ea6df0 0x5572c6ea9280 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7fb8021020 msgr2=0x7f7fb8049a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7fb8021020 0x7f7fb8049a30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6eab800 msgr2=0x5572c6eadbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6eab800 0x5572c6eadbf0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e88039a70 msgr2=0x7f7e8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e88039a70 0x7f7e8803bf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b67b0 tx=0x7f7fa80d3000 comp rx=0 tx=0).stop 2024-09-12T00:19:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 msgr2=0x5572c6e9b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fbf686640 1 -- 172.21.15.66:0/2928719247 reap_dead start 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8016a50 tx=0x7f7fb804ffd0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 shutdown_connections 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/2928719247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e95480 0x5572c6e9b950 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 >> 172.21.15.66:0/2928719247 conn(0x5572c6e908a0 msgr2=0x5572c6e8eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 shutdown_connections 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/2928719247 wait complete. 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 msgr2=0x7f7e9803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 0x7f7e9803bf80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009ab0 tx=0x7f7fa80b65f0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 msgr2=0x5572c6e87ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5572c6e6dd30 tx=0x7f7fb800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 shutdown_connections 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/1653841313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6e87ab0 0x5572c6e87ed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 >> 172.21.15.66:0/1653841313 conn(0x5572c6e7d460 msgr2=0x5572c6e7d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 shutdown_connections 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/1653841313 wait complete. 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 msgr2=0x5572c6e74120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 0x5572c6e74120 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 msgr2=0x5572c6e78ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 0x5572c6e78ca0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 msgr2=0x7f7ea803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 0x7f7ea803bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0001650 tx=0x7f7fb0006720 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 msgr2=0x5572c6e6cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ab510 tx=0x7f7fa8018020 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 shutdown_connections 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5572c6e768b0 0x5572c6e78ca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5572c6d7d890 0x5572c6e74120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ea8039a70 0x7f7ea803bf30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 --2- 172.21.15.66:0/3975037525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5572c6d7a750 0x5572c6e6cfb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 >> 172.21.15.66:0/3975037525 conn(0x5572c6cee060 msgr2=0x5572c6e600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 shutdown_connections 2024-09-12T00:19:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.249+0000 7f7fc23819c0 1 -- 172.21.15.66:0/3975037525 wait complete. 2024-09-12T00:19:09.263 INFO:teuthology.orchestra.run.smithi066.stdout:["myfoo"] 2024-09-12T00:19:09.263 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T00:19:09.275 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.290 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.307 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.349 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-12T00:19:09.406 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.466 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.533 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:09.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:09.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:09.533 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T00:19:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:09.573 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f7498f9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55de3678c770 0x55de3678cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f7498f9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de3663e9c0 con 0x55de3678f8b0 2024-09-12T00:19:09.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f7498f9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55de3668e6d0 con 0x55de3678c770 2024-09-12T00:19:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f72495640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55de3678c770 0x55de3678cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f71c94640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55de3678f8b0 0x55de36791ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42916/0 (socket says 172.21.15.66:42916) 2024-09-12T00:19:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f71c94640 1 -- 172.21.15.66:0/1030371114 learned_addr learned my addr 172.21.15.66:0/1030371114 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f72495640 1 -- 172.21.15.66:0/1030371114 >> v1:172.21.15.31:6789/0 conn(0x55de3678f8b0 legacy=0x55de36791ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.569+0000 7f6f72495640 1 -- 172.21.15.66:0/1030371114 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de36632ca0 con 0x55de3678c770 2024-09-12T00:19:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f72495640 1 --2- 172.21.15.66:0/1030371114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3678cb50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400a480 tx=0x7f6f6401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb889166f7ed73a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f71493640 1 -- 172.21.15.66:0/1030371114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640b0070 con 0x55de3678c770 2024-09-12T00:19:09.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f71493640 1 -- 172.21.15.66:0/1030371114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640ab540 con 0x55de3678c770 2024-09-12T00:19:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f71493640 1 -- 172.21.15.66:0/1030371114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640ab840 con 0x55de3678c770 2024-09-12T00:19:09.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1030371114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 msgr2=0x55de3678cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1030371114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3678cb50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400a480 tx=0x7f6f6401b280 comp rx=0 tx=0).stop 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1030371114 shutdown_connections 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1030371114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3678cb50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1030371114 >> 172.21.15.66:0/1030371114 conn(0x55de36700080 msgr2=0x55de36700490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1030371114 shutdown_connections 2024-09-12T00:19:09.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.573+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1030371114 wait complete. 2024-09-12T00:19:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f7498f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f7498f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55de36692680 con 0x55de3678c770 2024-09-12T00:19:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f72495640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f72495640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44790/0 (socket says 172.21.15.66:44790) 2024-09-12T00:19:09.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f72495640 1 -- 172.21.15.66:0/2186937411 learned_addr learned my addr 172.21.15.66:0/2186937411 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.589+0000 7f6f72495640 1 -- 172.21.15.66:0/2186937411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3660dda0 con 0x55de3678c770 2024-09-12T00:19:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 --2- 172.21.15.66:0/2186937411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6f64018eb0 tx=0x7f6f64003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea6eeb6086927d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e60608640 1 -- 172.21.15.66:0/2186937411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640b0070 con 0x55de3678c770 2024-09-12T00:19:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e60608640 1 -- 172.21.15.66:0/2186937411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640b1040 con 0x55de3678c770 2024-09-12T00:19:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e60608640 1 -- 172.21.15.66:0/2186937411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640ab6f0 con 0x55de3678c770 2024-09-12T00:19:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/2186937411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 msgr2=0x55de36877a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/2186937411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6f64018eb0 tx=0x7f6f64003030 comp rx=0 tx=0).stop 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/2186937411 shutdown_connections 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/2186937411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de36877a20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/2186937411 >> 172.21.15.66:0/2186937411 conn(0x55de36700080 msgr2=0x55de368736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/2186937411 shutdown_connections 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/2186937411 wait complete. 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55de36634a50 con 0x55de3678c770 2024-09-12T00:19:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44794/0 (socket says 172.21.15.66:44794) 2024-09-12T00:19:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 -- 172.21.15.66:0/1176426247 learned_addr learned my addr 172.21.15.66:0/1176426247 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3687f470 con 0x55de3678c770 2024-09-12T00:19:09.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f72495640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f640ab510 tx=0x7f6f64018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e5ee05640 1 -- 172.21.15.66:0/1176426247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640c4070 con 0x55de3678c770 2024-09-12T00:19:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de3687f700 con 0x55de3678c770 2024-09-12T00:19:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e5ee05640 1 -- 172.21.15.66:0/1176426247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f640b75b0 con 0x55de3678c770 2024-09-12T00:19:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6e5ee05640 1 -- 172.21.15.66:0/1176426247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f640ce060 con 0x55de3678c770 2024-09-12T00:19:09.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.593+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de368800b0 con 0x55de3678c770 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6e5ee05640 1 -- 172.21.15.66:0/1176426247 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6f640c7070 con 0x55de3678c770 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6e5ee05640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 0x7f6e5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6e5ee05640 1 -- 172.21.15.66:0/1176426247 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6f640bc070 con 0x55de3678c770 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f71c94640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 0x7f6e5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 0x55de36886080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368865c0 con 0x55de3678f8b0 2024-09-12T00:19:09.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72c96640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 0x55de36886080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f71c94640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 0x7f6e5803bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6f68001650 tx=0x7f6f68006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72c96640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 0x55de36886080 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72c96640 1 -- 172.21.15.66:0/1176426247 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f6c0083f0 con 0x55de3678f8b0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368869e0 con 0x55de3678f8b0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72c96640 1 -- 172.21.15.66:0/1176426247 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f6c0083f0 con 0x55de3678f8b0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 0x55de3688abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de3688b2d0 con 0x55de368887f0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72495640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 0x55de3688abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72495640 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 0x55de3688abe0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f72495640 1 -- 172.21.15.66:0/1176426247 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f640c6030 con 0x55de368887f0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.597+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de36887690 con 0x55de3678f8b0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 -- 172.21.15.66:0/1176426247 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f6c0083f0 con 0x55de3678f8b0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de36887b70 con 0x55de368887f0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72495640 1 -- 172.21.15.66:0/1176426247 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f640c6030 con 0x55de368887f0 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55de3669f450 con 0x55de368999c0 2024-09-12T00:19:09.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44796/0 (socket says 172.21.15.66:44796) 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 -- 172.21.15.66:0/1342396609 learned_addr learned my addr 172.21.15.66:0/1342396609 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 -- 172.21.15.66:0/1342396609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de3689a420 con 0x55de368999c0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f72c96640 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55de3687ff40 tx=0x7f6f6c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6e57fff640 1 -- 172.21.15.66:0/1342396609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c01c020 con 0x55de368999c0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de3689ac80 con 0x55de368999c0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6e57fff640 1 -- 172.21.15.66:0/1342396609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c007d00 con 0x55de368999c0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6e57fff640 1 -- 172.21.15.66:0/1342396609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c018440 con 0x55de368999c0 2024-09-12T00:19:09.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.601+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de3689b1f0 con 0x55de368999c0 2024-09-12T00:19:09.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e57fff640 1 -- 172.21.15.66:0/1342396609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6f6c01f020 con 0x55de368999c0 2024-09-12T00:19:09.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e57fff640 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 0x7f6e4c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e57fff640 1 -- 172.21.15.66:0/1342396609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6f6c051d80 con 0x55de368999c0 2024-09-12T00:19:09.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72495640 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 0x7f6e4c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72495640 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 0x7f6e4c03bf80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f6401b2c0 tx=0x7f6f640a4fd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55de36878190 con 0x55de368a72f0 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44804/0 (socket says 172.21.15.66:44804) 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72c96640 1 -- 172.21.15.66:0/1485608737 learned_addr learned my addr 172.21.15.66:0/1485608737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72c96640 1 -- 172.21.15.66:0/1485608737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de368a7cc0 con 0x55de368a72f0 2024-09-12T00:19:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f72c96640 1 --2- 172.21.15.66:0/1485608737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0500d0 tx=0x7f6f6c0214c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caa04e229a66490 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e55ffb640 1 -- 172.21.15.66:0/1485608737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c020e00 con 0x55de368a72f0 2024-09-12T00:19:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e55ffb640 1 -- 172.21.15.66:0/1485608737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c016330 con 0x55de368a72f0 2024-09-12T00:19:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6e55ffb640 1 -- 172.21.15.66:0/1485608737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c016650 con 0x55de368a72f0 2024-09-12T00:19:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1485608737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 msgr2=0x55de368a76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1485608737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0500d0 tx=0x7f6f6c0214c0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1485608737 shutdown_connections 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1485608737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368a76d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1485608737 >> 172.21.15.66:0/1485608737 conn(0x55de368a2710 msgr2=0x55de368a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1485608737 shutdown_connections 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1485608737 wait complete. 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 Processor -- start 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.605+0000 7f6f7498f9c0 1 -- start start 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55de368a6240 con 0x55de368a72f0 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44810/0 (socket says 172.21.15.66:44810) 2024-09-12T00:19:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 learned_addr learned my addr 172.21.15.66:0/771375046 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de368add20 con 0x55de368a72f0 2024-09-12T00:19:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72c96640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c018e60 tx=0x7f6f6c050060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 -- 172.21.15.66:0/771375046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c029b90 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de368adfb0 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 -- 172.21.15.66:0/771375046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c029d30 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 -- 172.21.15.66:0/771375046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f6c0294a0 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de368ae960 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 -- 172.21.15.66:0/771375046 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6f6c045030 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e3c039a70 0x7f6e3c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6e43fff640 1 -- 172.21.15.66:0/771375046 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6f6c032070 con 0x55de368a72f0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72495640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e3c039a70 0x7f6e3c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de368b8cf0 0x55de368bb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368bb8d0 con 0x55de368b8cf0 2024-09-12T00:19:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f71c94640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de368b8cf0 0x55de368bb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.609+0000 7f6f72495640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e3c039a70 0x7f6e3c03bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f640aa550 tx=0x7f6f640c05e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f71c94640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de368b8cf0 0x55de368bb180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 realm 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368b8100 con 0x55de368b8cf0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368bc3d0 con 0x55de368b8cf0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368bc900 con 0x55de368b8cf0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368bd700 0x55de368bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c00b0 con 0x55de368bd700 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368bd700 0x55de368bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368bd700 0x55de368bfaf0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 20 searching for the correct realm 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6f6c021020 0x7f6f6c046a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72495640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6f6c021020 0x7f6f6c046a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72495640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6f6c021020 0x7f6f6c046a80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72495640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6f640f8040 0x7f6f640bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.613+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6f640f8040 0x7f6f640bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6f640f8040 0x7f6f640bf5e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.617+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.621+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368bd700 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.625+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f640f8040 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x55de368b8cf0 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de368c1910 con 0x7f6f6c021020 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:09.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c0a00 con 0x55de368b8cf0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c12a0 con 0x55de368b8cf0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f6800f070 con 0x55de368b8cf0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c0640 con 0x55de368bd700 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 zone default found 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 4 Realm: () 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 zonegroup default 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c0ed0 con 0x7f6f640f8040 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f6800f070 con 0x7f6f640f8040 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c4180 con 0x55de368bd700 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.629+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c4520 con 0x55de368bd700 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 20 started sync module instance, tier type = 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c35c0 con 0x7f6f6c021020 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412886257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c4980 con 0x7f6f6c021020 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c51d0 con 0x55de368b8cf0 2024-09-12T00:19:09.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412886257936] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.633+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412886265120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c55f0 con 0x55de368b8cf0 2024-09-12T00:19:09.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c5e40 con 0x55de368bd700 2024-09-12T00:19:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412886267648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c61f0 con 0x55de368bd700 2024-09-12T00:19:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c6d10 con 0x7f6f6c021020 2024-09-12T00:19:09.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412886265120] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412886271968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c7100 con 0x7f6f6c021020 2024-09-12T00:19:09.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.637+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c7ac0 con 0x55de368b8cf0 2024-09-12T00:19:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412886267648] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412886271968] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412886268992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c5250 con 0x55de368b8cf0 2024-09-12T00:19:09.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c7ac0 con 0x7f6f640f8040 2024-09-12T00:19:09.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412886268992] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412886278272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c7ac0 con 0x7f6f640f8040 2024-09-12T00:19:09.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.641+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c8b20 con 0x7f6f640f8040 2024-09-12T00:19:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412886279616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c8ae0 con 0x7f6f640f8040 2024-09-12T00:19:09.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c9a50 con 0x7f6f640f8040 2024-09-12T00:19:09.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412886278272] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412886279616] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412886283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368c8cc0 con 0x7f6f640f8040 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=0 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=1 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=2 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=3 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=4 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=5 2024-09-12T00:19:09.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.645+0000 7f6f7498f9c0 20 add_watcher() i=6 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412886283616] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f7498f9c0 20 add_watcher() i=7 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f7498f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368c7610 con 0x55de368b8cf0 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.649+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412886275600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ca100 con 0x55de368b8cf0 2024-09-12T00:19:09.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412886275600] v31'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 5 note: GC not initialized 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6da37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 Filter name: none 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6da17fa640 20 reqs_thread_entry: start 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f0040 con 0x7f6f6c021020 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f08d0 con 0x55de368bd700 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(63 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:09.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f0a90 con 0x7f6f6c021020 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6f640d8050 con 0x7f6f6c021020 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368ef2f0 con 0x55de368bd700 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(65 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 4.30 4:0d6f2ca4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f3410 con 0x55de368bd700 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 4.1 4:831b4391:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f5dc0 con 0x7f6f6c021020 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 4.a 4:52dbcbb5:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f87c0 con 0x7f6f6c021020 2024-09-12T00:19:09.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 4.35 4:afe87baa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368fb2c0 con 0x55de368b8cf0 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 4.32 4:4c178f1d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368fe030 con 0x55de368b8cf0 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 4.33 4:cd533e59:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f87c0 con 0x7f6f640f8040 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(66 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(69 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368fa7e0 con 0x55de368bd700 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.653+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 4.12 4:4aa7517e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f13f0 con 0x55de368b8cf0 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(68 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:74 4.3b 4:dea3e5aa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f13f0 con 0x55de368bd700 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 4.a 4:5196933a:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f2d40 con 0x7f6f6c021020 2024-09-12T00:19:09.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 4.3f 4:fcc2f598:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de368f13f0 con 0x7f6f6c021020 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(72 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(73 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(74 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(75 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(76 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412886275600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368eeb50 con 0x55de368b8cf0 2024-09-12T00:19:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94412886275600] v31'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.657+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412886257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x7f6f6c021020 2024-09-12T00:19:09.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94412886257936] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f7498f9c0 20 remove_watcher() i=0 2024-09-12T00:19:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f7498f9c0 2 removed watcher, disabling cache 2024-09-12T00:19:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412886265120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x55de368b8cf0 2024-09-12T00:19:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94412886265120] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f7498f9c0 20 remove_watcher() i=1 2024-09-12T00:19:09.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.661+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412886267648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x55de368bd700 2024-09-12T00:19:09.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f72c96640 1 -- 172.21.15.66:0/771375046 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94412886267648] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6c03c020 con 0x55de368bd700 2024-09-12T00:19:09.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f7498f9c0 20 remove_watcher() i=2 2024-09-12T00:19:09.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412886271968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x7f6f6c021020 2024-09-12T00:19:09.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f72495640 1 -- 172.21.15.66:0/771375046 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94412886271968] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f64109040 con 0x7f6f6c021020 2024-09-12T00:19:09.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f7498f9c0 20 remove_watcher() i=3 2024-09-12T00:19:09.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.665+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412886268992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x55de368b8cf0 2024-09-12T00:19:09.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94412886268992] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x55de368b8cf0 2024-09-12T00:19:09.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f7498f9c0 20 remove_watcher() i=4 2024-09-12T00:19:09.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412886278272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x7f6f640f8040 2024-09-12T00:19:09.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94412886278272] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f7498f9c0 20 remove_watcher() i=5 2024-09-12T00:19:09.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.669+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412886279616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x7f6f640f8040 2024-09-12T00:19:09.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94412886279616] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 20 remove_watcher() i=6 2024-09-12T00:19:09.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412886283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de368ed8e0 con 0x7f6f640f8040 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94412886283616] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f6803c040 con 0x7f6f640f8040 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 20 remove_watcher() i=7 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6f640f8040 msgr2=0x7f6f640bf5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6f640f8040 0x7f6f640bf5e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de368b8cf0 msgr2=0x55de368bb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de368b8cf0 0x55de368bb180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6f6c021020 msgr2=0x7f6f6c046a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6f6c021020 0x7f6f6c046a80 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368bd700 msgr2=0x55de368bfaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368bd700 0x55de368bfaf0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e3c039a70 msgr2=0x7f6e3c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e3c039a70 0x7f6e3c03bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f640aa550 tx=0x7f6f640c05e0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 msgr2=0x55de368ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f71c94640 1 -- 172.21.15.66:0/771375046 reap_dead start 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c018e60 tx=0x7f6f6c050060 comp rx=0 tx=0).stop 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 shutdown_connections 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/771375046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368a72f0 0x55de368ad7c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 >> 172.21.15.66:0/771375046 conn(0x55de368a2710 msgr2=0x55de368a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 shutdown_connections 2024-09-12T00:19:09.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.673+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/771375046 wait complete. 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 msgr2=0x7f6e4c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 0x7f6e4c03bf80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f6401b2c0 tx=0x7f6f640a4fd0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 msgr2=0x55de36899de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55de3687ff40 tx=0x7f6f6c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 shutdown_connections 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e4c039ac0 0x7f6e4c03bf80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1342396609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de368999c0 0x55de36899de0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 >> 172.21.15.66:0/1342396609 conn(0x55de3688f370 msgr2=0x55de3688f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 shutdown_connections 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1342396609 wait complete. 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 msgr2=0x55de36886080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 0x55de36886080 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 msgr2=0x55de3688abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 0x55de3688abe0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 msgr2=0x7f6e5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 0x7f6e5803bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6f68001650 tx=0x7f6f68006720 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 msgr2=0x55de3687ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f640ab510 tx=0x7f6f64018020 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 shutdown_connections 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55de368887f0 0x55de3688abe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55de3678f8b0 0x55de36886080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6e58039a70 0x7f6e5803bf30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 --2- 172.21.15.66:0/1176426247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55de3678c770 0x55de3687ef10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 >> 172.21.15.66:0/1176426247 conn(0x55de36700080 msgr2=0x55de36872150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 shutdown_connections 2024-09-12T00:19:09.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.677+0000 7f6f7498f9c0 1 -- 172.21.15.66:0/1176426247 wait complete. 2024-09-12T00:19:09.692 INFO:teuthology.orchestra.run.smithi066.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0f94cb3c-a22e-48d3-91ff-0e4df7c90757","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T00:19:08.911652Z","creation_time":"2024-09-12T00:19:08.903952Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T00:19:09.692 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:19:08.911652Z', 'creation_time': '2024-09-12T00:19:08.903952Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T00:19:09.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T00:19:09.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T00:19:09.693 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T00:19:09.768 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:09.768 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:09.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe3b4f9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55eed8231770 0x55eed82c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe3b4f9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eed81719c0 con 0x55eed8231b50 2024-09-12T00:19:09.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe3b4f9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55eed81c16d0 con 0x55eed8231770 2024-09-12T00:19:09.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe1655640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55eed8231770 0x55eed82c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe1655640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55eed8231770 0x55eed82c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44818/0 (socket says 172.21.15.66:44818) 2024-09-12T00:19:09.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe1655640 1 -- 172.21.15.66:0/3670541169 learned_addr learned my addr 172.21.15.66:0/3670541169 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe1655640 1 -- 172.21.15.66:0/3670541169 >> v1:172.21.15.31:6789/0 conn(0x55eed8231b50 legacy=0x55eed82c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.765+0000 7febe1655640 1 -- 172.21.15.66:0/3670541169 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed8165ca0 con 0x55eed8231770 2024-09-12T00:19:09.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe1655640 1 --2- 172.21.15.66:0/3670541169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed82c25a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febd400a5c0 tx=0x7febd401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b91ce0e34b39f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febd3fff640 1 -- 172.21.15.66:0/3670541169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40a6070 con 0x55eed8231770 2024-09-12T00:19:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febd3fff640 1 -- 172.21.15.66:0/3670541169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd40af070 con 0x55eed8231770 2024-09-12T00:19:09.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febd3fff640 1 -- 172.21.15.66:0/3670541169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40aa5c0 con 0x55eed8231770 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3670541169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 msgr2=0x55eed82c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3670541169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed82c25a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febd400a5c0 tx=0x7febd401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3670541169 shutdown_connections 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3670541169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed82c25a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3670541169 >> 172.21.15.66:0/3670541169 conn(0x55eed82b7e90 msgr2=0x55eed82ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3670541169 shutdown_connections 2024-09-12T00:19:09.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.769+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3670541169 wait complete. 2024-09-12T00:19:09.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe3b4f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe3b4f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eed81c5680 con 0x55eed8231770 2024-09-12T00:19:09.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe1655640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe1655640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44830/0 (socket says 172.21.15.66:44830) 2024-09-12T00:19:09.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe1655640 1 -- 172.21.15.66:0/640592400 learned_addr learned my addr 172.21.15.66:0/640592400 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe1655640 1 -- 172.21.15.66:0/640592400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed8140da0 con 0x55eed8231770 2024-09-12T00:19:09.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7febe1655640 1 --2- 172.21.15.66:0/640592400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7febd4018f70 tx=0x7febd4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2babefd09b6bb3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7feacf606640 1 -- 172.21.15.66:0/640592400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40aa9e0 con 0x55eed8231770 2024-09-12T00:19:09.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7feacf606640 1 -- 172.21.15.66:0/640592400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd40aab80 con 0x55eed8231770 2024-09-12T00:19:09.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.785+0000 7feacf606640 1 -- 172.21.15.66:0/640592400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40aae60 con 0x55eed8231770 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/640592400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 msgr2=0x55eed83aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/640592400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7febd4018f70 tx=0x7febd4003030 comp rx=0 tx=0).stop 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/640592400 shutdown_connections 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/640592400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83aa9e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/640592400 >> 172.21.15.66:0/640592400 conn(0x55eed82b7e90 msgr2=0x55eed83a6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/640592400 shutdown_connections 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/640592400 wait complete. 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eed8167a50 con 0x55eed8231770 2024-09-12T00:19:09.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe1655640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe1655640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44846/0 (socket says 172.21.15.66:44846) 2024-09-12T00:19:09.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe1655640 1 -- 172.21.15.66:0/995594415 learned_addr learned my addr 172.21.15.66:0/995594415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe1655640 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed83b2480 con 0x55eed8231770 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe1655640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7febd4000c10 tx=0x7febd40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7feacde03640 1 -- 172.21.15.66:0/995594415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40c6750 con 0x55eed8231770 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eed83b2710 con 0x55eed8231770 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7feacde03640 1 -- 172.21.15.66:0/995594415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd40c68f0 con 0x55eed8231770 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eed83b30c0 con 0x55eed8231770 2024-09-12T00:19:09.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7feacde03640 1 -- 172.21.15.66:0/995594415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febd40c6bf0 con 0x55eed8231770 2024-09-12T00:19:09.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.789+0000 7feacde03640 1 -- 172.21.15.66:0/995594415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7febd40ce030 con 0x55eed8231770 2024-09-12T00:19:09.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7feacde03640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 0x7feac803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7feacde03640 1 -- 172.21.15.66:0/995594415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7febd40cc020 con 0x55eed8231770 2024-09-12T00:19:09.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe0e54640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 0x7feac803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 0x55eed83b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83b95d0 con 0x55eed8231b50 2024-09-12T00:19:09.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1e56640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 0x55eed83b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe0e54640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 0x7feac803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febd8001e60 tx=0x7febd80013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1e56640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 0x55eed83b9090 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1e56640 1 -- 172.21.15.66:0/995594415 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7febdc00a4d0 con 0x55eed8231b50 2024-09-12T00:19:09.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83b34e0 con 0x55eed8231b50 2024-09-12T00:19:09.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1e56640 1 -- 172.21.15.66:0/995594415 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7febdc00a4d0 con 0x55eed8231b50 2024-09-12T00:19:09.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 0x55eed83bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83be350 con 0x55eed83bb870 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1655640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 0x55eed83bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1655640 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 0x55eed83bdc60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1655640 1 -- 172.21.15.66:0/995594415 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7febd40c53e0 con 0x55eed83bb870 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83ba710 con 0x55eed8231b50 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1e56640 1 -- 172.21.15.66:0/995594415 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7febdc00a4d0 con 0x55eed8231b50 2024-09-12T00:19:09.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83babf0 con 0x55eed83bb870 2024-09-12T00:19:09.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe1655640 1 -- 172.21.15.66:0/995594415 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7febd40c53e0 con 0x55eed83bb870 2024-09-12T00:19:09.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.793+0000 7febe3b4f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eed81d2450 con 0x55eed83ccac0 2024-09-12T00:19:09.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44856/0 (socket says 172.21.15.66:44856) 2024-09-12T00:19:09.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1e56640 1 -- 172.21.15.66:0/2979785581 learned_addr learned my addr 172.21.15.66:0/2979785581 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1e56640 1 -- 172.21.15.66:0/2979785581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed83cd520 con 0x55eed83ccac0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1e56640 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55eed83b2f50 tx=0x7febdc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 -- 172.21.15.66:0/2979785581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc013450 con 0x55eed83ccac0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 -- 172.21.15.66:0/2979785581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc0135f0 con 0x55eed83ccac0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 -- 172.21.15.66:0/2979785581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc013910 con 0x55eed83ccac0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eed83cdd80 con 0x55eed83ccac0 2024-09-12T00:19:09.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eed83ce2f0 con 0x55eed83ccac0 2024-09-12T00:19:09.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 -- 172.21.15.66:0/2979785581 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7febdc011040 con 0x55eed83ccac0 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 0x7feab803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7feac6ffd640 1 -- 172.21.15.66:0/2979785581 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7febdc00e040 con 0x55eed83ccac0 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.797+0000 7febe1655640 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 0x7feab803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1655640 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 0x7feab803bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55eed83b9a10 tx=0x7febd40d0cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eed83ab170 con 0x55eed83da410 2024-09-12T00:19:09.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44866/0 (socket says 172.21.15.66:44866) 2024-09-12T00:19:09.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 -- 172.21.15.66:0/3729756726 learned_addr learned my addr 172.21.15.66:0/3729756726 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 -- 172.21.15.66:0/3729756726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed83dae00 con 0x55eed83da410 2024-09-12T00:19:09.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 --2- 172.21.15.66:0/3729756726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febdc005a20 tx=0x7febdc012470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d389793e7edf300 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7feac4ff9640 1 -- 172.21.15.66:0/3729756726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc04d020 con 0x55eed83da410 2024-09-12T00:19:09.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7feac4ff9640 1 -- 172.21.15.66:0/3729756726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc02a960 con 0x55eed83da410 2024-09-12T00:19:09.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7feac4ff9640 1 -- 172.21.15.66:0/3729756726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc01f390 con 0x55eed83da410 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3729756726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 msgr2=0x55eed83da810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3729756726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febdc005a20 tx=0x7febdc012470 comp rx=0 tx=0).stop 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3729756726 shutdown_connections 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3729756726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83da810 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3729756726 >> 172.21.15.66:0/3729756726 conn(0x55eed83d5830 msgr2=0x55eed83d3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3729756726 shutdown_connections 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3729756726 wait complete. 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 Processor -- start 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- start start 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe3b4f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eed83d9360 con 0x55eed83da410 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44880/0 (socket says 172.21.15.66:44880) 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 learned_addr learned my addr 172.21.15.66:0/3416771899 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.801+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eed83e0df0 con 0x55eed83da410 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe1e56640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7febdc012560 tx=0x7febdc050850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 -- 172.21.15.66:0/3416771899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc04d030 con 0x55eed83da410 2024-09-12T00:19:09.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eed83e1080 con 0x55eed83da410 2024-09-12T00:19:09.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eed83e1a30 con 0x55eed83da410 2024-09-12T00:19:09.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 -- 172.21.15.66:0/3416771899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febdc04f4e0 con 0x55eed83da410 2024-09-12T00:19:09.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 -- 172.21.15.66:0/3416771899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febdc03eba0 con 0x55eed83da410 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 -- 172.21.15.66:0/3416771899 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7febdc029800 con 0x55eed83da410 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feaac039a70 0x7feaac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7feab6ffd640 1 -- 172.21.15.66:0/3416771899 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7febdc004af0 con 0x55eed83da410 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe1655640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feaac039a70 0x7feaac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed83ebfd0 0x55eed83ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83eebb0 con 0x55eed83ebfd0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe0e54640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed83ebfd0 0x55eed83ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe1655640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feaac039a70 0x7feaac03bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febd40d63f0 tx=0x7febd40e1000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe0e54640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed83ebfd0 0x55eed83ee460 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7febd800d040 con 0x55eed83ebfd0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 realm 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83eb380 con 0x55eed83ebfd0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7febd800d040 con 0x55eed83ebfd0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:09.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83ef6b0 con 0x55eed83ebfd0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7febd800d040 con 0x55eed83ebfd0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.805+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83eff80 con 0x55eed83ebfd0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7febd800d040 con 0x55eed83ebfd0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83f0880 0x55eed83f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f33e0 con 0x55eed83f0880 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83f0880 0x55eed83f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83f0880 0x55eed83f2c70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 20 searching for the correct realm 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83f0880 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7febdc013070 0x7febdc03c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febdc013070 2024-09-12T00:19:09.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1655640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7febdc013070 0x7febdc03c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1655640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7febdc013070 0x7febdc03c3f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1655640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7febd4009040 0x7febd40d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febd4009040 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe0e54640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7febd4009040 0x7febd40d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe0e54640 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7febd4009040 0x7febd40d6690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.809+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd800d040 con 0x7febd4009040 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83ebfd0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd800d040 con 0x55eed83ebfd0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83ebfd0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febd4009040 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febd4009040 2024-09-12T00:19:09.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febdc013070 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83f0880 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83ebfd0 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febd4009040 2024-09-12T00:19:09.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x55eed83ebfd0 2024-09-12T00:19:09.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.813+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4cb0 con 0x7febdc013070 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febd4009040 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83ebfd0 2024-09-12T00:19:09.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83ebfd0 2024-09-12T00:19:09.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febd4009040 2024-09-12T00:19:09.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.817+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febdc013070 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83ebfd0 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febd4009040 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febd4009040 2024-09-12T00:19:09.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febdc013070 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83f0880 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febd4009040 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.821+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x55eed83ebfd0 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7febd4104060 con 0x7febdc013070 2024-09-12T00:19:09.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f3dd0 con 0x55eed83ebfd0 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f4670 con 0x55eed83ebfd0 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f3a10 con 0x55eed83f0880 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 zone default found 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 4 Realm: () 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 zonegroup default 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f5160 con 0x7febd4009040 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f6ce0 con 0x55eed83f0880 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f7180 con 0x55eed83f0880 2024-09-12T00:19:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 started sync module instance, tier type = 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.825+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f5ff0 con 0x7febdc013070 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94484318610400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f6800 con 0x7febdc013070 2024-09-12T00:19:09.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f80b0 con 0x55eed83ebfd0 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94484318610400] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94484318616576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f84d0 con 0x55eed83ebfd0 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.829+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f8e90 con 0x55eed83f0880 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94484318620128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f92b0 con 0x55eed83f0880 2024-09-12T00:19:09.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f9cb0 con 0x7febdc013070 2024-09-12T00:19:09.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94484318616576] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94484318617632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fa0d0 con 0x7febdc013070 2024-09-12T00:19:09.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83faa90 con 0x55eed83ebfd0 2024-09-12T00:19:09.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94484318620128] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94484318617632] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94484318621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f98d0 con 0x55eed83ebfd0 2024-09-12T00:19:09.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.833+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83faa90 con 0x7febd4009040 2024-09-12T00:19:09.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.837+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94484318621184] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.837+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.837+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94484318630096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83faa90 con 0x7febd4009040 2024-09-12T00:19:09.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.837+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fbc80 con 0x7febd4009040 2024-09-12T00:19:09.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94484318631888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fc0a0 con 0x7febd4009040 2024-09-12T00:19:09.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fcad0 con 0x7febd4009040 2024-09-12T00:19:09.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94484318630096] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94484318635488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fcad0 con 0x7febd4009040 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=0 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=1 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=2 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=3 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=4 2024-09-12T00:19:09.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=5 2024-09-12T00:19:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94484318631888] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.841+0000 7febe3b4f9c0 20 add_watcher() i=6 2024-09-12T00:19:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94484318635488] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 add_watcher() i=7 2024-09-12T00:19:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fbbf0 con 0x55eed83ebfd0 2024-09-12T00:19:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94484318632944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fcf00 con 0x55eed83ebfd0 2024-09-12T00:19:09.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94484318632944] v31'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7fea977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:09.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:09.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 5 note: GC not initialized 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7fea967e4640 20 reqs_thread_entry: start 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 Filter name: none 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7fea07fff640 20 reqs_thread_entry: start 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8422b90 con 0x55eed83ebfd0 2024-09-12T00:19:09.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:09.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8423580 con 0x55eed83ebfd0 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.845+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8424590 con 0x7febdc013070 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8421d50 con 0x7febdc013070 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8424590 con 0x55eed83f0880 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:09.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 4.30 4:0d6f2ca4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8425dd0 con 0x55eed83f0880 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 4.1 4:831b4391:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed84288d0 con 0x7febdc013070 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 4.a 4:52dbcbb5:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed842b320 con 0x7febdc013070 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 4.35 4:afe87baa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed842dd70 con 0x55eed83ebfd0 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 4.32 4:4c178f1d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8430780 con 0x55eed83ebfd0 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 4.33 4:cd533e59:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8432ff0 con 0x7febd4009040 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(71 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(69 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(70 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8435860 con 0x55eed83f0880 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 4.12 4:4aa7517e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed842d740 con 0x55eed83ebfd0 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 4.3b 4:dea3e5aa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8426200 con 0x55eed83f0880 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 4.a 4:5196933a:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed8427d50 con 0x7febdc013070 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:77 4.3f 4:fcc2f598:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eed84261b0 con 0x7febdc013070 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(74 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(76 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(73 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(77 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(75 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7fea977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:09.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.849+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94484318632944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x55eed83ebfd0 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94484318632944] v31'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94484318610400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x7febdc013070 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94484318610400] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe3b4f9c0 20 remove_watcher() i=0 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe3b4f9c0 2 removed watcher, disabling cache 2024-09-12T00:19:09.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.853+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94484318616576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x55eed83ebfd0 2024-09-12T00:19:09.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94484318616576] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 20 remove_watcher() i=1 2024-09-12T00:19:09.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94484318620128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f7c00 con 0x55eed83f0880 2024-09-12T00:19:09.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe1e56640 1 -- 172.21.15.66:0/3416771899 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94484318620128] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febdc04f040 con 0x55eed83f0880 2024-09-12T00:19:09.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 20 remove_watcher() i=2 2024-09-12T00:19:09.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94484318617632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x7febdc013070 2024-09-12T00:19:09.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe1655640 1 -- 172.21.15.66:0/3416771899 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94484318617632] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd40f5070 con 0x7febdc013070 2024-09-12T00:19:09.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 20 remove_watcher() i=3 2024-09-12T00:19:09.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.857+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94484318621184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83f89e0 con 0x55eed83ebfd0 2024-09-12T00:19:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94484318621184] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x55eed83ebfd0 2024-09-12T00:19:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe3b4f9c0 20 remove_watcher() i=4 2024-09-12T00:19:09.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94484318630096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x7febd4009040 2024-09-12T00:19:09.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94484318630096] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe3b4f9c0 20 remove_watcher() i=5 2024-09-12T00:19:09.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.861+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94484318631888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed83fb0d0 con 0x7febd4009040 2024-09-12T00:19:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.865+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94484318631888] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.865+0000 7febe3b4f9c0 20 remove_watcher() i=6 2024-09-12T00:19:09.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.865+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94484318635488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eed8420920 con 0x7febd4009040 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94484318635488] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7febd802a040 con 0x7febd4009040 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 20 remove_watcher() i=7 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7febd4009040 msgr2=0x7febd40d6690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7febd4009040 0x7febd40d6690 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed83ebfd0 msgr2=0x55eed83ee460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed83ebfd0 0x55eed83ee460 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7febdc013070 msgr2=0x7febdc03c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7febdc013070 0x7febdc03c3f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83f0880 msgr2=0x55eed83f2c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83f0880 0x55eed83f2c70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feaac039a70 msgr2=0x7feaac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feaac039a70 0x7feaac03bf30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febd40d63f0 tx=0x7febd40e1000 comp rx=0 tx=0).stop 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe0e54640 1 -- 172.21.15.66:0/3416771899 reap_dead start 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 msgr2=0x55eed83e0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7febdc012560 tx=0x7febdc050850 comp rx=0 tx=0).stop 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 shutdown_connections 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/3416771899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83da410 0x55eed83e0890 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 >> 172.21.15.66:0/3416771899 conn(0x55eed83d5830 msgr2=0x55eed83d3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 shutdown_connections 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/3416771899 wait complete. 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 msgr2=0x7feab803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 0x7feab803bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55eed83b9a10 tx=0x7febd40d0cb0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 msgr2=0x55eed83ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55eed83b2f50 tx=0x7febdc0163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 shutdown_connections 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feab8039a70 0x7feab803bf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/2979785581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed83ccac0 0x55eed83ccee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 >> 172.21.15.66:0/2979785581 conn(0x55eed83c2470 msgr2=0x55eed83c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 shutdown_connections 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/2979785581 wait complete. 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 msgr2=0x55eed83b9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 0x55eed83b9090 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 msgr2=0x55eed83bdc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 0x55eed83bdc60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 msgr2=0x7feac803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 0x7feac803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febd8001e60 tx=0x7febd80013e0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 msgr2=0x55eed83b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7febd4000c10 tx=0x7febd40180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 shutdown_connections 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eed83bb870 0x55eed83bdc60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eed8231b50 0x55eed83b9090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feac8039a70 0x7feac803bf30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 --2- 172.21.15.66:0/995594415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eed8231770 0x55eed83b1f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 >> 172.21.15.66:0/995594415 conn(0x55eed82b7e90 msgr2=0x55eed83a5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 shutdown_connections 2024-09-12T00:19:09.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.869+0000 7febe3b4f9c0 1 -- 172.21.15.66:0/995594415 wait complete. 2024-09-12T00:19:09.885 INFO:teuthology.orchestra.run.smithi066.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0f94cb3c-a22e-48d3-91ff-0e4df7c90757","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T00:19:08.911652Z","creation_time":"2024-09-12T00:19:08.903952Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-12T00:19:09.885 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:19:08.911652Z', 'creation_time': '2024-09-12T00:19:08.903952Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T00:19:09.896 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T00:19:09.896 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:09.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:09.896 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T00:19:09.965 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:09.965 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa8022df9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4ee6d8770 0x55e4ee6d8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa8022df9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4ee58a9c0 con 0x55e4ee6db8b0 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa8022df9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55e4ee5da6d0 con 0x55e4ee6d8770 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ffde5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4ee6d8770 0x55e4ee6d8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ff5e4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55e4ee6db8b0 0x55e4ee6ddca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42938/0 (socket says 172.21.15.66:42938) 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ffde5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e4ee6d8770 0x55e4ee6d8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44896/0 (socket says 172.21.15.66:44896) 2024-09-12T00:19:09.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3488842859 learned_addr learned my addr 172.21.15.66:0/3488842859 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:09.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3488842859 >> v1:172.21.15.31:6789/0 conn(0x55e4ee6db8b0 legacy=0x55e4ee6ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.961+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3488842859 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee57eca0 con 0x55e4ee6d8770 2024-09-12T00:19:09.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3488842859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee6d8b50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000a420 tx=0x7fa7f001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c2be6ccfbf3abf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa7fede3640 1 -- 172.21.15.66:0/3488842859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00af070 con 0x55e4ee6d8770 2024-09-12T00:19:09.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa7fede3640 1 -- 172.21.15.66:0/3488842859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f00aa530 con 0x55e4ee6d8770 2024-09-12T00:19:09.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa7fede3640 1 -- 172.21.15.66:0/3488842859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00aa850 con 0x55e4ee6d8770 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3488842859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 msgr2=0x55e4ee6d8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3488842859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee6d8b50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000a420 tx=0x7fa7f001afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3488842859 shutdown_connections 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3488842859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee6d8b50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3488842859 >> 172.21.15.66:0/3488842859 conn(0x55e4ee64c080 msgr2=0x55e4ee64c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3488842859 shutdown_connections 2024-09-12T00:19:09.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.965+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3488842859 wait complete. 2024-09-12T00:19:09.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:09.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:09.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa8022df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa8022df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee5de680 con 0x55e4ee6d8770 2024-09-12T00:19:09.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa7ffde5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa7ffde5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44910/0 (socket says 172.21.15.66:44910) 2024-09-12T00:19:09.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.981+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2686238626 learned_addr learned my addr 172.21.15.66:0/2686238626 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2686238626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee559da0 con 0x55e4ee6d8770 2024-09-12T00:19:09.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2686238626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0018c00 tx=0x7fa7f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3741986789f3c065 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa6ede0b640 1 -- 172.21.15.66:0/2686238626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00af040 con 0x55e4ee6d8770 2024-09-12T00:19:09.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa6ede0b640 1 -- 172.21.15.66:0/2686238626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f00aaa00 con 0x55e4ee6d8770 2024-09-12T00:19:09.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa6ede0b640 1 -- 172.21.15.66:0/2686238626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00aace0 con 0x55e4ee6d8770 2024-09-12T00:19:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2686238626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 msgr2=0x55e4ee7c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2686238626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0018c00 tx=0x7fa7f00033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2686238626 shutdown_connections 2024-09-12T00:19:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2686238626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7c39e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:09.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2686238626 >> 172.21.15.66:0/2686238626 conn(0x55e4ee64c080 msgr2=0x55e4ee7bf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2686238626 shutdown_connections 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2686238626 wait complete. 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa8022df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee580a50 con 0x55e4ee6d8770 2024-09-12T00:19:09.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44922/0 (socket says 172.21.15.66:44922) 2024-09-12T00:19:09.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2588962338 learned_addr learned my addr 172.21.15.66:0/2588962338 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:09.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.985+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee7cb450 con 0x55e4ee6d8770 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0000f90 tx=0x7fa7f0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 -- 172.21.15.66:0/2588962338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00c5030 con 0x55e4ee6d8770 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ee7cb6e0 con 0x55e4ee6d8770 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 -- 172.21.15.66:0/2588962338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f00c1690 con 0x55e4ee6d8770 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 -- 172.21.15.66:0/2588962338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f00c1990 con 0x55e4ee6d8770 2024-09-12T00:19:09.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee7cc110 con 0x55e4ee6d8770 2024-09-12T00:19:09.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 -- 172.21.15.66:0/2588962338 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7f00c8070 con 0x55e4ee6d8770 2024-09-12T00:19:09.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 0x7fa6e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa6e7fff640 1 -- 172.21.15.66:0/2588962338 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f00c6070 con 0x55e4ee6d8770 2024-09-12T00:19:09.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 0x7fa6e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 0x55e4ee7d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee7d25a0 con 0x55e4ee6db8b0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8005e6640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 0x55e4ee7d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 0x7fa6e803bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8001d80 tx=0x7fa7e80012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8005e6640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 0x55e4ee7d2060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8005e6640 1 -- 172.21.15.66:0/2588962338 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7f80083f0 con 0x55e4ee6db8b0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee7cc400 con 0x55e4ee6db8b0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8005e6640 1 -- 172.21.15.66:0/2588962338 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7f80083f0 con 0x55e4ee6db8b0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 0x55e4ee7d6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee7d72f0 con 0x55e4ee7d4810 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.989+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 0x55e4ee7d6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:09.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 0x55e4ee7d6c00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2588962338 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7f00b2040 con 0x55e4ee7d4810 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee7d3680 con 0x55e4ee6db8b0 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 -- 172.21.15.66:0/2588962338 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7f80083f0 con 0x55e4ee6db8b0 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee7d3b60 con 0x55e4ee7d4810 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa7ffde5640 1 -- 172.21.15.66:0/2588962338 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7f00b2040 con 0x55e4ee7d4810 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee5eb450 con 0x55e4ee7e5a00 2024-09-12T00:19:09.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44926/0 (socket says 172.21.15.66:44926) 2024-09-12T00:19:10.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 -- 172.21.15.66:0/2670692217 learned_addr learned my addr 172.21.15.66:0/2670692217 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 -- 172.21.15.66:0/2670692217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee7e6460 con 0x55e4ee7e5a00 2024-09-12T00:19:10.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8005e6640 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55e4ee7cb930 tx=0x7fa7f800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa6e57fa640 1 -- 172.21.15.66:0/2670692217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f801c020 con 0x55e4ee7e5a00 2024-09-12T00:19:10.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ee7e6cc0 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa6e57fa640 1 -- 172.21.15.66:0/2670692217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8007d00 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa6e57fa640 1 -- 172.21.15.66:0/2670692217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8018440 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.993+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee7e7230 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6e57fa640 1 -- 172.21.15.66:0/2670692217 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7f801f020 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6e57fa640 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 0x7fa6d803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6e57fa640 1 -- 172.21.15.66:0/2670692217 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f8051db0 con 0x55e4ee7e5a00 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 0x7fa6d803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 0x7fa6d803bf80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00033f0 tx=0x7fa7f00b6870 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee7c4150 con 0x55e4ee7f32d0 2024-09-12T00:19:10.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44934/0 (socket says 172.21.15.66:44934) 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8005e6640 1 -- 172.21.15.66:0/3337188254 learned_addr learned my addr 172.21.15.66:0/3337188254 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8005e6640 1 -- 172.21.15.66:0/3337188254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee7f3ca0 con 0x55e4ee7f32d0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8005e6640 1 --2- 172.21.15.66:0/3337188254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8050130 tx=0x7fa7f8016f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fd889c06329a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6deffd640 1 -- 172.21.15.66:0/3337188254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f80166f0 con 0x55e4ee7f32d0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6deffd640 1 -- 172.21.15.66:0/3337188254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8016890 con 0x55e4ee7f32d0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa6deffd640 1 -- 172.21.15.66:0/3337188254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8029d80 con 0x55e4ee7f32d0 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3337188254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 msgr2=0x55e4ee7f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3337188254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8050130 tx=0x7fa7f8016f20 comp rx=0 tx=0).stop 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3337188254 shutdown_connections 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3337188254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f36b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3337188254 >> 172.21.15.66:0/3337188254 conn(0x55e4ee7ee6f0 msgr2=0x55e4ee7ec930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3337188254 shutdown_connections 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:09.997+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3337188254 wait complete. 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 Processor -- start 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 -- start start 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee7f2220 con 0x55e4ee7f32d0 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8005e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44942/0 (socket says 172.21.15.66:44942) 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 learned_addr learned my addr 172.21.15.66:0/3387637937 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee7f9ce0 con 0x55e4ee7f32d0 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8005e6640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8016f60 tx=0x7fa7f8050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 -- 172.21.15.66:0/3387637937 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8028af0 con 0x55e4ee7f32d0 2024-09-12T00:19:10.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4ee7f9f70 con 0x55e4ee7f32d0 2024-09-12T00:19:10.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 -- 172.21.15.66:0/3387637937 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f8028c90 con 0x55e4ee7f32d0 2024-09-12T00:19:10.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 -- 172.21.15.66:0/3387637937 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f80203b0 con 0x55e4ee7f32d0 2024-09-12T00:19:10.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee7fa920 con 0x55e4ee7f32d0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 -- 172.21.15.66:0/3387637937 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa7f8016040 con 0x55e4ee7f32d0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6c8039a70 0x7fa6c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa6dd7fa640 1 -- 172.21.15.66:0/3387637937 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fa7f8036c80 con 0x55e4ee7f32d0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6c8039a70 0x7fa6c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee804d20 0x55e4ee8071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee807900 con 0x55e4ee804d20 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee804d20 0x55e4ee8071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6c8039a70 0x7fa6c803bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00aa000 tx=0x7fa7f00dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.001+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee804d20 0x55e4ee8071b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e800e5a0 con 0x55e4ee804d20 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 realm 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee804130 con 0x55e4ee804d20 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e800e5a0 con 0x55e4ee804d20 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee808400 con 0x55e4ee804d20 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e800e5a0 con 0x55e4ee804d20 2024-09-12T00:19:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee808cd0 con 0x55e4ee804d20 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7e800e5a0 con 0x55e4ee804d20 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee8095d0 0x55e4ee80b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80c100 con 0x55e4ee8095d0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee8095d0 0x55e4ee80b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee8095d0 0x55e4ee80b9c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 20 searching for the correct realm 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa7f8021020 0x7fa7f804a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa7f8021020 0x7fa7f804a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa7f8021020 0x7fa7f804a070 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ffde5640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa7f00f8040 0x7fa7f00c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.005+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa7f00f8040 0x7fa7f00c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa7f00f8040 0x7fa7f00c03e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e800e5a0 con 0x7fa7f00f8040 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e800e5a0 con 0x55e4ee804d20 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.009+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.013+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee8095d0 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f00f8040 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x55e4ee804d20 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.017+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d9d0 con 0x7fa7f8021020 2024-09-12T00:19:10.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80cb20 con 0x55e4ee804d20 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d3c0 con 0x55e4ee804d20 2024-09-12T00:19:10.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80c760 con 0x55e4ee8095d0 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 zone default found 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 4 Realm: () 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 zonegroup default 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80d010 con 0x7fa7f00f8040 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee810250 con 0x55e4ee8095d0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee810650 con 0x55e4ee8095d0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 started sync module instance, tier type = 2024-09-12T00:19:10.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:10.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.021+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee80f690 con 0x7fa7f8021020 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441742332384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee810ab0 con 0x7fa7f8021020 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee811300 con 0x55e4ee804d20 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441742332384] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441742339664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee811720 con 0x55e4ee804d20 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.025+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee811f70 con 0x55e4ee8095d0 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441742339664] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441742340992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee811d70 con 0x55e4ee8095d0 2024-09-12T00:19:10.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee812890 con 0x7fa7f8021020 2024-09-12T00:19:10.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441742345056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee812850 con 0x7fa7f8021020 2024-09-12T00:19:10.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee8137d0 con 0x55e4ee804d20 2024-09-12T00:19:10.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441742340992] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441742345056] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.029+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441742349056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee8137d0 con 0x55e4ee804d20 2024-09-12T00:19:10.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee813c00 con 0x7fa7f00f8040 2024-09-12T00:19:10.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441742349056] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441742342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee812d00 con 0x7fa7f00f8040 2024-09-12T00:19:10.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.033+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee814610 con 0x7fa7f00f8040 2024-09-12T00:19:10.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441742342112] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441742350560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee814610 con 0x7fa7f00f8040 2024-09-12T00:19:10.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee814fd0 con 0x7fa7f00f8040 2024-09-12T00:19:10.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441742350560] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441742353008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee814fd0 con 0x7fa7f00f8040 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=0 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=1 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=2 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=3 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=4 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=5 2024-09-12T00:19:10.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.037+0000 7fa8022df9c0 20 add_watcher() i=6 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441742353008] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 add_watcher() i=7 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee8182f0 con 0x55e4ee804d20 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441742368048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee815140 con 0x55e4ee804d20 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441742368048] v31'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 5 note: GC not initialized 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa6b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:10.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:10.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 Filter name: none 2024-09-12T00:19:10.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa62e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:10.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee83ba60 con 0x7fa7f8021020 2024-09-12T00:19:10.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.041+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee83c2f0 con 0x55e4ee8095d0 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(63 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee83c4b0 con 0x7fa7f8021020 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa7f00d5050 con 0x7fa7f8021020 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:10.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee83d970 con 0x55e4ee8095d0 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(65 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 4.30 4:0d6f2ca4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee83f2e0 con 0x55e4ee8095d0 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 4.1 4:831b4391:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee841d30 con 0x7fa7f8021020 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 4.a 4:52dbcbb5:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee844790 con 0x7fa7f8021020 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 4.35 4:afe87baa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee8471f0 con 0x55e4ee804d20 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 4.32 4:4c178f1d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee849be0 con 0x55e4ee804d20 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 4.33 4:cd533e59:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee84c670 con 0x7fa7f00f8040 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee84f520 con 0x55e4ee8095d0 2024-09-12T00:19:10.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 4.12 4:4aa7517e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee852390 con 0x55e4ee804d20 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:74 4.3b 4:dea3e5aa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee855250 con 0x55e4ee8095d0 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 4.a 4:5196933a:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee858080 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 4.3f 4:fcc2f598:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee85aed0 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(66 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(68 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(75 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(74 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(76 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(69 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(72 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(73 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.045+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441742368048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee8471f0 con 0x55e4ee804d20 2024-09-12T00:19:10.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94441742368048] v31'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441742332384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x7fa7f8021020 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94441742332384] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa8022df9c0 20 remove_watcher() i=0 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa8022df9c0 2 removed watcher, disabling cache 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.049+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441742339664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x55e4ee804d20 2024-09-12T00:19:10.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94441742339664] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 20 remove_watcher() i=1 2024-09-12T00:19:10.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441742340992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x55e4ee8095d0 2024-09-12T00:19:10.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8005e6640 1 -- 172.21.15.66:0/3387637937 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94441742340992] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f803b020 con 0x55e4ee8095d0 2024-09-12T00:19:10.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 20 remove_watcher() i=2 2024-09-12T00:19:10.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441742345056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x7fa7f8021020 2024-09-12T00:19:10.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa7ffde5640 1 -- 172.21.15.66:0/3387637937 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94441742345056] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f0108040 con 0x7fa7f8021020 2024-09-12T00:19:10.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 20 remove_watcher() i=3 2024-09-12T00:19:10.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.053+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441742349056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x55e4ee804d20 2024-09-12T00:19:10.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94441742349056] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x55e4ee804d20 2024-09-12T00:19:10.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa8022df9c0 20 remove_watcher() i=4 2024-09-12T00:19:10.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441742342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x7fa7f00f8040 2024-09-12T00:19:10.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94441742342112] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8029040 con 0x7fa7f00f8040 2024-09-12T00:19:10.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa8022df9c0 20 remove_watcher() i=5 2024-09-12T00:19:10.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.057+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441742350560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x7fa7f00f8040 2024-09-12T00:19:10.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94441742350560] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8044040 con 0x7fa7f00f8040 2024-09-12T00:19:10.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 20 remove_watcher() i=6 2024-09-12T00:19:10.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441742353008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e4ee817750 con 0x7fa7f00f8040 2024-09-12T00:19:10.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94441742353008] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7e8044040 con 0x7fa7f00f8040 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 20 remove_watcher() i=7 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa7f00f8040 msgr2=0x7fa7f00c03e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa7f00f8040 0x7fa7f00c03e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee804d20 msgr2=0x55e4ee8071b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee804d20 0x55e4ee8071b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa7f8021020 msgr2=0x7fa7f804a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa7f8021020 0x7fa7f804a070 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee8095d0 msgr2=0x55e4ee80b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.061+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee8095d0 0x55e4ee80b9c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6c8039a70 msgr2=0x7fa6c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6c8039a70 0x7fa6c803bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00aa000 tx=0x7fa7f00dd000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 msgr2=0x55e4ee7f9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa7ff5e4640 1 -- 172.21.15.66:0/3387637937 reap_dead start 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8016f60 tx=0x7fa7f8050090 comp rx=0 tx=0).stop 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 shutdown_connections 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/3387637937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7f32d0 0x55e4ee7f9780 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 >> 172.21.15.66:0/3387637937 conn(0x55e4ee7ee6f0 msgr2=0x55e4ee7ec900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 shutdown_connections 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/3387637937 wait complete. 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 msgr2=0x7fa6d803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 0x7fa6d803bf80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00033f0 tx=0x7fa7f00b6870 comp rx=0 tx=0).stop 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 msgr2=0x55e4ee7e5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55e4ee7cb930 tx=0x7fa7f800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:10.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 shutdown_connections 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6d8039ac0 0x7fa6d803bf80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2670692217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee7e5a00 0x55e4ee7e5e20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 >> 172.21.15.66:0/2670692217 conn(0x55e4ee7db3b0 msgr2=0x55e4ee7db790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 shutdown_connections 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2670692217 wait complete. 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 msgr2=0x55e4ee7d2060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 0x55e4ee7d2060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 msgr2=0x55e4ee7d6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 0x55e4ee7d6c00 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 msgr2=0x7fa6e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 0x7fa6e803bf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8001d80 tx=0x7fa7e80012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 msgr2=0x55e4ee7caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0000f90 tx=0x7fa7f0017d70 comp rx=0 tx=0).stop 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 shutdown_connections 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e4ee7d4810 0x55e4ee7d6c00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e4ee6db8b0 0x55e4ee7d2060 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa6e8039a70 0x7fa6e803bf30 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8001d80 tx=0x7fa7e80012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 --2- 172.21.15.66:0/2588962338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e4ee6d8770 0x55e4ee7caef0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 >> 172.21.15.66:0/2588962338 conn(0x55e4ee64c080 msgr2=0x55e4ee7be110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 shutdown_connections 2024-09-12T00:19:10.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.065+0000 7fa8022df9c0 1 -- 172.21.15.66:0/2588962338 wait complete. 2024-09-12T00:19:10.080 INFO:teuthology.orchestra.run.smithi066.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0f94cb3c-a22e-48d3-91ff-0e4df7c90757","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T00:19:08.911652Z","creation_time":"2024-09-12T00:19:08.903952Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T00:19:10.081 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:19:08.911652Z', 'creation_time': '2024-09-12T00:19:08.903952Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T00:19:10.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T00:19:10.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T00:19:10.081 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-12T00:19:10.163 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:10.164 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:10.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb26527f9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555f3c234370 0x555f3c234750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb26527f9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f3c0e99c0 con 0x555f3c237550 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb26527f9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555f3c1396d0 con 0x555f3c234370 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb262d85640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555f3c234370 0x555f3c234750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb262584640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x555f3c237550 0x555f3c239940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42942/0 (socket says 172.21.15.66:42942) 2024-09-12T00:19:10.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb262584640 1 -- 172.21.15.66:0/3088909166 learned_addr learned my addr 172.21.15.66:0/3088909166 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:10.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb262d85640 1 -- 172.21.15.66:0/3088909166 >> v1:172.21.15.31:6789/0 conn(0x555f3c237550 legacy=0x555f3c239940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.161+0000 7fb262d85640 1 -- 172.21.15.66:0/3088909166 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c0ddca0 con 0x555f3c234370 2024-09-12T00:19:10.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb262d85640 1 --2- 172.21.15.66:0/3088909166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c234750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb25400a420 tx=0x7fb25401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18d2d63b10c6049 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb261d83640 1 -- 172.21.15.66:0/3088909166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540af070 con 0x555f3c234370 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb261d83640 1 -- 172.21.15.66:0/3088909166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540aa530 con 0x555f3c234370 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb261d83640 1 -- 172.21.15.66:0/3088909166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540aa850 con 0x555f3c234370 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 -- 172.21.15.66:0/3088909166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 msgr2=0x555f3c234750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/3088909166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c234750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb25400a420 tx=0x7fb25401afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 -- 172.21.15.66:0/3088909166 shutdown_connections 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/3088909166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c234750 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 -- 172.21.15.66:0/3088909166 >> 172.21.15.66:0/3088909166 conn(0x555f3c22fe90 msgr2=0x555f3c2322b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 -- 172.21.15.66:0/3088909166 shutdown_connections 2024-09-12T00:19:10.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.165+0000 7fb26527f9c0 1 -- 172.21.15.66:0/3088909166 wait complete. 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb26527f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb26527f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f3c13d680 con 0x555f3c234370 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb262d85640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb262d85640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44956/0 (socket says 172.21.15.66:44956) 2024-09-12T00:19:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb262d85640 1 -- 172.21.15.66:0/108594288 learned_addr learned my addr 172.21.15.66:0/108594288 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb262d85640 1 -- 172.21.15.66:0/108594288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c0b8da0 con 0x555f3c234370 2024-09-12T00:19:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb262d85640 1 --2- 172.21.15.66:0/108594288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ad040 tx=0x7fb2540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cab6019bbcc195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb150e09640 1 -- 172.21.15.66:0/108594288 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540af040 con 0x555f3c234370 2024-09-12T00:19:10.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb150e09640 1 -- 172.21.15.66:0/108594288 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540aaa60 con 0x555f3c234370 2024-09-12T00:19:10.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.181+0000 7fb150e09640 1 -- 172.21.15.66:0/108594288 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540aad40 con 0x555f3c234370 2024-09-12T00:19:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/108594288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 msgr2=0x555f3c1a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/108594288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ad040 tx=0x7fb2540033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/108594288 shutdown_connections 2024-09-12T00:19:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/108594288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c1a9280 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/108594288 >> 172.21.15.66:0/108594288 conn(0x555f3c22fe90 msgr2=0x555f3c31b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/108594288 shutdown_connections 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/108594288 wait complete. 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f3c0dfa50 con 0x555f3c234370 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb262d85640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb262d85640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44972/0 (socket says 172.21.15.66:44972) 2024-09-12T00:19:10.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb262d85640 1 -- 172.21.15.66:0/943063800 learned_addr learned my addr 172.21.15.66:0/943063800 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb262d85640 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c328340 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb262d85640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb25401b4b0 tx=0x7fb254017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb14f606640 1 -- 172.21.15.66:0/943063800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540c5070 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f3c3285d0 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb14f606640 1 -- 172.21.15.66:0/943063800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540c17c0 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb14f606640 1 -- 172.21.15.66:0/943063800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540cf060 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.185+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3c328f80 con 0x555f3c234370 2024-09-12T00:19:10.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb14f606640 1 -- 172.21.15.66:0/943063800 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2540c8070 con 0x555f3c234370 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb14f606640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 0x7fb14803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb14f606640 1 -- 172.21.15.66:0/943063800 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb2540bb070 con 0x555f3c234370 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb262584640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 0x7fb14803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 0x555f3c32ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb262584640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 0x7fb14803bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb24c004180 tx=0x7fb24c001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c32f490 con 0x555f3c237550 2024-09-12T00:19:10.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb263586640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 0x555f3c32ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb263586640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 0x555f3c32ef50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb263586640 1 -- 172.21.15.66:0/943063800 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25c0083f0 con 0x555f3c237550 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c32f890 con 0x555f3c237550 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb263586640 1 -- 172.21.15.66:0/943063800 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb25c0083f0 con 0x555f3c237550 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 0x555f3c333a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb262d85640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 0x555f3c333a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.189+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c334160 con 0x555f3c3316a0 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb262d85640 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 0x555f3c333a90 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb262d85640 1 -- 172.21.15.66:0/943063800 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2540c7030 con 0x555f3c3316a0 2024-09-12T00:19:10.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c330510 con 0x555f3c237550 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 -- 172.21.15.66:0/943063800 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb25c0083f0 con 0x555f3c237550 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3309f0 con 0x555f3c3316a0 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb262d85640 1 -- 172.21.15.66:0/943063800 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2540c7030 con 0x555f3c3316a0 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f3c14a450 con 0x555f3c342890 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:44988/0 (socket says 172.21.15.66:44988) 2024-09-12T00:19:10.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 -- 172.21.15.66:0/4134324556 learned_addr learned my addr 172.21.15.66:0/4134324556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 -- 172.21.15.66:0/4134324556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c3432f0 con 0x555f3c342890 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb263586640 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x555f3c328e10 tx=0x7fb25c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb14ce01640 1 -- 172.21.15.66:0/4134324556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c01c020 con 0x555f3c342890 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb14ce01640 1 -- 172.21.15.66:0/4134324556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c007d00 con 0x555f3c342890 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f3c343b50 con 0x555f3c342890 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb14ce01640 1 -- 172.21.15.66:0/4134324556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c018440 con 0x555f3c342890 2024-09-12T00:19:10.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.193+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3c344060 con 0x555f3c342890 2024-09-12T00:19:10.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb14ce01640 1 -- 172.21.15.66:0/4134324556 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb25c01f020 con 0x555f3c342890 2024-09-12T00:19:10.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb14ce01640 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 0x7fb13c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb14ce01640 1 -- 172.21.15.66:0/4134324556 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb25c051d60 con 0x555f3c342890 2024-09-12T00:19:10.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb262d85640 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 0x7fb13c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb262d85640 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 0x7fb13c03bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb2540bf900 tx=0x7fb2540bf3d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb26527f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb26527f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f3c1a9a10 con 0x555f3c350320 2024-09-12T00:19:10.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45004/0 (socket says 172.21.15.66:45004) 2024-09-12T00:19:10.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb263586640 1 -- 172.21.15.66:0/4020532327 learned_addr learned my addr 172.21.15.66:0/4020532327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb263586640 1 -- 172.21.15.66:0/4020532327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c350d10 con 0x555f3c350320 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb263586640 1 --2- 172.21.15.66:0/4020532327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0500e0 tx=0x7fb25c0168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba1605450f2dcfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb1467fc640 1 -- 172.21.15.66:0/4020532327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c021400 con 0x555f3c350320 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb1467fc640 1 -- 172.21.15.66:0/4020532327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c029c50 con 0x555f3c350320 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.197+0000 7fb1467fc640 1 -- 172.21.15.66:0/4020532327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c0215a0 con 0x555f3c350320 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4020532327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 msgr2=0x555f3c350720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4020532327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0500e0 tx=0x7fb25c0168b0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4020532327 shutdown_connections 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4020532327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c350720 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4020532327 >> 172.21.15.66:0/4020532327 conn(0x555f3c34b640 msgr2=0x555f3c349880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4020532327 shutdown_connections 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4020532327 wait complete. 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 Processor -- start 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- start start 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f3c34f2e0 con 0x555f3c350320 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb263586640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45014/0 (socket says 172.21.15.66:45014) 2024-09-12T00:19:10.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 learned_addr learned my addr 172.21.15.66:0/2156721819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3c321230 con 0x555f3c350320 2024-09-12T00:19:10.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb263586640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0168f0 tx=0x7fb25c050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb144ff9640 1 -- 172.21.15.66:0/2156721819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c039070 con 0x555f3c350320 2024-09-12T00:19:10.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f3c31f610 con 0x555f3c350320 2024-09-12T00:19:10.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb144ff9640 1 -- 172.21.15.66:0/2156721819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c0289c0 con 0x555f3c350320 2024-09-12T00:19:10.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb144ff9640 1 -- 172.21.15.66:0/2156721819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c028ca0 con 0x555f3c350320 2024-09-12T00:19:10.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.201+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3c31fb20 con 0x555f3c350320 2024-09-12T00:19:10.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb144ff9640 1 -- 172.21.15.66:0/2156721819 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb25c03c070 con 0x555f3c350320 2024-09-12T00:19:10.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb144ff9640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb12c039a70 0x7fb12c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb144ff9640 1 -- 172.21.15.66:0/2156721819 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb25c031070 con 0x555f3c350320 2024-09-12T00:19:10.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c363f10 0x555f3c3663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c366af0 con 0x555f3c363f10 2024-09-12T00:19:10.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c363f10 0x555f3c3663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262d85640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb12c039a70 0x7fb12c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c363f10 0x555f3c3663a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb24c00e640 con 0x555f3c363f10 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262d85640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb12c039a70 0x7fb12c03bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb2540e9d60 tx=0x7fb2540dd000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 realm 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3632c0 con 0x555f3c363f10 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb24c00e640 con 0x555f3c363f10 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3675d0 con 0x555f3c363f10 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb24c00e640 con 0x555f3c363f10 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c367ea0 con 0x555f3c363f10 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb24c00e640 con 0x555f3c363f10 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c368750 0x555f3c36ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36b2a0 con 0x555f3c368750 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb263586640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c368750 0x555f3c36ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.205+0000 7fb263586640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c368750 0x555f3c36ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:10.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb26527f9c0 20 searching for the correct realm 2024-09-12T00:19:10.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb263586640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb25c021020 0x7fb25c02dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262d85640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb25c021020 0x7fb25c02dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262d85640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb25c021020 0x7fb25c02dad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262d85640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2540f8040 0x7fb2540eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2540f8040 0x7fb2540eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2540f8040 0x7fb2540eb0b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c00e640 con 0x7fb2540f8040 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c00e640 con 0x555f3c363f10 2024-09-12T00:19:10.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.209+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.213+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.217+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c368750 2024-09-12T00:19:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb2540f8040 2024-09-12T00:19:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x555f3c363f10 2024-09-12T00:19:10.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36cbc0 con 0x7fb25c021020 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36bce0 con 0x555f3c363f10 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.221+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36c580 con 0x555f3c363f10 2024-09-12T00:19:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36b920 con 0x555f3c368750 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 zone default found 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 4 Realm: () 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 zonegroup default 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36c1b0 con 0x7fb2540f8040 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36f060 con 0x555f3c368750 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36f450 con 0x555f3c368750 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 started sync module instance, tier type = 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:10.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36e400 con 0x7fb25c021020 2024-09-12T00:19:10.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93867520483152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36f450 con 0x7fb25c021020 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.225+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36fca0 con 0x555f3c363f10 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.229+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93867520483152] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.229+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.229+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93867520489456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c36fc10 con 0x555f3c363f10 2024-09-12T00:19:10.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.229+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3709f0 con 0x555f3c368750 2024-09-12T00:19:10.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.229+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93867520492864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c370e10 con 0x555f3c368750 2024-09-12T00:19:10.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c371900 con 0x7fb25c021020 2024-09-12T00:19:10.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93867520489456] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93867520496592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3718c0 con 0x7fb25c021020 2024-09-12T00:19:10.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c372310 con 0x555f3c363f10 2024-09-12T00:19:10.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93867520492864] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93867520496592] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93867520491664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c371e60 con 0x555f3c363f10 2024-09-12T00:19:10.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.233+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c372710 con 0x7fb2540f8040 2024-09-12T00:19:10.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93867520491664] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93867520493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c372310 con 0x7fb2540f8040 2024-09-12T00:19:10.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c373120 con 0x7fb2540f8040 2024-09-12T00:19:10.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93867520493920] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.237+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93867520502896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c373540 con 0x7fb2540f8040 2024-09-12T00:19:10.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c371ea0 con 0x7fb2540f8040 2024-09-12T00:19:10.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93867520502896] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93867520503952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3734b0 con 0x7fb2540f8040 2024-09-12T00:19:10.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=0 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=1 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=2 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=3 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=4 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=5 2024-09-12T00:19:10.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.241+0000 7fb26527f9c0 20 add_watcher() i=6 2024-09-12T00:19:10.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93867520503952] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 add_watcher() i=7 2024-09-12T00:19:10.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:10.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c376fe0 con 0x555f3c363f10 2024-09-12T00:19:10.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93867520506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c374400 con 0x555f3c363f10 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93867520506624] v31'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb1197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 5 note: GC not initialized 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb093fff640 20 reqs_thread_entry: start 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 Filter name: none 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb091ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c39a020 con 0x555f3c363f10 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c39b570 con 0x7fb25c021020 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.245+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c39b570 con 0x555f3c368750 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 4.30 4:0d6f2ca4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c39d030 con 0x555f3c368750 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 4.1 4:831b4391:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c39f940 con 0x7fb25c021020 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 4.a 4:52dbcbb5:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3a2360 con 0x7fb25c021020 2024-09-12T00:19:10.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 4.35 4:afe87baa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3a4dc0 con 0x555f3c363f10 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 4.32 4:4c178f1d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3a7630 con 0x555f3c363f10 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 4.33 4:cd533e59:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3aa050 con 0x7fb2540f8040 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3ac8c0 con 0x555f3c368750 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 4.12 4:4aa7517e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3af130 con 0x555f3c363f10 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 4.3b 4:dea3e5aa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1c50 con 0x555f3c368750 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 4.a 4:5196933a:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b47b0 con 0x7fb25c021020 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 4.3f 4:fcc2f598:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1c50 con 0x7fb25c021020 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(65 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(73 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(70 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(75 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(68 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(69 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(72 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.249+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb25c021020 2024-09-12T00:19:10.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(76 foo.buckets [call] v31'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c398f50 con 0x7fb25c021020 2024-09-12T00:19:10.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(77 foo.buckets [call] v31'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb26527f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x555f3c363f10 2024-09-12T00:19:10.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb26527f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:10.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb25c021020 2024-09-12T00:19:10.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.253+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb1197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93867520506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x555f3c363f10 2024-09-12T00:19:10.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93867520506624] v31'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93867520483152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb25c021020 2024-09-12T00:19:10.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93867520483152] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb26527f9c0 20 remove_watcher() i=0 2024-09-12T00:19:10.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb26527f9c0 2 removed watcher, disabling cache 2024-09-12T00:19:10.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.257+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93867520489456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x555f3c363f10 2024-09-12T00:19:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93867520489456] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb26527f9c0 20 remove_watcher() i=1 2024-09-12T00:19:10.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93867520492864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x555f3c368750 2024-09-12T00:19:10.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb263586640 1 -- 172.21.15.66:0/2156721819 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93867520492864] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c057020 con 0x555f3c368750 2024-09-12T00:19:10.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb26527f9c0 20 remove_watcher() i=2 2024-09-12T00:19:10.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.261+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93867520496592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb25c021020 2024-09-12T00:19:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb262d85640 1 -- 172.21.15.66:0/2156721819 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93867520496592] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2540c7030 con 0x7fb25c021020 2024-09-12T00:19:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb26527f9c0 20 remove_watcher() i=3 2024-09-12T00:19:10.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93867520491664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x555f3c363f10 2024-09-12T00:19:10.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93867520491664] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x555f3c363f10 2024-09-12T00:19:10.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb26527f9c0 20 remove_watcher() i=4 2024-09-12T00:19:10.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.265+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93867520493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb2540f8040 2024-09-12T00:19:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93867520493920] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb26527f9c0 20 remove_watcher() i=5 2024-09-12T00:19:10.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93867520502896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb2540f8040 2024-09-12T00:19:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93867520502896] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb26527f9c0 20 remove_watcher() i=6 2024-09-12T00:19:10.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.269+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93867520503952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f3c3b1600 con 0x7fb2540f8040 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93867520503952] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c029040 con 0x7fb2540f8040 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 20 remove_watcher() i=7 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2540f8040 msgr2=0x7fb2540eb0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2540f8040 0x7fb2540eb0b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c363f10 msgr2=0x555f3c3663a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c363f10 0x555f3c3663a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb25c021020 msgr2=0x7fb25c02dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb25c021020 0x7fb25c02dad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c368750 msgr2=0x555f3c36ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c368750 0x555f3c36ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb12c039a70 msgr2=0x7fb12c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb12c039a70 0x7fb12c03bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb2540e9d60 tx=0x7fb2540dd000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb262584640 1 -- 172.21.15.66:0/2156721819 reap_dead start 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 msgr2=0x555f3c320cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0168f0 tx=0x7fb25c050040 comp rx=0 tx=0).stop 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 shutdown_connections 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/2156721819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c350320 0x555f3c320cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 >> 172.21.15.66:0/2156721819 conn(0x555f3c34b640 msgr2=0x555f3c349850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 shutdown_connections 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/2156721819 wait complete. 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 msgr2=0x7fb13c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 0x7fb13c03bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb2540bf900 tx=0x7fb2540bf3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 msgr2=0x555f3c342cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x555f3c328e10 tx=0x7fb25c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 shutdown_connections 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb13c039a70 0x7fb13c03bf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/4134324556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c342890 0x555f3c342cb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 >> 172.21.15.66:0/4134324556 conn(0x555f3c338240 msgr2=0x555f3c338620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 shutdown_connections 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/4134324556 wait complete. 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 msgr2=0x555f3c32ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 0x555f3c32ef50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 msgr2=0x555f3c333a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 0x555f3c333a90 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 msgr2=0x7fb14803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 0x7fb14803bf80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb24c004180 tx=0x7fb24c001340 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 msgr2=0x555f3c327de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb25401b4b0 tx=0x7fb254017d70 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 shutdown_connections 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f3c3316a0 0x555f3c333a90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f3c237550 0x555f3c32ef50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb148039ac0 0x7fb14803bf80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 --2- 172.21.15.66:0/943063800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f3c234370 0x555f3c327de0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 >> 172.21.15.66:0/943063800 conn(0x555f3c22fe90 msgr2=0x555f3c319e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 shutdown_connections 2024-09-12T00:19:10.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.273+0000 7fb26527f9c0 1 -- 172.21.15.66:0/943063800 wait complete. 2024-09-12T00:19:10.290 INFO:teuthology.orchestra.run.smithi066.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-12T00:19:10.256632Z","last_stats_update":"2024-09-12T00:19:10.254364Z"} 2024-09-12T00:19:10.290 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-12T00:19:10.256632Z', 'last_stats_update': '2024-09-12T00:19:10.254364Z'} 2024-09-12T00:19:10.299 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:10.299 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T00:19:10.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T00:19:10.299 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-12T00:19:10.367 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:10.367 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a5c869c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f4f43398c0 0x55f4f433bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a5c869c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4f41e79c0 con 0x55f4f4335770 2024-09-12T00:19:10.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a5c869c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f4f42376d0 con 0x55f4f43398c0 2024-09-12T00:19:10.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a2f8b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f4f43398c0 0x55f4f433bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a378c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55f4f4335770 0x55f4f4335b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42950/0 (socket says 172.21.15.66:42950) 2024-09-12T00:19:10.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a378c640 1 -- 172.21.15.66:0/4273202324 learned_addr learned my addr 172.21.15.66:0/4273202324 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:10.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a2f8b640 1 -- 172.21.15.66:0/4273202324 >> v1:172.21.15.31:6789/0 conn(0x55f4f4335770 legacy=0x55f4f4335b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.365+0000 7f00a2f8b640 1 -- 172.21.15.66:0/4273202324 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f41dbca0 con 0x55f4f43398c0 2024-09-12T00:19:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/4273202324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f43398c0 0x55f4f433bcb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f008c00a480 tx=0x7f008c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cada4d4658b2477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a278a640 1 -- 172.21.15.66:0/4273202324 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f008c0aa570 con 0x55f4f43398c0 2024-09-12T00:19:10.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a278a640 1 -- 172.21.15.66:0/4273202324 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c0af070 con 0x55f4f43398c0 2024-09-12T00:19:10.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a278a640 1 -- 172.21.15.66:0/4273202324 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f008c0aa860 con 0x55f4f43398c0 2024-09-12T00:19:10.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 -- 172.21.15.66:0/4273202324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f43398c0 msgr2=0x55f4f433bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/4273202324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f43398c0 0x55f4f433bcb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f008c00a480 tx=0x7f008c01b310 comp rx=0 tx=0).stop 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 -- 172.21.15.66:0/4273202324 shutdown_connections 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/4273202324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f43398c0 0x55f4f433bcb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 -- 172.21.15.66:0/4273202324 >> 172.21.15.66:0/4273202324 conn(0x55f4f42a9080 msgr2=0x55f4f42a9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 -- 172.21.15.66:0/4273202324 shutdown_connections 2024-09-12T00:19:10.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.369+0000 7f00a5c869c0 1 -- 172.21.15.66:0/4273202324 wait complete. 2024-09-12T00:19:10.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f4f423b680 con 0x55f4f4335770 2024-09-12T00:19:10.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a378c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a378c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45030/0 (socket says 172.21.15.66:45030) 2024-09-12T00:19:10.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a378c640 1 -- 172.21.15.66:0/1114385589 learned_addr learned my addr 172.21.15.66:0/1114385589 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a378c640 1 -- 172.21.15.66:0/1114385589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f41b6da0 con 0x55f4f4335770 2024-09-12T00:19:10.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a378c640 1 --2- 172.21.15.66:0/1114385589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0094001810 tx=0x7f0094001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150d87070201f445 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7eff9160a640 1 -- 172.21.15.66:0/1114385589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094004530 con 0x55f4f4335770 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7eff9160a640 1 -- 172.21.15.66:0/1114385589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940046d0 con 0x55f4f4335770 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7eff9160a640 1 -- 172.21.15.66:0/1114385589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00940049f0 con 0x55f4f4335770 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1114385589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 msgr2=0x55f4f44209b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1114385589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0094001810 tx=0x7f0094001cd0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1114385589 shutdown_connections 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1114385589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f44209b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1114385589 >> 172.21.15.66:0/1114385589 conn(0x55f4f42a9080 msgr2=0x55f4f441c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1114385589 shutdown_connections 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.385+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1114385589 wait complete. 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f4f41dda50 con 0x55f4f4335770 2024-09-12T00:19:10.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a378c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a378c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45038/0 (socket says 172.21.15.66:45038) 2024-09-12T00:19:10.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a378c640 1 -- 172.21.15.66:0/3156357839 learned_addr learned my addr 172.21.15.66:0/3156357839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a378c640 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f44285b0 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a378c640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0094000f90 tx=0x7f0094001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 -- 172.21.15.66:0/3156357839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094013820 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f4428840 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 -- 172.21.15.66:0/3156357839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940139c0 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 -- 172.21.15.66:0/3156357839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094013ce0 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f44291f0 con 0x55f4f4335770 2024-09-12T00:19:10.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 -- 172.21.15.66:0/3156357839 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0094010070 con 0x55f4f4335770 2024-09-12T00:19:10.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 0x7eff8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7eff8fe07640 1 -- 172.21.15.66:0/3156357839 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f0094018070 con 0x55f4f4335770 2024-09-12T00:19:10.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.389+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 0x7eff8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 0x55f4f442f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f442f700 con 0x55f4f43398c0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 0x55f4f442f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 0x7eff8803bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f008c0ae000 tx=0x7f008c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 0x55f4f442f1c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 -- 172.21.15.66:0/3156357839 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f009c0083f0 con 0x55f4f43398c0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f442fb30 con 0x55f4f43398c0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 -- 172.21.15.66:0/3156357839 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f009c0083f0 con 0x55f4f43398c0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 0x55f4f4433d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4434420 con 0x55f4f4431940 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a378c640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 0x55f4f4433d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a378c640 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 0x55f4f4433d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a378c640 1 -- 172.21.15.66:0/3156357839 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f009401b030 con 0x55f4f4431940 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44307e0 con 0x55f4f43398c0 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 -- 172.21.15.66:0/3156357839 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f009c0083f0 con 0x55f4f43398c0 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4430ca0 con 0x55f4f4431940 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a378c640 1 -- 172.21.15.66:0/3156357839 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f009401b030 con 0x55f4f4431940 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a5c869c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f4f4248450 con 0x55f4f4442b50 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.393+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45046/0 (socket says 172.21.15.66:45046) 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 -- 172.21.15.66:0/3508124666 learned_addr learned my addr 172.21.15.66:0/3508124666 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 -- 172.21.15.66:0/3508124666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f44435b0 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55f4f4429080 tx=0x7f009c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 -- 172.21.15.66:0/3508124666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c01c020 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f4443e10 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 -- 172.21.15.66:0/3508124666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c007d00 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 -- 172.21.15.66:0/3508124666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c018440 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f4444380 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 -- 172.21.15.66:0/3508124666 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f009c01f020 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 0x7eff7c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7eff8d602640 1 -- 172.21.15.66:0/3508124666 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f009c051db0 con 0x55f4f4442b50 2024-09-12T00:19:10.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a378c640 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 0x7eff7c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a378c640 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 0x7eff7c03bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f4f44347f0 tx=0x7f009404e8b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a5c869c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f4f4421200 con 0x55f4f444f470 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45060/0 (socket says 172.21.15.66:45060) 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.397+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1139996073 learned_addr learned my addr 172.21.15.66:0/1139996073 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1139996073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f444fe20 con 0x55f4f444f470 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/1139996073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f009c008fd0 tx=0x7f009c050240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9258f2bbd21b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff86ffd640 1 -- 172.21.15.66:0/1139996073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c021400 con 0x55f4f444f470 2024-09-12T00:19:10.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff86ffd640 1 -- 172.21.15.66:0/1139996073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c029c50 con 0x55f4f444f470 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff86ffd640 1 -- 172.21.15.66:0/1139996073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c0215a0 con 0x55f4f444f470 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1139996073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 msgr2=0x55f4f444f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1139996073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f009c008fd0 tx=0x7f009c050240 comp rx=0 tx=0).stop 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1139996073 shutdown_connections 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1139996073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f444f850 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1139996073 >> 172.21.15.66:0/1139996073 conn(0x55f4f444b8a0 msgr2=0x55f4f4449ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1139996073 shutdown_connections 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1139996073 wait complete. 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 Processor -- start 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- start start 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f4456960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f4f4450480 con 0x55f4f444f470 2024-09-12T00:19:10.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f4456960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f4456960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45074/0 (socket says 172.21.15.66:45074) 2024-09-12T00:19:10.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 learned_addr learned my addr 172.21.15.66:0/1136076788 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f4456ec0 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f4456960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f009c008fd0 tx=0x7f009c050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff857fa640 1 -- 172.21.15.66:0/1136076788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c038070 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f4457150 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff857fa640 1 -- 172.21.15.66:0/1136076788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c0289c0 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7eff857fa640 1 -- 172.21.15.66:0/1136076788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f009c028ca0 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.401+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f4457b00 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7eff857fa640 1 -- 172.21.15.66:0/1136076788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f009c03b070 con 0x55f4f444f470 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7eff857fa640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff6c039a70 0x7eff6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7eff857fa640 1 -- 172.21.15.66:0/1136076788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f009c034c30 con 0x55f4f444f470 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a378c640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff6c039a70 0x7eff6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f4461eb0 0x55f4f4464340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4464a90 con 0x55f4f4461eb0 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f4461eb0 0x55f4f4464340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a378c640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff6c039a70 0x7eff6c03bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0094028fd0 tx=0x7f0094041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f4461eb0 0x55f4f4464340 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 realm 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4464ec0 con 0x55f4f4461eb0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4465790 con 0x55f4f4461eb0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4465b30 con 0x55f4f4461eb0 2024-09-12T00:19:10.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4466890 0x55f4f4468c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44692d0 con 0x55f4f4466890 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.405+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4466890 0x55f4f4468c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4466890 0x55f4f4468c80 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a5c869c0 20 searching for the correct realm 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a3f8d640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f009c03d060 0x7f009c050800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a378c640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f009c03d060 0x7f009c050800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a378c640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f009c03d060 0x7f009c050800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a378c640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f009404e0f0 0x7f009401d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f009404e0f0 0x7f009401d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f009404e0f0 0x7f009401d530 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.409+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.413+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.417+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4466890 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009404e0f0 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x55f4f4461eb0 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ab30 con 0x7f009c03d060 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:10.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4469c20 con 0x55f4f4461eb0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.421+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446a470 con 0x55f4f4461eb0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4469860 con 0x55f4f4466890 2024-09-12T00:19:10.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 zone default found 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 4 Realm: () 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 zonegroup default 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446b410 con 0x7f009404e0f0 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446d650 con 0x55f4f4466890 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446d9f0 con 0x55f4f4466890 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 started sync module instance, tier type = 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:10.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ca90 con 0x7f009c03d060 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510558662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446d2a0 con 0x7f009c03d060 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.425+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446e4c0 con 0x55f4f4461eb0 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.429+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510558662272] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.429+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.429+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510558666768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446e8e0 con 0x55f4f4461eb0 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.429+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446f170 con 0x55f4f4466890 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.429+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510558666768] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510558667824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ed00 con 0x55f4f4466890 2024-09-12T00:19:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446fb80 con 0x7f009c03d060 2024-09-12T00:19:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510558672592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4470420 con 0x7f009c03d060 2024-09-12T00:19:10.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4470e20 con 0x55f4f4461eb0 2024-09-12T00:19:10.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510558667824] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510558672592] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510558668880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446ff70 con 0x55f4f4461eb0 2024-09-12T00:19:10.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.433+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44716c0 con 0x7f009404e0f0 2024-09-12T00:19:10.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.437+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510558668880] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.437+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.437+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510558677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44713e0 con 0x7f009404e0f0 2024-09-12T00:19:10.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.437+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4471c30 con 0x7f009404e0f0 2024-09-12T00:19:10.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510558677296] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510558679104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4471a30 con 0x7f009404e0f0 2024-09-12T00:19:10.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4472550 con 0x7f009404e0f0 2024-09-12T00:19:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510558679104] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510558683168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4472510 con 0x7f009404e0f0 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=0 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=1 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=2 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=3 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=4 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=5 2024-09-12T00:19:10.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.441+0000 7f00a5c869c0 20 add_watcher() i=6 2024-09-12T00:19:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510558683168] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0a8070 con 0x7f009404e0f0 2024-09-12T00:19:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 add_watcher() i=7 2024-09-12T00:19:10.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4475970 con 0x55f4f4461eb0 2024-09-12T00:19:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f008c0a8070 con 0x55f4f4461eb0 2024-09-12T00:19:10.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510558680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4472e90 con 0x55f4f4461eb0 2024-09-12T00:19:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510558680224] v31'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x55f4f4461eb0 2024-09-12T00:19:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7eff59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 5 note: GC not initialized 2024-09-12T00:19:10.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7eff58fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 Filter name: none 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7efed27fc640 20 reqs_thread_entry: start 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.445+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4498f80 con 0x55f4f4461eb0 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f008c0d5040 con 0x55f4f4461eb0 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:10.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f449b070 con 0x7f009c03d060 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f449c8d0 con 0x55f4f4466890 2024-09-12T00:19:10.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:10.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f449fad0 con 0x7f009c03d060 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 foo.buckets [call] v31'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f449ec70 con 0x7f009c03d060 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:10.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T00:19:10.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:10.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:10.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.449+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44a3f10 con 0x7f009c03d060 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a5c869c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a5c869c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a5c869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94510558869360 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4f44a13d0 con 0x7f009404e0f0 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify (1) cookie 94510558679104 notify 133143986178 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55f4f41dbca0 con 0x7f009404e0f0 2024-09-12T00:19:10.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7eff86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94510558679104 notifier 4480 bl.length()=338 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7eff86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7eff86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7eff86ffd640 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7eff68003eb0 con 0x7f009404e0f0 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(68 notify.6 [notify cookie 94510558869360 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f008c0d5040 con 0x7f009404e0f0 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x7f009404e0f0 2024-09-12T00:19:10.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.453+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify_complete (2) cookie 94510558869360 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f008c0d7650 con 0x7f009404e0f0 2024-09-12T00:19:10.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7eff59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510558680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x55f4f4461eb0 2024-09-12T00:19:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94510558680224] v31'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x55f4f4461eb0 2024-09-12T00:19:10.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510558662272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x7f009c03d060 2024-09-12T00:19:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94510558662272] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a5c869c0 20 remove_watcher() i=0 2024-09-12T00:19:10.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a5c869c0 2 removed watcher, disabling cache 2024-09-12T00:19:10.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.457+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510558666768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x55f4f4461eb0 2024-09-12T00:19:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94510558666768] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x55f4f4461eb0 2024-09-12T00:19:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a5c869c0 20 remove_watcher() i=1 2024-09-12T00:19:10.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510558667824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f446e010 con 0x55f4f4466890 2024-09-12T00:19:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a3f8d640 1 -- 172.21.15.66:0/1136076788 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94510558667824] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009c057060 con 0x55f4f4466890 2024-09-12T00:19:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a5c869c0 20 remove_watcher() i=2 2024-09-12T00:19:10.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.461+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510558672592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x7f009c03d060 2024-09-12T00:19:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a378c640 1 -- 172.21.15.66:0/1136076788 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94510558672592] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f009401b030 con 0x7f009c03d060 2024-09-12T00:19:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a5c869c0 20 remove_watcher() i=3 2024-09-12T00:19:10.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510558668880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x55f4f4461eb0 2024-09-12T00:19:10.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94510558668880] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x55f4f4461eb0 2024-09-12T00:19:10.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a5c869c0 20 remove_watcher() i=4 2024-09-12T00:19:10.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.465+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510558677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x7f009404e0f0 2024-09-12T00:19:10.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94510558677296] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x7f009404e0f0 2024-09-12T00:19:10.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a5c869c0 20 remove_watcher() i=5 2024-09-12T00:19:10.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510558679104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4496cb0 con 0x7f009404e0f0 2024-09-12T00:19:10.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94510558679104] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x7f009404e0f0 2024-09-12T00:19:10.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a5c869c0 20 remove_watcher() i=6 2024-09-12T00:19:10.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.469+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510558683168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4f4471040 con 0x7f009404e0f0 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94510558683168] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f008c0d5040 con 0x7f009404e0f0 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 20 remove_watcher() i=7 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f009404e0f0 msgr2=0x7f009401d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f009404e0f0 0x7f009401d530 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f4461eb0 msgr2=0x55f4f4464340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f4461eb0 0x55f4f4464340 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f009c03d060 msgr2=0x7f009c050800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f009c03d060 0x7f009c050800 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4466890 msgr2=0x55f4f4468c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4466890 0x55f4f4468c80 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff6c039a70 msgr2=0x7eff6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff6c039a70 0x7eff6c03bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0094028fd0 tx=0x7f0094041000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 msgr2=0x55f4f4456960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/1136076788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f444f470 0x55f4f4456960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f009c008fd0 tx=0x7f009c050090 comp rx=0 tx=0).stop 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a2f8b640 1 -- 172.21.15.66:0/1136076788 reap_dead start 2024-09-12T00:19:10.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 shutdown_connections 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 >> 172.21.15.66:0/1136076788 conn(0x55f4f444b8a0 msgr2=0x55f4f4449ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 shutdown_connections 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/1136076788 wait complete. 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 msgr2=0x7eff7c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 0x7eff7c03bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f4f44347f0 tx=0x7f009404e8b0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 msgr2=0x55f4f4442f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55f4f4429080 tx=0x7f009c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 shutdown_connections 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff7c039a70 0x7eff7c03bf30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3508124666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4442b50 0x55f4f4442f70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 >> 172.21.15.66:0/3508124666 conn(0x55f4f4438500 msgr2=0x55f4f44388e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 shutdown_connections 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3508124666 wait complete. 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 msgr2=0x55f4f442f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 0x55f4f442f1c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 msgr2=0x55f4f4433d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 0x55f4f4433d30 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 msgr2=0x7eff8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 0x7eff8803bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f008c0ae000 tx=0x7f008c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 msgr2=0x55f4f4428050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0094000f90 tx=0x7f0094001260 comp rx=0 tx=0).stop 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 shutdown_connections 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f4f4431940 0x55f4f4433d30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f4f43398c0 0x55f4f442f1c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7eff88039a70 0x7eff8803bf30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 --2- 172.21.15.66:0/3156357839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f4f4335770 0x55f4f4428050 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 >> 172.21.15.66:0/3156357839 conn(0x55f4f42a9080 msgr2=0x55f4f441b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 shutdown_connections 2024-09-12T00:19:10.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.473+0000 7f00a5c869c0 1 -- 172.21.15.66:0/3156357839 wait complete. 2024-09-12T00:19:10.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T00:19:10.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T00:19:10.490 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T00:19:10.573 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:10.573 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:10.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98f096b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c54aee46f0 0x55c54aee6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98f096b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c54ad949c0 con 0x55c54aee0550 2024-09-12T00:19:10.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98f096b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c54ade46d0 con 0x55c54aee46f0 2024-09-12T00:19:10.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98edc70640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c54aee46f0 0x55c54aee6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98ee471640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55c54aee0550 0x55c54aee0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42958/0 (socket says 172.21.15.66:42958) 2024-09-12T00:19:10.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.569+0000 7f98ee471640 1 -- 172.21.15.66:0/517602852 learned_addr learned my addr 172.21.15.66:0/517602852 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:10.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98edc70640 1 -- 172.21.15.66:0/517602852 >> v1:172.21.15.31:6789/0 conn(0x55c54aee0550 legacy=0x55c54aee0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98edc70640 1 -- 172.21.15.66:0/517602852 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54ad88ca0 con 0x55c54aee46f0 2024-09-12T00:19:10.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98edc70640 1 --2- 172.21.15.66:0/517602852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee46f0 0x55c54aee6ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f98d800a480 tx=0x7f98d801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedf27c25ddddd4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98ed46f640 1 -- 172.21.15.66:0/517602852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d80aa570 con 0x55c54aee46f0 2024-09-12T00:19:10.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98ed46f640 1 -- 172.21.15.66:0/517602852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d80af070 con 0x55c54aee46f0 2024-09-12T00:19:10.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98ed46f640 1 -- 172.21.15.66:0/517602852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d80aa860 con 0x55c54aee46f0 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 -- 172.21.15.66:0/517602852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee46f0 msgr2=0x55c54aee6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/517602852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee46f0 0x55c54aee6ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f98d800a480 tx=0x7f98d801b310 comp rx=0 tx=0).stop 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 -- 172.21.15.66:0/517602852 shutdown_connections 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/517602852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee46f0 0x55c54aee6ae0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 -- 172.21.15.66:0/517602852 >> 172.21.15.66:0/517602852 conn(0x55c54aedc070 msgr2=0x55c54aede490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 -- 172.21.15.66:0/517602852 shutdown_connections 2024-09-12T00:19:10.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.573+0000 7f98f096b9c0 1 -- 172.21.15.66:0/517602852 wait complete. 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98f096b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98f096b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c54ade8680 con 0x55c54aee0550 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98ee471640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98ee471640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45090/0 (socket says 172.21.15.66:45090) 2024-09-12T00:19:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.589+0000 7f98ee471640 1 -- 172.21.15.66:0/522520263 learned_addr learned my addr 172.21.15.66:0/522520263 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 -- 172.21.15.66:0/522520263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54ad63da0 con 0x55c54aee0550 2024-09-12T00:19:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 --2- 172.21.15.66:0/522520263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001e00 tx=0x7f98e000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a308caf620694188 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dc608640 1 -- 172.21.15.66:0/522520263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e0012020 con 0x55c54aee0550 2024-09-12T00:19:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dc608640 1 -- 172.21.15.66:0/522520263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e000e690 con 0x55c54aee0550 2024-09-12T00:19:10.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dc608640 1 -- 172.21.15.66:0/522520263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e000ea10 con 0x55c54aee0550 2024-09-12T00:19:10.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/522520263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 msgr2=0x55c54afcbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/522520263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001e00 tx=0x7f98e000b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/522520263 shutdown_connections 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/522520263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afcbaa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/522520263 >> 172.21.15.66:0/522520263 conn(0x55c54aedc070 msgr2=0x55c54afc76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/522520263 shutdown_connections 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/522520263 wait complete. 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c54ad8aa50 con 0x55c54aee0550 2024-09-12T00:19:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45106/0 (socket says 172.21.15.66:45106) 2024-09-12T00:19:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 -- 172.21.15.66:0/4031042852 learned_addr learned my addr 172.21.15.66:0/4031042852 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54afd35e0 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98ee471640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98e000b710 tx=0x7f98e0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dae05640 1 -- 172.21.15.66:0/4031042852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e0012030 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dae05640 1 -- 172.21.15.66:0/4031042852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e001a750 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c54afd3870 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.593+0000 7f97dae05640 1 -- 172.21.15.66:0/4031042852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e001aa70 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54afd4220 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f97dae05640 1 -- 172.21.15.66:0/4031042852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98e0015020 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f97dae05640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 0x7f97d403bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f97dae05640 1 -- 172.21.15.66:0/4031042852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98e0020030 con 0x55c54aee0550 2024-09-12T00:19:10.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98edc70640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 0x7f97d403bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 0x55c54afda5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54afdab10 con 0x55c54afd81e0 2024-09-12T00:19:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98eec72640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 0x55c54afda5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98edc70640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 0x7f97d403bfd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98d80ae000 tx=0x7f98d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98eec72640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 0x55c54afda5d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98eec72640 1 -- 172.21.15.66:0/4031042852 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98e800a4d0 con 0x55c54afd81e0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54afdaeb0 con 0x55c54afd81e0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98eec72640 1 -- 172.21.15.66:0/4031042852 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98e800a4d0 con 0x55c54afd81e0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 0x55c54afdf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54afdf780 con 0x55c54afdccc0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98ee471640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 0x55c54afdf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.597+0000 7f98ee471640 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 0x55c54afdf0b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98ee471640 1 -- 172.21.15.66:0/4031042852 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98e0008030 con 0x55c54afdccc0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54afdbb30 con 0x55c54afd81e0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 -- 172.21.15.66:0/4031042852 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98e800a4d0 con 0x55c54afd81e0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54afdc010 con 0x55c54afdccc0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98ee471640 1 -- 172.21.15.66:0/4031042852 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98e0008030 con 0x55c54afdccc0 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c54adf5450 con 0x55c54afedeb0 2024-09-12T00:19:10.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45118/0 (socket says 172.21.15.66:45118) 2024-09-12T00:19:10.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 -- 172.21.15.66:0/1408292067 learned_addr learned my addr 172.21.15.66:0/1408292067 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 -- 172.21.15.66:0/1408292067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54afee910 con 0x55c54afedeb0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98eec72640 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c54afd5180 tx=0x7f98e80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f97d3fff640 1 -- 172.21.15.66:0/1408292067 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e8013640 con 0x55c54afedeb0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c54afef170 con 0x55c54afedeb0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f97d3fff640 1 -- 172.21.15.66:0/1408292067 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e80137e0 con 0x55c54afedeb0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f97d3fff640 1 -- 172.21.15.66:0/1408292067 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e8013ac0 con 0x55c54afedeb0 2024-09-12T00:19:10.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.601+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54afef6e0 con 0x55c54afedeb0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d3fff640 1 -- 172.21.15.66:0/1408292067 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98e8011040 con 0x55c54afedeb0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d3fff640 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 0x7f97c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d3fff640 1 -- 172.21.15.66:0/1408292067 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98e800e040 con 0x55c54afedeb0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98ee471640 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 0x7f97c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98ee471640 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 0x7f97c803bf30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98e0016940 tx=0x7f98e0001580 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c54afcc2d0 con 0x55c54affa7f0 2024-09-12T00:19:10.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45134/0 (socket says 172.21.15.66:45134) 2024-09-12T00:19:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98eec72640 1 -- 172.21.15.66:0/1114616338 learned_addr learned my addr 172.21.15.66:0/1114616338 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98eec72640 1 -- 172.21.15.66:0/1114616338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54affb1a0 con 0x55c54affa7f0 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98eec72640 1 --2- 172.21.15.66:0/1114616338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f98e8016cd0 tx=0x7f98e8020880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d9541fa8dfcb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d1ffb640 1 -- 172.21.15.66:0/1114616338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e8021a90 con 0x55c54affa7f0 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d1ffb640 1 -- 172.21.15.66:0/1114616338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e8013c60 con 0x55c54affa7f0 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f97d1ffb640 1 -- 172.21.15.66:0/1114616338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e8021440 con 0x55c54affa7f0 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1114616338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 msgr2=0x55c54affabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1114616338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f98e8016cd0 tx=0x7f98e8020880 comp rx=0 tx=0).stop 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1114616338 shutdown_connections 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1114616338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54affabd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1114616338 >> 172.21.15.66:0/1114616338 conn(0x55c54aff6c20 msgr2=0x55c54aff4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1114616338 shutdown_connections 2024-09-12T00:19:10.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1114616338 wait complete. 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.605+0000 7f98f096b9c0 1 Processor -- start 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 -- start start 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54ae571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c54affb800 con 0x55c54affa7f0 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54ae571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98eec72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54ae571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45146/0 (socket says 172.21.15.66:45146) 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 learned_addr learned my addr 172.21.15.66:0/1427445539 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54ae57710 con 0x55c54affa7f0 2024-09-12T00:19:10.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98eec72640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54ae571b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98e8020b10 tx=0x7f98e8050800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 -- 172.21.15.66:0/1427445539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e80144f0 con 0x55c54affa7f0 2024-09-12T00:19:10.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c54ae55af0 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 -- 172.21.15.66:0/1427445539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e8020bd0 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 -- 172.21.15.66:0/1427445539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98e8020eb0 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54ae56000 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 -- 172.21.15.66:0/1427445539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98e801fa90 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97b8039a70 0x7f97b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f97bffff640 1 -- 172.21.15.66:0/1427445539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f98e8034c40 con 0x55c54affa7f0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98ee471640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97b8039a70 0x7f97b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54b00f410 0x55c54b0118a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b011ff0 con 0x55c54b00f410 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.609+0000 7f98edc70640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54b00f410 0x55c54b0118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97b8039a70 0x7f97b803bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001430 tx=0x7f98e0044000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54b00f410 0x55c54b0118a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 realm 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b012420 con 0x55c54b00f410 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b012cf0 con 0x55c54b00f410 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b013090 con 0x55c54b00f410 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54b013df0 0x55c54b0161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b016830 con 0x55c54b013df0 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54b013df0 0x55c54b0161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54b013df0 0x55c54b0161e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 20 searching for the correct realm 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f98e80129c0 0x7f98e8035630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f98e80129c0 0x7f98e8035630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f98e80129c0 0x7f98e8035630 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f98e0017050 0x7f98e0040320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.613+0000 7f98edc70640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f98e0017050 0x7f98e0040320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f98e0017050 0x7f98e0040320 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.617+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.621+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b013df0 2024-09-12T00:19:10.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.625+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e0017050 2024-09-12T00:19:10.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x55c54b00f410 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018090 con 0x7f98e80129c0 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:10.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0171b0 con 0x55c54b00f410 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b017a00 con 0x55c54b00f410 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0184c0 con 0x55c54b013df0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:10.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 zone default found 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 4 Realm: () 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 zonegroup default 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b018860 con 0x7f98e0017050 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01ab20 con 0x55c54b013df0 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01aec0 con 0x55c54b013df0 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:10.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.629+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b019f60 con 0x7f98e80129c0 2024-09-12T00:19:10.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94305855314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01b2b0 con 0x7f98e80129c0 2024-09-12T00:19:10.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01bb00 con 0x55c54b00f410 2024-09-12T00:19:10.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94305855314608] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94305855316864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01bba0 con 0x55c54b00f410 2024-09-12T00:19:10.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.633+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01c6c0 con 0x55c54b013df0 2024-09-12T00:19:10.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94305855324560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01c680 con 0x55c54b013df0 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01d5f0 con 0x7f98e80129c0 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94305855316864] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94305855328512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01da10 con 0x7f98e80129c0 2024-09-12T00:19:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01e3d0 con 0x55c54b00f410 2024-09-12T00:19:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94305855324560] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.637+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94305855328512] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94305855321680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01df20 con 0x55c54b00f410 2024-09-12T00:19:10.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01e7b0 con 0x7f98e0017050 2024-09-12T00:19:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94305855321680] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94305855326896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01e3d0 con 0x7f98e0017050 2024-09-12T00:19:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.641+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01f1c0 con 0x7f98e0017050 2024-09-12T00:19:10.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.645+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94305855326896] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.645+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.645+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94305855332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01f1c0 con 0x7f98e0017050 2024-09-12T00:19:10.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.645+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01fb80 con 0x7f98e0017050 2024-09-12T00:19:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.645+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94305855332608] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94305855335968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b01fb80 con 0x7f98e0017050 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=0 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=1 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=2 2024-09-12T00:19:10.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=3 2024-09-12T00:19:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=4 2024-09-12T00:19:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=5 2024-09-12T00:19:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=6 2024-09-12T00:19:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94305855335968] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80a8070 con 0x7f98e0017050 2024-09-12T00:19:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 20 add_watcher() i=7 2024-09-12T00:19:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b022e70 con 0x55c54b00f410 2024-09-12T00:19:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98d80a8070 con 0x55c54b00f410 2024-09-12T00:19:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.649+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94305855338560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b020110 con 0x55c54b00f410 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94305855338560] v31'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x55c54b00f410 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f97a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 5 note: GC not initialized 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f971f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:10.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 Filter name: none 2024-09-12T00:19:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f971d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b046590 con 0x7f98e0017050 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b044c30 con 0x7f98e0017050 2024-09-12T00:19:10.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:19:10.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.653+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b045760 con 0x7f98e0017050 2024-09-12T00:19:10.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98f096b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T00:19:10.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98f096b9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98f096b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T00:19:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94305855493104 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b04a240 con 0x7f98e0017050 2024-09-12T00:19:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify (1) cookie 94305855326896 notify 133143986179 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c54b049b80 con 0x7f98e0017050 2024-09-12T00:19:10.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(65 notify.5 [notify cookie 94305855493104 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f97d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94305855326896 notifier 4487 bl.length()=556 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f97d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f97d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f97d1ffb640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f97b4003eb0 con 0x7f98e0017050 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== watch-notify(notify_complete (2) cookie 94305855493104 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c54b045050 con 0x7f98e0017050 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.657+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b04a200 con 0x7f98e0017050 2024-09-12T00:19:10.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98f096b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:10.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98f096b9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98f096b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94305855511888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c54b04a170 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94305855324560 notify 133143986178 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c54ae55af0 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f97d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94305855324560 notifier 4487 bl.length()=177 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f97d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f97d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 notify.2 [notify cookie 94305855511888 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f97d1ffb640 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f97b4003eb0 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.661+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== watch-notify(notify_complete (2) cookie 94305855511888 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c54ae57710 con 0x55c54b013df0 2024-09-12T00:19:10.667 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T00:19:10.659440Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:10.659424Z","tags":[],"group_ids":[]} 2024-09-12T00:19:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f97a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94305855338560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x55c54b00f410 2024-09-12T00:19:10.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94305855338560] v31'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x55c54b00f410 2024-09-12T00:19:10.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94305855314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x7f98e80129c0 2024-09-12T00:19:10.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94305855314608] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98f096b9c0 20 remove_watcher() i=0 2024-09-12T00:19:10.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98f096b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:10.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.665+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94305855316864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x55c54b00f410 2024-09-12T00:19:10.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94305855316864] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x55c54b00f410 2024-09-12T00:19:10.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98f096b9c0 20 remove_watcher() i=1 2024-09-12T00:19:10.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94305855324560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x55c54b013df0 2024-09-12T00:19:10.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98eec72640 1 -- 172.21.15.66:0/1427445539 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94305855324560] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e8039020 con 0x55c54b013df0 2024-09-12T00:19:10.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98f096b9c0 20 remove_watcher() i=2 2024-09-12T00:19:10.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.669+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94305855328512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x7f98e80129c0 2024-09-12T00:19:10.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98ee471640 1 -- 172.21.15.66:0/1427445539 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94305855328512] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98e0008030 con 0x7f98e80129c0 2024-09-12T00:19:10.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98f096b9c0 20 remove_watcher() i=3 2024-09-12T00:19:10.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94305855321680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x55c54b00f410 2024-09-12T00:19:10.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94305855321680] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x55c54b00f410 2024-09-12T00:19:10.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98f096b9c0 20 remove_watcher() i=4 2024-09-12T00:19:10.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.673+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94305855326896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x7f98e0017050 2024-09-12T00:19:10.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94305855326896] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98f096b9c0 20 remove_watcher() i=5 2024-09-12T00:19:10.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94305855332608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x7f98e0017050 2024-09-12T00:19:10.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94305855332608] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98f096b9c0 20 remove_watcher() i=6 2024-09-12T00:19:10.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.677+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94305855335968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c54b0442a0 con 0x7f98e0017050 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94305855335968] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98d80d5040 con 0x7f98e0017050 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 20 remove_watcher() i=7 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f98e0017050 msgr2=0x7f98e0040320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f98e0017050 0x7f98e0040320 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54b00f410 msgr2=0x55c54b0118a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54b00f410 0x55c54b0118a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f98e80129c0 msgr2=0x7f98e8035630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f98e80129c0 0x7f98e8035630 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54b013df0 msgr2=0x55c54b0161e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54b013df0 0x55c54b0161e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97b8039a70 msgr2=0x7f97b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97b8039a70 0x7f97b803bf30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001430 tx=0x7f98e0044000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 msgr2=0x55c54ae571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1427445539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54affa7f0 0x55c54ae571b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98e8020b10 tx=0x7f98e8050800 comp rx=0 tx=0).stop 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 reap_dead start 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98edc70640 1 -- 172.21.15.66:0/1427445539 reap_dead start 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 shutdown_connections 2024-09-12T00:19:10.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 >> 172.21.15.66:0/1427445539 conn(0x55c54aff6c20 msgr2=0x55c54aff4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 shutdown_connections 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1427445539 wait complete. 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 msgr2=0x7f97c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 0x7f97c803bf30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98e0016940 tx=0x7f98e0001580 comp rx=0 tx=0).stop 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 msgr2=0x55c54afee2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c54afd5180 tx=0x7f98e80167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 shutdown_connections 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97c8039a70 0x7f97c803bf30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/1408292067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54afedeb0 0x55c54afee2d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 >> 172.21.15.66:0/1408292067 conn(0x55c54afe3860 msgr2=0x55c54afe3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 shutdown_connections 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/1408292067 wait complete. 2024-09-12T00:19:10.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 msgr2=0x55c54afda5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 0x55c54afda5d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 msgr2=0x55c54afdf0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 0x55c54afdf0b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 msgr2=0x7f97d403bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 0x7f97d403bfd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98d80ae000 tx=0x7f98d80a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 msgr2=0x55c54afd3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98e000b710 tx=0x7f98e0000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 shutdown_connections 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c54afdccc0 0x55c54afdf0b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c54afd81e0 0x55c54afda5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f97d4039b10 0x7f97d403bfd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 --2- 172.21.15.66:0/4031042852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c54aee0550 0x55c54afd3080 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 >> 172.21.15.66:0/4031042852 conn(0x55c54aedc070 msgr2=0x55c54afc6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 shutdown_connections 2024-09-12T00:19:10.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.681+0000 7f98f096b9c0 1 -- 172.21.15.66:0/4031042852 wait complete. 2024-09-12T00:19:10.698 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T00:19:10.659440Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:10.659424Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:10.706 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T00:19:10.713 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:10.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-12T00:19:10.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-12T00:19:10.713 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-12T00:19:10.771 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:10.771 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:10.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.765+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.765+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd861cb19c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5563a6bbe770 0x5563a6bbeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd861cb19c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563a6a709c0 con 0x5563a6bc18b0 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd861cb19c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5563a6ac06d0 con 0x5563a6bbe770 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85f7b7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5563a6bbe770 0x5563a6bbeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85efb6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5563a6bc18b0 0x5563a6bc3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42972/0 (socket says 172.21.15.66:42972) 2024-09-12T00:19:10.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85efb6640 1 -- 172.21.15.66:0/2079857896 learned_addr learned my addr 172.21.15.66:0/2079857896 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:10.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85f7b7640 1 -- 172.21.15.66:0/2079857896 >> v1:172.21.15.31:6789/0 conn(0x5563a6bc18b0 legacy=0x5563a6bc3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85f7b7640 1 -- 172.21.15.66:0/2079857896 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6a64ca0 con 0x5563a6bbe770 2024-09-12T00:19:10.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.769+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/2079857896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6bbeb50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd85000a480 tx=0x7fd85001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a5e6f85b31a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd85e7b5640 1 -- 172.21.15.66:0/2079857896 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500b0070 con 0x5563a6bbe770 2024-09-12T00:19:10.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd85e7b5640 1 -- 172.21.15.66:0/2079857896 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500ab540 con 0x5563a6bbe770 2024-09-12T00:19:10.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd85e7b5640 1 -- 172.21.15.66:0/2079857896 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500ab840 con 0x5563a6bbe770 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 -- 172.21.15.66:0/2079857896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 msgr2=0x5563a6bbeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/2079857896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6bbeb50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd85000a480 tx=0x7fd85001b280 comp rx=0 tx=0).stop 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 -- 172.21.15.66:0/2079857896 shutdown_connections 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/2079857896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6bbeb50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 -- 172.21.15.66:0/2079857896 >> 172.21.15.66:0/2079857896 conn(0x5563a6b32080 msgr2=0x5563a6b32490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 -- 172.21.15.66:0/2079857896 shutdown_connections 2024-09-12T00:19:10.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.773+0000 7fd861cb19c0 1 -- 172.21.15.66:0/2079857896 wait complete. 2024-09-12T00:19:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.785+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563a6ac4680 con 0x5563a6bbe770 2024-09-12T00:19:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45156/0 (socket says 172.21.15.66:45156) 2024-09-12T00:19:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1726780279 learned_addr learned my addr 172.21.15.66:0/1726780279 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1726780279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6a3fda0 con 0x5563a6bbe770 2024-09-12T00:19:10.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/1726780279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ae040 tx=0x7fd850003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35767b3b954fcbd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd74d60a640 1 -- 172.21.15.66:0/1726780279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500b0070 con 0x5563a6bbe770 2024-09-12T00:19:10.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd74d60a640 1 -- 172.21.15.66:0/1726780279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500b1040 con 0x5563a6bbe770 2024-09-12T00:19:10.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd74d60a640 1 -- 172.21.15.66:0/1726780279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500ab6f0 con 0x5563a6bbe770 2024-09-12T00:19:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1726780279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 msgr2=0x5563a6ca9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1726780279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ae040 tx=0x7fd850003030 comp rx=0 tx=0).stop 2024-09-12T00:19:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1726780279 shutdown_connections 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1726780279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6ca9a10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1726780279 >> 172.21.15.66:0/1726780279 conn(0x5563a6b32080 msgr2=0x5563a6ca56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1726780279 shutdown_connections 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1726780279 wait complete. 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd861cb19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563a6a66a50 con 0x5563a6bbe770 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45164/0 (socket says 172.21.15.66:45164) 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.789+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1866455876 learned_addr learned my addr 172.21.15.66:0/1866455876 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6cb1480 con 0x5563a6bbe770 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ae040 tx=0x7fd850018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 -- 172.21.15.66:0/1866455876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500b7480 con 0x5563a6bbe770 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563a6cb1710 con 0x5563a6bbe770 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563a6cb20c0 con 0x5563a6bbe770 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 -- 172.21.15.66:0/1866455876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500b7620 con 0x5563a6bbe770 2024-09-12T00:19:10.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 -- 172.21.15.66:0/1866455876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500ce060 con 0x5563a6bbe770 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 -- 172.21.15.66:0/1866455876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd8500b7900 con 0x5563a6bbe770 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 0x7fd74403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd74be07640 1 -- 172.21.15.66:0/1866455876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd8500bc070 con 0x5563a6bbe770 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85efb6640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 0x7fd74403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 0x5563a6cb8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cb85d0 con 0x5563a6bc18b0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 0x5563a6cb8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85efb6640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 0x7fd74403bf80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd854001d80 tx=0x7fd8540012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 0x5563a6cb8090 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd85ffb8640 1 -- 172.21.15.66:0/1866455876 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85800a4d0 con 0x5563a6bc18b0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.793+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cb8990 con 0x5563a6bc18b0 2024-09-12T00:19:10.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 -- 172.21.15.66:0/1866455876 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd85800a4d0 con 0x5563a6bc18b0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 0x5563a6cbcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cbd280 con 0x5563a6cba7a0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 0x5563a6cbcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 0x5563a6cbcb90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1866455876 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8500c7070 con 0x5563a6cba7a0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cb9640 con 0x5563a6bc18b0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 -- 172.21.15.66:0/1866455876 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd85800a4d0 con 0x5563a6bc18b0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cb9b20 con 0x5563a6cba7a0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85f7b7640 1 -- 172.21.15.66:0/1866455876 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8500c7070 con 0x5563a6cba7a0 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563a6ad1450 con 0x5563a6ccb9b0 2024-09-12T00:19:10.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45166/0 (socket says 172.21.15.66:45166) 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 -- 172.21.15.66:0/30410629 learned_addr learned my addr 172.21.15.66:0/30410629 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 -- 172.21.15.66:0/30410629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6ccc410 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x5563a6cb1e30 tx=0x7fd8580163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd749602640 1 -- 172.21.15.66:0/30410629 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd858013450 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563a6cccc70 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd749602640 1 -- 172.21.15.66:0/30410629 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8580135f0 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd749602640 1 -- 172.21.15.66:0/30410629 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8580138d0 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.797+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563a6ccd1e0 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd749602640 1 -- 172.21.15.66:0/30410629 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd858011040 con 0x5563a6ccb9b0 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd749602640 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 0x7fd73803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd749602640 1 -- 172.21.15.66:0/30410629 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd85800e040 con 0x5563a6ccb9b0 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 0x7fd73803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 0x7fd73803bf80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5563a6cb23e0 tx=0x7fd850000bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd861cb19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd861cb19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563a6caa180 con 0x5563a6cd9360 2024-09-12T00:19:10.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45178/0 (socket says 172.21.15.66:45178) 2024-09-12T00:19:10.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85ffb8640 1 -- 172.21.15.66:0/1315307927 learned_addr learned my addr 172.21.15.66:0/1315307927 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85ffb8640 1 -- 172.21.15.66:0/1315307927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6cd9d30 con 0x5563a6cd9360 2024-09-12T00:19:10.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/1315307927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd8580508d0 tx=0x7fd85801f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edc9746cd2e776d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd742ffd640 1 -- 172.21.15.66:0/1315307927 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85804d020 con 0x5563a6cd9360 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd742ffd640 1 -- 172.21.15.66:0/1315307927 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85802a960 con 0x5563a6cd9360 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.801+0000 7fd742ffd640 1 -- 172.21.15.66:0/1315307927 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85802a440 con 0x5563a6cd9360 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1315307927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 msgr2=0x5563a6cd9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1315307927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd8580508d0 tx=0x7fd85801f450 comp rx=0 tx=0).stop 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1315307927 shutdown_connections 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1315307927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cd9740 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1315307927 >> 172.21.15.66:0/1315307927 conn(0x5563a6cd4720 msgr2=0x5563a6cd2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1315307927 shutdown_connections 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1315307927 wait complete. 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 Processor -- start 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- start start 2024-09-12T00:19:10.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563a6cd8250 con 0x5563a6cd9360 2024-09-12T00:19:10.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd85ffb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45180/0 (socket says 172.21.15.66:45180) 2024-09-12T00:19:10.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 learned_addr learned my addr 172.21.15.66:0/308479715 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563a6cdfd30 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd85804f720 tx=0x7fd858050830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd7417fa640 1 -- 172.21.15.66:0/308479715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd858052300 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563a6cdffc0 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd7417fa640 1 -- 172.21.15.66:0/308479715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8580125c0 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd7417fa640 1 -- 172.21.15.66:0/308479715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85801fc10 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563a6ce0970 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.805+0000 7fd7417fa640 1 -- 172.21.15.66:0/308479715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd858029ba0 con 0x5563a6cd9360 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd7417fa640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd728039a70 0x7fd72803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd7417fa640 1 -- 172.21.15.66:0/308479715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd858048040 con 0x5563a6cd9360 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd728039a70 0x7fd72803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6ceaef0 0x5563a6ced380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cedad0 con 0x5563a6ceaef0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6ceaef0 0x5563a6ced380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd728039a70 0x7fd72803bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8500aa760 tx=0x7fd8500de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6ceaef0 0x5563a6ced380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85400e5a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 realm 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cea2a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85400e5a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cee5d0 con 0x5563a6ceaef0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85400e5a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6ceeea0 con 0x5563a6ceaef0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd85400e5a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cef7a0 0x5563a6cf1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf22d0 con 0x5563a6cef7a0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cef7a0 0x5563a6cf1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cef7a0 0x5563a6cf1b90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 20 searching for the correct realm 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd858013070 0x7fd8580149c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd858013070 0x7fd8580149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd858013070 0x7fd8580149c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd8500ab030 0x7fd8500ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.809+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd8500ab030 0x7fd8500ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd8500ab030 0x7fd8500ec8c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85400e5a0 con 0x7fd8500ab030 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85400e5a0 con 0x5563a6ceaef0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.813+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.817+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd858038020 con 0x5563a6cef7a0 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6cef7a0 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd8500ab030 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x5563a6ceaef0 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.821+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3b30 con 0x7fd858013070 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:10.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf2c50 con 0x5563a6ceaef0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf34f0 con 0x5563a6ceaef0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf2890 con 0x5563a6cef7a0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 zone default found 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 4 Realm: () 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 zonegroup default 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf3110 con 0x7fd8500ab030 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf5f50 con 0x5563a6cef7a0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf6400 con 0x5563a6cef7a0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 started sync module instance, tier type = 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:10.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf53c0 con 0x7fd858013070 2024-09-12T00:19:10.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886488729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf5020 con 0x7fd858013070 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.825+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf7330 con 0x5563a6ceaef0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.829+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886488729520] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.829+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.829+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886488735360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf7750 con 0x5563a6ceaef0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.829+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf8110 con 0x5563a6cef7a0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886488735360] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886488736688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf8110 con 0x5563a6cef7a0 2024-09-12T00:19:10.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf8ad0 con 0x7fd858013070 2024-09-12T00:19:10.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886488741408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf9320 con 0x7fd858013070 2024-09-12T00:19:10.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf9d20 con 0x5563a6ceaef0 2024-09-12T00:19:10.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886488736688] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886488741408] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886488738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf8e70 con 0x5563a6ceaef0 2024-09-12T00:19:10.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.833+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfa5c0 con 0x7fd8500ab030 2024-09-12T00:19:10.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886488738912] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886488746032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cf8e70 con 0x7fd8500ab030 2024-09-12T00:19:10.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfaab0 con 0x7fd8500ab030 2024-09-12T00:19:10.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886488746032] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.837+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886488749440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfaa70 con 0x7fd8500ab030 2024-09-12T00:19:10.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfb470 con 0x7fd8500ab030 2024-09-12T00:19:10.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886488749440] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886488747792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfb430 con 0x7fd8500ab030 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=0 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=1 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=2 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=3 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=4 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=5 2024-09-12T00:19:10.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.841+0000 7fd861cb19c0 20 add_watcher() i=6 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886488747792] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 add_watcher() i=7 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfe860 con 0x5563a6ceaef0 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886488752464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6cfbdb0 con 0x5563a6ceaef0 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886488752464] v31'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 5 note: GC not initialized 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd714fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 Filter name: none 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd68e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d219c0 con 0x7fd858013070 2024-09-12T00:19:10.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:10.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:10.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.845+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886488752464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x5563a6ceaef0 2024-09-12T00:19:10.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93886488752464] v31'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886488729520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x7fd858013070 2024-09-12T00:19:10.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93886488729520] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd861cb19c0 20 remove_watcher() i=0 2024-09-12T00:19:10.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd861cb19c0 2 removed watcher, disabling cache 2024-09-12T00:19:10.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.849+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886488735360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x5563a6ceaef0 2024-09-12T00:19:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93886488735360] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 20 remove_watcher() i=1 2024-09-12T00:19:10.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886488736688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x5563a6cef7a0 2024-09-12T00:19:10.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd85ffb8640 1 -- 172.21.15.66:0/308479715 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93886488736688] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85806b040 con 0x5563a6cef7a0 2024-09-12T00:19:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 20 remove_watcher() i=2 2024-09-12T00:19:10.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886488741408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x7fd858013070 2024-09-12T00:19:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd85f7b7640 1 -- 172.21.15.66:0/308479715 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93886488741408] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8500c7070 con 0x7fd858013070 2024-09-12T00:19:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 20 remove_watcher() i=3 2024-09-12T00:19:10.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.853+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886488738912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x5563a6ceaef0 2024-09-12T00:19:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93886488738912] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x5563a6ceaef0 2024-09-12T00:19:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd861cb19c0 20 remove_watcher() i=4 2024-09-12T00:19:10.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886488746032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x7fd8500ab030 2024-09-12T00:19:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93886488746032] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd861cb19c0 20 remove_watcher() i=5 2024-09-12T00:19:10.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.857+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886488749440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x7fd8500ab030 2024-09-12T00:19:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93886488749440] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 20 remove_watcher() i=6 2024-09-12T00:19:10.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886488747792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563a6d1f850 con 0x7fd8500ab030 2024-09-12T00:19:10.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93886488747792] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd854029040 con 0x7fd8500ab030 2024-09-12T00:19:10.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 20 remove_watcher() i=7 2024-09-12T00:19:10.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd8500ab030 msgr2=0x7fd8500ec8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd8500ab030 0x7fd8500ec8c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6ceaef0 msgr2=0x5563a6ced380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6ceaef0 0x5563a6ced380 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd858013070 msgr2=0x7fd8580149c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd858013070 0x7fd8580149c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cef7a0 msgr2=0x5563a6cf1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cef7a0 0x5563a6cf1b90 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd728039a70 msgr2=0x7fd72803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd728039a70 0x7fd72803bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8500aa760 tx=0x7fd8500de000 comp rx=0 tx=0).stop 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 msgr2=0x5563a6cdf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd85804f720 tx=0x7fd858050830 comp rx=0 tx=0).stop 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd85efb6640 1 -- 172.21.15.66:0/308479715 reap_dead start 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 shutdown_connections 2024-09-12T00:19:10.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/308479715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6cd9360 0x5563a6cdf7d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 >> 172.21.15.66:0/308479715 conn(0x5563a6cd4720 msgr2=0x5563a6cd2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 shutdown_connections 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.861+0000 7fd861cb19c0 1 -- 172.21.15.66:0/308479715 wait complete. 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 msgr2=0x7fd73803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 0x7fd73803bf80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5563a6cb23e0 tx=0x7fd850000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 msgr2=0x5563a6ccbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x5563a6cb1e30 tx=0x7fd8580163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 shutdown_connections 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd738039ac0 0x7fd73803bf80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/30410629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6ccb9b0 0x5563a6ccbdd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 >> 172.21.15.66:0/30410629 conn(0x5563a6cc1360 msgr2=0x5563a6cc1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 shutdown_connections 2024-09-12T00:19:10.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/30410629 wait complete. 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 msgr2=0x5563a6cb8090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 0x5563a6cb8090 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 msgr2=0x5563a6cbcb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 0x5563a6cbcb90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 msgr2=0x7fd74403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 0x7fd74403bf80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd854001d80 tx=0x7fd8540012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 msgr2=0x5563a6cb0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd8500ae040 tx=0x7fd850018020 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 shutdown_connections 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5563a6cba7a0 0x5563a6cbcb90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5563a6bc18b0 0x5563a6cb8090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd744039ac0 0x7fd74403bf80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 --2- 172.21.15.66:0/1866455876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563a6bbe770 0x5563a6cb0f20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 >> 172.21.15.66:0/1866455876 conn(0x5563a6b32080 msgr2=0x5563a6ca4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 shutdown_connections 2024-09-12T00:19:10.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.865+0000 7fd861cb19c0 1 -- 172.21.15.66:0/1866455876 wait complete. 2024-09-12T00:19:10.878 INFO:teuthology.orchestra.run.smithi066.stdout:{"key":"bucket:myfoo","ver":{"tag":"_JcbRT8D5MQeBJ3ngVbvIQ30","ver":2},"mtime":"2024-09-12T00:19:10.456107Z","data":{"bucket":{"name":"myfoo","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","bucket_id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-12T00:19:08.903952Z","linked":false,"has_bucket_info":false}} 2024-09-12T00:19:10.878 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_JcbRT8D5MQeBJ3ngVbvIQ30', 'ver': 2}, 'mtime': '2024-09-12T00:19:10.456107Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'bucket_id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-12T00:19:08.903952Z', 'linked': False, 'has_bucket_info': False}} 2024-09-12T00:19:10.878 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1'] 2024-09-12T00:19:10.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1'] 2024-09-12T00:19:10.878 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:10.953 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:10.953 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:10.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7e6d59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55729f154520 0x55729f1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7e6d59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55729f0919c0 con 0x55729f153ff0 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7e6d59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55729f0e16d0 con 0x55729f154520 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7b9da640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55729f154520 0x55729f1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7c1db640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55729f153ff0 0x55729f152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42980/0 (socket says 172.21.15.66:42980) 2024-09-12T00:19:10.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7c1db640 1 -- 172.21.15.66:0/3519086169 learned_addr learned my addr 172.21.15.66:0/3519086169 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:10.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7b1d9640 1 -- 172.21.15.66:0/3519086169 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241513866 0 0) 0x55729f0919c0 con 0x55729f153ff0 2024-09-12T00:19:10.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7b1d9640 1 -- 172.21.15.66:0/3519086169 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d64001e20 con 0x55729f153ff0 2024-09-12T00:19:10.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7b9da640 1 -- 172.21.15.66:0/3519086169 >> v1:172.21.15.31:6789/0 conn(0x55729f153ff0 legacy=0x55729f152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.949+0000 7f2d7b9da640 1 -- 172.21.15.66:0/3519086169 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f085ca0 con 0x55729f154520 2024-09-12T00:19:10.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/3519086169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f154520 0x55729f1530a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000a480 tx=0x7f2d7001b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1bd05a65aa523c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7b1d9640 1 -- 172.21.15.66:0/3519086169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d700af070 con 0x55729f154520 2024-09-12T00:19:10.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7b1d9640 1 -- 172.21.15.66:0/3519086169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d700aa570 con 0x55729f154520 2024-09-12T00:19:10.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7b1d9640 1 -- 172.21.15.66:0/3519086169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d700aa850 con 0x55729f154520 2024-09-12T00:19:10.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3519086169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f154520 msgr2=0x55729f1530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/3519086169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f154520 0x55729f1530a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000a480 tx=0x7f2d7001b220 comp rx=0 tx=0).stop 2024-09-12T00:19:10.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3519086169 shutdown_connections 2024-09-12T00:19:10.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/3519086169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f154520 0x55729f1530a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3519086169 >> 172.21.15.66:0/3519086169 conn(0x55729f1d8fd0 msgr2=0x55729f1db3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3519086169 shutdown_connections 2024-09-12T00:19:10.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.953+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3519086169 wait complete. 2024-09-12T00:19:10.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55729f0e5680 con 0x55729f153ff0 2024-09-12T00:19:10.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7c1db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7c1db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45202/0 (socket says 172.21.15.66:45202) 2024-09-12T00:19:10.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2202670158 learned_addr learned my addr 172.21.15.66:0/2202670158 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2202670158 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f060da0 con 0x55729f153ff0 2024-09-12T00:19:10.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2202670158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2d740016a0 tx=0x7f2d74001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96112ed0abeee0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2c6a60c640 1 -- 172.21.15.66:0/2202670158 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d74004530 con 0x55729f153ff0 2024-09-12T00:19:10.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2c6a60c640 1 -- 172.21.15.66:0/2202670158 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d740046d0 con 0x55729f153ff0 2024-09-12T00:19:10.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2c6a60c640 1 -- 172.21.15.66:0/2202670158 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d740049f0 con 0x55729f153ff0 2024-09-12T00:19:10.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2202670158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 msgr2=0x55729f2cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2202670158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2d740016a0 tx=0x7f2d74001b60 comp rx=0 tx=0).stop 2024-09-12T00:19:10.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2202670158 shutdown_connections 2024-09-12T00:19:10.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2202670158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2cab90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2202670158 >> 172.21.15.66:0/2202670158 conn(0x55729f1d8fd0 msgr2=0x55729f2c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2202670158 shutdown_connections 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2202670158 wait complete. 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.969+0000 7f2d7e6d59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55729f087a50 con 0x55729f153ff0 2024-09-12T00:19:10.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c1db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c1db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45212/0 (socket says 172.21.15.66:45212) 2024-09-12T00:19:10.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c1db640 1 -- 172.21.15.66:0/4013478412 learned_addr learned my addr 172.21.15.66:0/4013478412 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c1db640 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f2d26f0 con 0x55729f153ff0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d74001ba0 tx=0x7f2d74004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 -- 172.21.15.66:0/4013478412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d74013760 con 0x55729f153ff0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55729f2d2980 con 0x55729f153ff0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 -- 172.21.15.66:0/4013478412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74013900 con 0x55729f153ff0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 -- 172.21.15.66:0/4013478412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d74013c00 con 0x55729f153ff0 2024-09-12T00:19:10.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729f2d3330 con 0x55729f153ff0 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 -- 172.21.15.66:0/4013478412 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d74010070 con 0x55729f153ff0 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 0x7f2c6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2c68e09640 1 -- 172.21.15.66:0/4013478412 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2d74018070 con 0x55729f153ff0 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 0x7f2c6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 0x55729f2d9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f2d9840 con 0x55729f154520 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 0x55729f2d9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 0x7f2c6403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ac000 tx=0x7f2d700a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 0x55729f2d9300 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/4013478412 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d6c0083f0 con 0x55729f154520 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.973+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f2d36a0 con 0x55729f154520 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/4013478412 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d6c0083f0 con 0x55729f154520 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 0x55729f2ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f2de610 con 0x55729f2dbb30 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 0x55729f2ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 0x55729f2ddf20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c1db640 1 -- 172.21.15.66:0/4013478412 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d7401b030 con 0x55729f2dbb30 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f2da9d0 con 0x55729f154520 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/4013478412 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d6c0083f0 con 0x55729f154520 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f2daeb0 con 0x55729f2dbb30 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c1db640 1 -- 172.21.15.66:0/4013478412 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d7401b030 con 0x55729f2dbb30 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55729f0f2450 con 0x55729f2ecd60 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45216/0 (socket says 172.21.15.66:45216) 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/762902905 learned_addr learned my addr 172.21.15.66:0/762902905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/762902905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f2ed7c0 con 0x55729f2ecd60 2024-09-12T00:19:10.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55729f2d3520 tx=0x7f2d6c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2c61ffb640 1 -- 172.21.15.66:0/762902905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c01c020 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55729f2ee020 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2c61ffb640 1 -- 172.21.15.66:0/762902905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c007d20 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2c61ffb640 1 -- 172.21.15.66:0/762902905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c018440 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.977+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729f2ee590 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c61ffb640 1 -- 172.21.15.66:0/762902905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d6c01f020 con 0x55729f2ecd60 2024-09-12T00:19:10.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c61ffb640 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 0x7f2c5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c61ffb640 1 -- 172.21.15.66:0/762902905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2d6c051d40 con 0x55729f2ecd60 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 0x7f2c5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 0x7f2c5403bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55729f2d9cd0 tx=0x7f2d7404e900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55729f2cb3c0 con 0x55729f2fa6f0 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45222/0 (socket says 172.21.15.66:45222) 2024-09-12T00:19:10.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/3822517901 learned_addr learned my addr 172.21.15.66:0/3822517901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/3822517901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f2fb0c0 con 0x55729f2fa6f0 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/3822517901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0500c0 tx=0x7f2d6c016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c40903054ae2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c5b7fe640 1 -- 172.21.15.66:0/3822517901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c021530 con 0x55729f2fa6f0 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c5b7fe640 1 -- 172.21.15.66:0/3822517901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c018b50 con 0x55729f2fa6f0 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2c5b7fe640 1 -- 172.21.15.66:0/3822517901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c029350 con 0x55729f2fa6f0 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3822517901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 msgr2=0x55729f2faad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:10.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.981+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/3822517901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0500c0 tx=0x7f2d6c016970 comp rx=0 tx=0).stop 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3822517901 shutdown_connections 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/3822517901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f2faad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3822517901 >> 172.21.15.66:0/3822517901 conn(0x55729f2f5ab0 msgr2=0x55729f2f3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3822517901 shutdown_connections 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/3822517901 wait complete. 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 Processor -- start 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- start start 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55729f2f95e0 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c9dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45226/0 (socket says 172.21.15.66:45226) 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 learned_addr learned my addr 172.21.15.66:0/2440710830 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729f3010d0 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c016fd0 tx=0x7f2d6c050020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 -- 172.21.15.66:0/2440710830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c039070 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55729f301360 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 -- 172.21.15.66:0/2440710830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c029c70 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 -- 172.21.15.66:0/2440710830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d6c016b10 con 0x55729f2fa6f0 2024-09-12T00:19:10.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729f301d10 con 0x55729f2fa6f0 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 -- 172.21.15.66:0/2440710830 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2d6c03c070 con 0x55729f2fa6f0 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c4c039a70 0x7f2c4c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2c59ffb640 1 -- 172.21.15.66:0/2440710830 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2d6c031070 con 0x55729f2fa6f0 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.985+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c4c039a70 0x7f2c4c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f30c120 0x55729f30e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f30ed00 con 0x55729f30c120 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f30c120 0x55729f30e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c4c039a70 0x7f2c4c03bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d74010cc0 tx=0x7f2d74036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f30c120 0x55729f30e5b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 realm 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f30f0d0 con 0x55729f30c120 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:10.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f30f9a0 con 0x55729f30c120 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f30fd40 con 0x55729f30c120 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f310aa0 0x55729f312e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f3134a0 con 0x55729f310aa0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f310aa0 0x55729f312e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:10.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f310aa0 0x55729f312e90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 20 searching for the correct realm 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2d6c021020 0x7f2d6c0539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2d6c021020 0x7f2d6c0539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2d6c021020 0x7f2d6c0539f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2d740283d0 0x7f2d74041400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.989+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2d740283d0 0x7f2d74041400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2d740283d0 0x7f2d74041400 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.993+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:10.997+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f310aa0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d740283d0 2024-09-12T00:19:11.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x55729f30c120 2024-09-12T00:19:11.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55729f314d70 con 0x7f2d6c021020 2024-09-12T00:19:11.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f313ef0 con 0x55729f30c120 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.001+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f314790 con 0x55729f30c120 2024-09-12T00:19:11.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f315110 con 0x55729f310aa0 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 zone default found 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 4 Realm: () 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 zonegroup default 2024-09-12T00:19:11.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f3154f0 con 0x7f2d740283d0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f3177d0 con 0x55729f310aa0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f3177d0 con 0x55729f310aa0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 started sync module instance, tier type = 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f316c60 con 0x7f2d6c021020 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93950785450064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f317c00 con 0x7f2d6c021020 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.005+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f318450 con 0x55729f30c120 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93950785450064] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93950785451120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f318130 con 0x55729f30c120 2024-09-12T00:19:11.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f318c50 con 0x55729f310aa0 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93950785455904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f318c10 con 0x55729f310aa0 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f319bb0 con 0x7f2d6c021020 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.009+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93950785451120] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93950785453056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f319bb0 con 0x7f2d6c021020 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31a5c0 con 0x55729f30c120 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93950785455904] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93950785453056] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93950785458240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31a110 con 0x55729f30c120 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.013+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31a9a0 con 0x7f2d740283d0 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93950785458240] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93950785459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31a5c0 con 0x7f2d740283d0 2024-09-12T00:19:11.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31a5c0 con 0x7f2d740283d0 2024-09-12T00:19:11.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93950785459856] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93950785462816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31b3b0 con 0x7f2d740283d0 2024-09-12T00:19:11.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.017+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31bd70 con 0x7f2d740283d0 2024-09-12T00:19:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93950785468608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31c190 con 0x7f2d740283d0 2024-09-12T00:19:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=0 2024-09-12T00:19:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=1 2024-09-12T00:19:11.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=2 2024-09-12T00:19:11.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=3 2024-09-12T00:19:11.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=4 2024-09-12T00:19:11.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=5 2024-09-12T00:19:11.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93950785462816] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=6 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93950785468608] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700a8070 con 0x7f2d740283d0 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 20 add_watcher() i=7 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f31af60 con 0x55729f30c120 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d700a8070 con 0x55729f30c120 2024-09-12T00:19:11.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.021+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93950785466208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f31c6a0 con 0x55729f30c120 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93950785466208] v31'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x55729f30c120 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2c327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 5 note: GC not initialized 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2c317e2640 20 reqs_thread_entry: start 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:11.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 Filter name: none 2024-09-12T00:19:11.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2baaffd640 20 reqs_thread_entry: start 2024-09-12T00:19:11.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:11.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f3427a0 con 0x7f2d740283d0 2024-09-12T00:19:11.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f344890 con 0x7f2d6c021020 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f346290 con 0x55729f310aa0 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:11.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.025+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a510 con 0x7f2d6c021020 2024-09-12T00:19:11.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f350880 con 0x55729f310aa0 2024-09-12T00:19:11.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v31'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:11.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93950785643008 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f34ae40 con 0x7f2d740283d0 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== watch-notify(notify (1) cookie 93950785462816 notify 133143986180 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55729f085ca0 con 0x7f2d740283d0 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2c5b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 93950785462816 notifier 4501 bl.length()=760 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2c5b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2c5b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2c5b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2c5b7fe640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2c40003eb0 con 0x7f2d740283d0 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.029+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(67 notify.6 [notify cookie 93950785643008 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== watch-notify(notify_complete (2) cookie 93950785643008 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2d700b79f0 con 0x7f2d740283d0 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f344620 con 0x7f2d740283d0 2024-09-12T00:19:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(69 fud.buckets [call] v31'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.033+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d6c021020 2024-09-12T00:19:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7e6d59c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7e6d59c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7e6d59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:11.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93950785643008 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d740283d0 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== watch-notify(notify (1) cookie 93950785462816 notify 133143986181 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f2d700b7c90 con 0x7f2d740283d0 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2c5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 93950785462816 notifier 4501 bl.length()=314 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2c5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2c5affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2c5affd640 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2bb0003410 con 0x7f2d740283d0 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(71 notify.6 [notify cookie 93950785643008 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== watch-notify(notify_complete (2) cookie 93950785643008 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2d700d9570 con 0x7f2d740283d0 2024-09-12T00:19:11.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2c327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.037+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93950785466208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x55729f30c120 2024-09-12T00:19:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93950785466208] v31'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x55729f30c120 2024-09-12T00:19:11.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93950785450064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d6c021020 2024-09-12T00:19:11.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93950785450064] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 20 remove_watcher() i=0 2024-09-12T00:19:11.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 2 removed watcher, disabling cache 2024-09-12T00:19:11.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93950785451120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x55729f30c120 2024-09-12T00:19:11.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93950785451120] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x55729f30c120 2024-09-12T00:19:11.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 20 remove_watcher() i=1 2024-09-12T00:19:11.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.041+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93950785455904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x55729f310aa0 2024-09-12T00:19:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7c9dc640 1 -- 172.21.15.66:0/2440710830 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93950785455904] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d6c03b030 con 0x55729f310aa0 2024-09-12T00:19:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7e6d59c0 20 remove_watcher() i=2 2024-09-12T00:19:11.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93950785453056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d6c021020 2024-09-12T00:19:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7c1db640 1 -- 172.21.15.66:0/2440710830 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93950785453056] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7401b030 con 0x7f2d6c021020 2024-09-12T00:19:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7e6d59c0 20 remove_watcher() i=3 2024-09-12T00:19:11.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.045+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93950785458240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x55729f30c120 2024-09-12T00:19:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93950785458240] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x55729f30c120 2024-09-12T00:19:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7e6d59c0 20 remove_watcher() i=4 2024-09-12T00:19:11.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93950785459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d740283d0 2024-09-12T00:19:11.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93950785459856] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7e6d59c0 20 remove_watcher() i=5 2024-09-12T00:19:11.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.049+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93950785462816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f34a990 con 0x7f2d740283d0 2024-09-12T00:19:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93950785462816] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 20 remove_watcher() i=6 2024-09-12T00:19:11.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93950785468608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55729f319690 con 0x7f2d740283d0 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93950785468608] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d700d7040 con 0x7f2d740283d0 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 20 remove_watcher() i=7 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2d740283d0 msgr2=0x7f2d74041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2d740283d0 0x7f2d74041400 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f30c120 msgr2=0x55729f30e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f30c120 0x55729f30e5b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2d6c021020 msgr2=0x7f2d6c0539f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2d6c021020 0x7f2d6c0539f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f310aa0 msgr2=0x55729f312e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f310aa0 0x55729f312e90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c4c039a70 msgr2=0x7f2c4c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c4c039a70 0x7f2c4c03bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d74010cc0 tx=0x7f2d74036000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 msgr2=0x55729f300b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c016fd0 tx=0x7f2d6c050020 comp rx=0 tx=0).stop 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7b9da640 1 -- 172.21.15.66:0/2440710830 reap_dead start 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 shutdown_connections 2024-09-12T00:19:11.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/2440710830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2fa6f0 0x55729f300b70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 >> 172.21.15.66:0/2440710830 conn(0x55729f2f5ab0 msgr2=0x55729f2f3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 shutdown_connections 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/2440710830 wait complete. 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 msgr2=0x7f2c5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 0x7f2c5403bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55729f2d9cd0 tx=0x7f2d7404e900 comp rx=0 tx=0).stop 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 msgr2=0x55729f2ed180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55729f2d3520 tx=0x7f2d6c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 shutdown_connections 2024-09-12T00:19:11.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c54039a70 0x7f2c5403bf30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/762902905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f2ecd60 0x55729f2ed180 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.053+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 >> 172.21.15.66:0/762902905 conn(0x55729f2e2710 msgr2=0x55729f2e2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 shutdown_connections 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/762902905 wait complete. 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 msgr2=0x55729f2d9300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 0x55729f2d9300 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 msgr2=0x55729f2ddf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 0x55729f2ddf20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 msgr2=0x7f2c6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 0x7f2c6403bf30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ac000 tx=0x7f2d700a5000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 msgr2=0x55729f2d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d74001ba0 tx=0x7f2d74004470 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 shutdown_connections 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55729f2dbb30 0x55729f2ddf20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55729f154520 0x55729f2d9300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2c64039a70 0x7f2c6403bf30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 --2- 172.21.15.66:0/4013478412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55729f153ff0 0x55729f2d2190 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 >> 172.21.15.66:0/4013478412 conn(0x55729f1d8fd0 msgr2=0x55729f2c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 shutdown_connections 2024-09-12T00:19:11.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.057+0000 7f2d7e6d59c0 1 -- 172.21.15.66:0/4013478412 wait complete. 2024-09-12T00:19:11.069 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:11.070 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:11.070 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T00:19:11.148 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:11.148 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:11.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9d0b79c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558546333770 0x558546333b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9d0b79c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585461e59c0 con 0x5585463368b0 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9d0b79c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5585462356d0 con 0x558546333770 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9abbd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558546333770 0x558546333b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9abbd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558546333770 0x558546333b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45238/0 (socket says 172.21.15.66:45238) 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9a3bc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5585463368b0 0x558546338ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:42990/0 (socket says 172.21.15.66:42990) 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9abbd640 1 -- 172.21.15.66:0/942839211 learned_addr learned my addr 172.21.15.66:0/942839211 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9abbd640 1 -- 172.21.15.66:0/942839211 >> v1:172.21.15.31:6789/0 conn(0x5585463368b0 legacy=0x558546338ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.145+0000 7fdc9abbd640 1 -- 172.21.15.66:0/942839211 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585461d9ca0 con 0x558546333770 2024-09-12T00:19:11.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/942839211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546333b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00a5c0 tx=0x7fdc8c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b85195c10d161 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc99bbb640 1 -- 172.21.15.66:0/942839211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0a6070 con 0x558546333770 2024-09-12T00:19:11.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc99bbb640 1 -- 172.21.15.66:0/942839211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0af070 con 0x558546333770 2024-09-12T00:19:11.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc99bbb640 1 -- 172.21.15.66:0/942839211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0aa5c0 con 0x558546333770 2024-09-12T00:19:11.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/942839211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 msgr2=0x558546333b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/942839211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546333b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00a5c0 tx=0x7fdc8c01b340 comp rx=0 tx=0).stop 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/942839211 shutdown_connections 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/942839211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546333b50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/942839211 >> 172.21.15.66:0/942839211 conn(0x5585462a7080 msgr2=0x5585462a7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/942839211 shutdown_connections 2024-09-12T00:19:11.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.149+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/942839211 wait complete. 2024-09-12T00:19:11.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558546239680 con 0x558546333770 2024-09-12T00:19:11.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9abbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9abbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45244/0 (socket says 172.21.15.66:45244) 2024-09-12T00:19:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9abbd640 1 -- 172.21.15.66:0/2371902409 learned_addr learned my addr 172.21.15.66:0/2371902409 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9abbd640 1 -- 172.21.15.66:0/2371902409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585461b4da0 con 0x558546333770 2024-09-12T00:19:11.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/2371902409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0ac040 tx=0x7fdc8c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c3a8330ba2133c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdb88e09640 1 -- 172.21.15.66:0/2371902409 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0aa970 con 0x558546333770 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdb88e09640 1 -- 172.21.15.66:0/2371902409 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0aab10 con 0x558546333770 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdb88e09640 1 -- 172.21.15.66:0/2371902409 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0aae30 con 0x558546333770 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2371902409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 msgr2=0x55854641e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2371902409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0ac040 tx=0x7fdc8c003030 comp rx=0 tx=0).stop 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2371902409 shutdown_connections 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2371902409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x55854641e9e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2371902409 >> 172.21.15.66:0/2371902409 conn(0x5585462a7080 msgr2=0x55854641a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2371902409 shutdown_connections 2024-09-12T00:19:11.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2371902409 wait complete. 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.165+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585461dba50 con 0x558546333770 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9abbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9abbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45258/0 (socket says 172.21.15.66:45258) 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9abbd640 1 -- 172.21.15.66:0/3508001836 learned_addr learned my addr 172.21.15.66:0/3508001836 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9abbd640 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558546426450 con 0x558546333770 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c01b170 tx=0x7fdc8c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 -- 172.21.15.66:0/3508001836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0cb020 con 0x558546333770 2024-09-12T00:19:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585464266e0 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 -- 172.21.15.66:0/3508001836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0c6650 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558546427090 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 -- 172.21.15.66:0/3508001836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc8c0c6930 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 -- 172.21.15.66:0/3508001836 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdc8c0ce020 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 0x7fdb8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdb87606640 1 -- 172.21.15.66:0/3508001836 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fdc8c0ebcb0 con 0x558546333770 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 0x7fdb8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 0x55854642d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854642d5a0 con 0x5585463368b0 2024-09-12T00:19:11.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 0x55854642d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.169+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 0x7fdb8003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001e40 tx=0x7fdc900013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 0x55854642d060 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 -- 172.21.15.66:0/3508001836 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc9400a4d0 con 0x5585463368b0 2024-09-12T00:19:11.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546427410 con 0x5585463368b0 2024-09-12T00:19:11.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 -- 172.21.15.66:0/3508001836 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc9400a4d0 con 0x5585463368b0 2024-09-12T00:19:11.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 0x558546431c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546432340 con 0x55854642f860 2024-09-12T00:19:11.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 0x558546431c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 0x558546431c50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9abbd640 1 -- 172.21.15.66:0/3508001836 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc8c0bd910 con 0x55854642f860 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854642e700 con 0x5585463368b0 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 -- 172.21.15.66:0/3508001836 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc9400a4d0 con 0x5585463368b0 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854642ebe0 con 0x55854642f860 2024-09-12T00:19:11.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9abbd640 1 -- 172.21.15.66:0/3508001836 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc8c0bd910 con 0x55854642f860 2024-09-12T00:19:11.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9d0b79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558546246450 con 0x558546440a70 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45266/0 (socket says 172.21.15.66:45266) 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 -- 172.21.15.66:0/2662642581 learned_addr learned my addr 172.21.15.66:0/2662642581 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.173+0000 7fdc9b3be640 1 -- 172.21.15.66:0/2662642581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585464414d0 con 0x558546440a70 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x558546427280 tx=0x7fdc94018c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 -- 172.21.15.66:0/2662642581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc94016d60 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558546441d30 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 -- 172.21.15.66:0/2662642581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94021440 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585464422a0 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 -- 172.21.15.66:0/2662642581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc94021720 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 -- 172.21.15.66:0/2662642581 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdc94011040 con 0x558546440a70 2024-09-12T00:19:11.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 0x7fdb7403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb84e01640 1 -- 172.21.15.66:0/2662642581 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fdc9400e040 con 0x558546440a70 2024-09-12T00:19:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 0x7fdb7403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 0x7fdb7403bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0bc770 tx=0x7fdc8c00a350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9d0b79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55854641f150 con 0x55854644e3e0 2024-09-12T00:19:11.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45272/0 (socket says 172.21.15.66:45272) 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 -- 172.21.15.66:0/3655384748 learned_addr learned my addr 172.21.15.66:0/3655384748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 -- 172.21.15.66:0/3655384748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55854644edd0 con 0x55854644e3e0 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/3655384748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc94052070 tx=0x7fdc9401f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892bf85926cdacf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb7e7fc640 1 -- 172.21.15.66:0/3655384748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc94043030 con 0x55854644e3e0 2024-09-12T00:19:11.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb7e7fc640 1 -- 172.21.15.66:0/3655384748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9404d020 con 0x55854644e3e0 2024-09-12T00:19:11.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.177+0000 7fdb7e7fc640 1 -- 172.21.15.66:0/3655384748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc940137b0 con 0x55854644e3e0 2024-09-12T00:19:11.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3655384748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 msgr2=0x55854644e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3655384748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdc94052070 tx=0x7fdc9401f680 comp rx=0 tx=0).stop 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3655384748 shutdown_connections 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3655384748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x55854644e7e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3655384748 >> 172.21.15.66:0/3655384748 conn(0x5585464497e0 msgr2=0x558546447a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3655384748 shutdown_connections 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3655384748 wait complete. 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 Processor -- start 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- start start 2024-09-12T00:19:11.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55854644d310 con 0x55854644e3e0 2024-09-12T00:19:11.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9b3be640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45280/0 (socket says 172.21.15.66:45280) 2024-09-12T00:19:11.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 learned_addr learned my addr 172.21.15.66:0/1558468414 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558546454d60 con 0x55854644e3e0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc94052070 tx=0x7fdc940503e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdb7cff9640 1 -- 172.21.15.66:0/1558468414 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc94043030 con 0x55854644e3e0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558546454ff0 con 0x55854644e3e0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdb7cff9640 1 -- 172.21.15.66:0/1558468414 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc940218c0 con 0x55854644e3e0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdb7cff9640 1 -- 172.21.15.66:0/1558468414 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc94021ab0 con 0x55854644e3e0 2024-09-12T00:19:11.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585464559a0 con 0x55854644e3e0 2024-09-12T00:19:11.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdb7cff9640 1 -- 172.21.15.66:0/1558468414 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdc94021c50 con 0x55854644e3e0 2024-09-12T00:19:11.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.181+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdb7cff9640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb64039a20 0x7fdb6403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdb7cff9640 1 -- 172.21.15.66:0/1558468414 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fdc94044070 con 0x55854644e3e0 2024-09-12T00:19:11.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb64039a20 0x7fdb6403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55854645fdf0 0x558546462260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585464629b0 con 0x55854645fdf0 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55854645fdf0 0x558546462260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb64039a20 0x7fdb6403bee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0bdc20 tx=0x7fdc8c0e5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55854645fdf0 0x558546462260 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc9000f620 con 0x55854645fdf0 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 realm 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854645f200 con 0x55854645fdf0 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc9000f620 con 0x55854645fdf0 2024-09-12T00:19:11.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:11.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585464634b0 con 0x55854645fdf0 2024-09-12T00:19:11.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc9000f620 con 0x55854645fdf0 2024-09-12T00:19:11.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546463d80 con 0x55854645fdf0 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc9000f620 con 0x55854645fdf0 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585464647a0 0x558546466b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585464672d0 con 0x5585464647a0 2024-09-12T00:19:11.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585464647a0 0x558546466b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585464647a0 0x558546466b90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 20 searching for the correct realm 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x5585464647a0 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fdc940123d0 0x7fdc94032780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc940123d0 2024-09-12T00:19:11.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fdc940123d0 0x7fdc94032780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fdc940123d0 0x7fdc94032780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fdc8c0da040 0x7fdc8c009420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc8c0da040 2024-09-12T00:19:11.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.185+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fdc8c0da040 0x7fdc8c009420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fdc8c0da040 0x7fdc8c009420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9000f620 con 0x7fdc8c0da040 2024-09-12T00:19:11.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x55854645fdf0 2024-09-12T00:19:11.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9000f620 con 0x55854645fdf0 2024-09-12T00:19:11.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x55854645fdf0 2024-09-12T00:19:11.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc8c0da040 2024-09-12T00:19:11.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc8c0da040 2024-09-12T00:19:11.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc940123d0 2024-09-12T00:19:11.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x5585464647a0 2024-09-12T00:19:11.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x55854645fdf0 2024-09-12T00:19:11.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.189+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc8c0da040 2024-09-12T00:19:11.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x55854645fdf0 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558546468ba0 con 0x7fdc940123d0 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc8c0da040 2024-09-12T00:19:11.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x55854645fdf0 2024-09-12T00:19:11.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x55854645fdf0 2024-09-12T00:19:11.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc8c0da040 2024-09-12T00:19:11.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.193+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc940123d0 2024-09-12T00:19:11.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x55854645fdf0 2024-09-12T00:19:11.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9002b040 con 0x55854645fdf0 2024-09-12T00:19:11.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc8c0da040 2024-09-12T00:19:11.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc8c0da040 2024-09-12T00:19:11.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc940123d0 2024-09-12T00:19:11.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x5585464647a0 2024-09-12T00:19:11.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc8c0da040 2024-09-12T00:19:11.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x55854645fdf0 2024-09-12T00:19:11.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdc8c104060 con 0x7fdc940123d0 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.197+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:11.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:11.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:11.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546467d20 con 0x55854645fdf0 2024-09-12T00:19:11.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585464685c0 con 0x55854645fdf0 2024-09-12T00:19:11.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546468f40 con 0x5585464647a0 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 zone default found 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 4 Realm: () 2024-09-12T00:19:11.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 zonegroup default 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546469350 con 0x7fdc8c0da040 2024-09-12T00:19:11.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854646b1b0 con 0x5585464647a0 2024-09-12T00:19:11.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854646b670 con 0x5585464647a0 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 started sync module instance, tier type = 2024-09-12T00:19:11.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646a620 con 0x7fdc940123d0 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94030898047504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646a280 con 0x7fdc940123d0 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.201+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646c5a0 con 0x55854645fdf0 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94030898047504] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94030898053360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646c9c0 con 0x55854645fdf0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646d210 con 0x5585464647a0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94030898056016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646d620 con 0x5585464647a0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646e140 con 0x7fdc940123d0 2024-09-12T00:19:11.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.205+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94030898053360] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94030898060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646e100 con 0x7fdc940123d0 2024-09-12T00:19:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646eb50 con 0x55854645fdf0 2024-09-12T00:19:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94030898056016] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94030898060304] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94030898054416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646e6a0 con 0x55854645fdf0 2024-09-12T00:19:11.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.209+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646f3f0 con 0x7fdc8c0da040 2024-09-12T00:19:11.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94030898064528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646f560 con 0x7fdc8c0da040 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94030898054416] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646ff20 con 0x7fdc8c0da040 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94030898064528] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94030898065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646f4d0 con 0x7fdc8c0da040 2024-09-12T00:19:11.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.213+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585464703d0 con 0x7fdc8c0da040 2024-09-12T00:19:11.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94030898065584] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94030898068080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558546470340 con 0x7fdc8c0da040 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=0 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=1 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=2 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=3 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=4 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=5 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.217+0000 7fdc9d0b79c0 20 add_watcher() i=6 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94030898068080] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 20 add_watcher() i=7 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558546473690 con 0x55854645fdf0 2024-09-12T00:19:11.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94030898081952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585464704b0 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94030898081952] v31'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdb517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647c050 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.221+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647c660 con 0x7fdc8c0da040 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.225+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.225+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647cbd0 con 0x5585464647a0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.225+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.225+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647cbd0 con 0x55854645fdf0 2024-09-12T00:19:11.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'119 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d080 con 0x7fdc940123d0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d080 con 0x5585464647a0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.229+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d080 con 0x55854645fdf0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.233+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.233+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d1d0 con 0x7fdc8c0da040 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.233+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.233+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d1d0 con 0x7fdc940123d0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x5585464647a0 2024-09-12T00:19:11.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x7fdc940123d0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.237+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x7fdc8c0da040 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.241+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.241+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x7fdc940123d0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.241+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.241+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x7fdc8c0da040 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.245+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'41 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.245+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x55854645fdf0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.245+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'120 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.245+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x5585464647a0 2024-09-12T00:19:11.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x7fdc940123d0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'41 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x5585464647a0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.249+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x55854645fdf0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x55854645fdf0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'121 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d680 con 0x5585464647a0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.253+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d700 con 0x7fdc940123d0 2024-09-12T00:19:11.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d700 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d740 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d740 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.257+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d740 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'34 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d740 con 0x7fdc8c0da040 2024-09-12T00:19:11.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d780 con 0x5585464647a0 2024-09-12T00:19:11.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'26 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.261+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d780 con 0x7fdc8c0da040 2024-09-12T00:19:11.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.265+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.265+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d780 con 0x5585464647a0 2024-09-12T00:19:11.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.265+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.265+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d780 con 0x7fdc8c0da040 2024-09-12T00:19:11.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.269+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'42 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.269+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854647d7b0 con 0x7fdc940123d0 2024-09-12T00:19:11.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdacbfff640 20 reqs_thread_entry: start 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 20 Filter name: none 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdac9ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854647a210 con 0x7fdc8c0da040 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55854649b330 con 0x7fdc8c0da040 2024-09-12T00:19:11.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.273+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.279 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T00:19:11.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdb517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94030898081952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854645a080 con 0x55854645fdf0 2024-09-12T00:19:11.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94030898081952] v31'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94030898047504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585464730a0 con 0x7fdc940123d0 2024-09-12T00:19:11.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94030898047504] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9d0b79c0 20 remove_watcher() i=0 2024-09-12T00:19:11.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9d0b79c0 2 removed watcher, disabling cache 2024-09-12T00:19:11.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.277+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94030898053360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646aa10 con 0x55854645fdf0 2024-09-12T00:19:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94030898053360] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 20 remove_watcher() i=1 2024-09-12T00:19:11.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94030898056016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646c0f0 con 0x5585464647a0 2024-09-12T00:19:11.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9b3be640 1 -- 172.21.15.66:0/1558468414 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94030898056016] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc94038020 con 0x5585464647a0 2024-09-12T00:19:11.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 20 remove_watcher() i=2 2024-09-12T00:19:11.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94030898060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646c0f0 con 0x7fdc940123d0 2024-09-12T00:19:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9abbd640 1 -- 172.21.15.66:0/1558468414 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94030898060304] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc8c0f5070 con 0x7fdc940123d0 2024-09-12T00:19:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 20 remove_watcher() i=3 2024-09-12T00:19:11.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.281+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94030898054416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646c0f0 con 0x55854645fdf0 2024-09-12T00:19:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94030898054416] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x55854645fdf0 2024-09-12T00:19:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9d0b79c0 20 remove_watcher() i=4 2024-09-12T00:19:11.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94030898064528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646dc10 con 0x7fdc8c0da040 2024-09-12T00:19:11.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94030898064528] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9d0b79c0 20 remove_watcher() i=5 2024-09-12T00:19:11.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.285+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94030898065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646dc10 con 0x7fdc8c0da040 2024-09-12T00:19:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94030898065584] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 20 remove_watcher() i=6 2024-09-12T00:19:11.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94030898068080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55854646dc10 con 0x7fdc8c0da040 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94030898068080] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc9003b040 con 0x7fdc8c0da040 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 20 remove_watcher() i=7 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fdc8c0da040 msgr2=0x7fdc8c009420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fdc8c0da040 0x7fdc8c009420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55854645fdf0 msgr2=0x558546462260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55854645fdf0 0x558546462260 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fdc940123d0 msgr2=0x7fdc94032780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fdc940123d0 0x7fdc94032780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585464647a0 msgr2=0x558546466b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585464647a0 0x558546466b90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb64039a20 msgr2=0x7fdb6403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb64039a20 0x7fdb6403bee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0bdc20 tx=0x7fdc8c0e5000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 msgr2=0x558546454800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9a3bc640 1 -- 172.21.15.66:0/1558468414 reap_dead start 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc94052070 tx=0x7fdc940503e0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 shutdown_connections 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/1558468414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55854644e3e0 0x558546454800 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 >> 172.21.15.66:0/1558468414 conn(0x5585464497e0 msgr2=0x5585464479f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 shutdown_connections 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.289+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/1558468414 wait complete. 2024-09-12T00:19:11.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 msgr2=0x7fdb7403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 0x7fdb7403bf30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0bc770 tx=0x7fdc8c00a350 comp rx=0 tx=0).stop 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 msgr2=0x558546440e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x558546427280 tx=0x7fdc94018c60 comp rx=0 tx=0).stop 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 shutdown_connections 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb74039a70 0x7fdb7403bf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/2662642581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546440a70 0x558546440e90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 >> 172.21.15.66:0/2662642581 conn(0x558546436420 msgr2=0x558546436800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 shutdown_connections 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/2662642581 wait complete. 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 msgr2=0x55854642d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 0x55854642d060 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 msgr2=0x558546431c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 0x558546431c50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 msgr2=0x7fdb8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 0x7fdb8003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc90001e40 tx=0x7fdc900013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 msgr2=0x558546425ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c01b170 tx=0x7fdc8c0180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 shutdown_connections 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55854642f860 0x558546431c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585463368b0 0x55854642d060 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdb80039a70 0x7fdb8003bf30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 --2- 172.21.15.66:0/3508001836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558546333770 0x558546425ef0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 >> 172.21.15.66:0/3508001836 conn(0x5585462a7080 msgr2=0x558546419110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 shutdown_connections 2024-09-12T00:19:11.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.293+0000 7fdc9d0b79c0 1 -- 172.21.15.66:0/3508001836 wait complete. 2024-09-12T00:19:11.306 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T00:19:11.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T00:19:11.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T00:19:11.306 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-12T00:19:11.386 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:11.386 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:11.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551c5df9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a69798eb50 0x55a697a22cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551c5df9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6978ce9c0 con 0x55a69798e770 2024-09-12T00:19:11.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551c5df9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55a69791e6d0 con 0x55a69798eb50 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f55198e4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a69798eb50 0x55a697a22cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f55198e4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a69798eb50 0x55a697a22cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45286/0 (socket says 172.21.15.66:45286) 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f55198e4640 1 -- 172.21.15.66:0/1483936648 learned_addr learned my addr 172.21.15.66:0/1483936648 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.381+0000 7f551a0e5640 1 --1- 172.21.15.66:0/1483936648 >> v1:172.21.15.31:6789/0 conn(0x55a69798e770 0x55a697a1f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43006/0 (socket says 172.21.15.66:43006) 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55198e4640 1 -- 172.21.15.66:0/1483936648 >> v1:172.21.15.31:6789/0 conn(0x55a69798e770 legacy=0x55a697a1f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55198e4640 1 -- 172.21.15.66:0/1483936648 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6978c2ca0 con 0x55a69798eb50 2024-09-12T00:19:11.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55198e4640 1 --2- 172.21.15.66:0/1483936648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798eb50 0x55a697a22cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f550400a5c0 tx=0x7f550401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7f33fcf4602f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55190e3640 1 -- 172.21.15.66:0/1483936648 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55040a6070 con 0x55a69798eb50 2024-09-12T00:19:11.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55190e3640 1 -- 172.21.15.66:0/1483936648 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55040af070 con 0x55a69798eb50 2024-09-12T00:19:11.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f55190e3640 1 -- 172.21.15.66:0/1483936648 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55040aa5c0 con 0x55a69798eb50 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1483936648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798eb50 msgr2=0x55a697a22cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1483936648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798eb50 0x55a697a22cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f550400a5c0 tx=0x7f550401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1483936648 shutdown_connections 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1483936648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798eb50 0x55a697a22cd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1483936648 >> 172.21.15.66:0/1483936648 conn(0x55a697a14e90 msgr2=0x55a697a172b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1483936648 shutdown_connections 2024-09-12T00:19:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.385+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1483936648 wait complete. 2024-09-12T00:19:11.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551c5df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551c5df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a697922680 con 0x55a69798e770 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551a0e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551a0e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45288/0 (socket says 172.21.15.66:45288) 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551a0e5640 1 -- 172.21.15.66:0/3688086423 learned_addr learned my addr 172.21.15.66:0/3688086423 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551a0e5640 1 -- 172.21.15.66:0/3688086423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69789dda0 con 0x55a69798e770 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551a0e5640 1 --2- 172.21.15.66:0/3688086423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f550c001680 tx=0x7f550c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c876fe0ed67cf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f5408608640 1 -- 172.21.15.66:0/3688086423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550c013420 con 0x55a69798e770 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f5408608640 1 -- 172.21.15.66:0/3688086423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c0135c0 con 0x55a69798e770 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f5408608640 1 -- 172.21.15.66:0/3688086423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550c0138e0 con 0x55a69798e770 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.401+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3688086423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 msgr2=0x55a697b07a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3688086423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f550c001680 tx=0x7f550c001b40 comp rx=0 tx=0).stop 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3688086423 shutdown_connections 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3688086423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b07a10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3688086423 >> 172.21.15.66:0/3688086423 conn(0x55a697a14e90 msgr2=0x55a697b036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3688086423 shutdown_connections 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3688086423 wait complete. 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a6978c4a50 con 0x55a69798e770 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551a0e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551a0e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45292/0 (socket says 172.21.15.66:45292) 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551a0e5640 1 -- 172.21.15.66:0/3435893892 learned_addr learned my addr 172.21.15.66:0/3435893892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551a0e5640 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a697b0f610 con 0x55a69798e770 2024-09-12T00:19:11.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551a0e5640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55a697b08a00 tx=0x7f550c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f5406e05640 1 -- 172.21.15.66:0/3435893892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550c0037a0 con 0x55a69798e770 2024-09-12T00:19:11.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a697b0f8a0 con 0x55a69798e770 2024-09-12T00:19:11.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f5406e05640 1 -- 172.21.15.66:0/3435893892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c023070 con 0x55a69798e770 2024-09-12T00:19:11.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f5406e05640 1 -- 172.21.15.66:0/3435893892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550c003ad0 con 0x55a69798e770 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.405+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a697b10250 con 0x55a69798e770 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f5406e05640 1 -- 172.21.15.66:0/3435893892 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f550c010070 con 0x55a69798e770 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f5406e05640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 0x7f540003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f5406e05640 1 -- 172.21.15.66:0/3435893892 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f550c050230 con 0x55a69798e770 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f55198e4640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 0x7f540003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 0x55a697b16220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b16760 con 0x55a69798eb50 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a8e6640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 0x55a697b16220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f55198e4640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 0x7f540003bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55040ae000 tx=0x7f55040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a8e6640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 0x55a697b16220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a8e6640 1 -- 172.21.15.66:0/3435893892 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x55a69798eb50 2024-09-12T00:19:11.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b16bb0 con 0x55a69798eb50 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a8e6640 1 -- 172.21.15.66:0/3435893892 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x55a69798eb50 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 0x55a697b1adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b1b4a0 con 0x55a697b189c0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a0e5640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 0x55a697b1adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a0e5640 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 0x55a697b1adb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a0e5640 1 -- 172.21.15.66:0/3435893892 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f550c00f030 con 0x55a697b189c0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b17830 con 0x55a69798eb50 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a8e6640 1 -- 172.21.15.66:0/3435893892 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x55a69798eb50 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b17d10 con 0x55a697b189c0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551a0e5640 1 -- 172.21.15.66:0/3435893892 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f550c00f030 con 0x55a697b189c0 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.409+0000 7f551c5df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a69792f450 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45296/0 (socket says 172.21.15.66:45296) 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a8e6640 1 -- 172.21.15.66:0/2154719484 learned_addr learned my addr 172.21.15.66:0/2154719484 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a8e6640 1 -- 172.21.15.66:0/2154719484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a697b2a670 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a8e6640 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a697b10440 tx=0x7f551400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 -- 172.21.15.66:0/2154719484 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551401c020 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 -- 172.21.15.66:0/2154719484 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514007d00 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a697b2aed0 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 -- 172.21.15.66:0/2154719484 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514018440 con 0x55a697b29c10 2024-09-12T00:19:11.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a697b2b440 con 0x55a697b29c10 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 -- 172.21.15.66:0/2154719484 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f551401f020 con 0x55a697b29c10 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 0x7f53f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f53fffff640 1 -- 172.21.15.66:0/2154719484 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f5514051db0 con 0x55a697b29c10 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a0e5640 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 0x7f53f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551a0e5640 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 0x7f53f403bf30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a697b10570 tx=0x7f550c006340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.413+0000 7f551c5df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a697b08240 con 0x55a697b37540 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45310/0 (socket says 172.21.15.66:45310) 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 -- 172.21.15.66:0/2940466114 learned_addr learned my addr 172.21.15.66:0/2940466114 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 -- 172.21.15.66:0/2940466114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a697b37f10 con 0x55a697b37540 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- 172.21.15.66:0/2940466114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5514050130 tx=0x7f55140503d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15bfda13763663e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53fdffb640 1 -- 172.21.15.66:0/2940466114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514021400 con 0x55a697b37540 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53fdffb640 1 -- 172.21.15.66:0/2940466114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55140166f0 con 0x55a697b37540 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53fdffb640 1 -- 172.21.15.66:0/2940466114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55140215a0 con 0x55a697b37540 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2940466114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 msgr2=0x55a697b37920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2940466114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5514050130 tx=0x7f55140503d0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2940466114 shutdown_connections 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2940466114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b37920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2940466114 >> 172.21.15.66:0/2940466114 conn(0x55a697b32900 msgr2=0x55a697b30b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2940466114 shutdown_connections 2024-09-12T00:19:11.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2940466114 wait complete. 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 Processor -- start 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- start start 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a697b36430 con 0x55a697b37540 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45316/0 (socket says 172.21.15.66:45316) 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 learned_addr learned my addr 172.21.15.66:0/1968156056 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a697b3df00 con 0x55a697b37540 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551a8e6640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5514041040 tx=0x7f5514050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53ebfff640 1 -- 172.21.15.66:0/1968156056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514038070 con 0x55a697b37540 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53ebfff640 1 -- 172.21.15.66:0/1968156056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514028640 con 0x55a697b37540 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a697b3e190 con 0x55a697b37540 2024-09-12T00:19:11.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f53ebfff640 1 -- 172.21.15.66:0/1968156056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5514028b10 con 0x55a697b37540 2024-09-12T00:19:11.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.417+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a697b3eb40 con 0x55a697b37540 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f53ebfff640 1 -- 172.21.15.66:0/1968156056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f551403b070 con 0x55a697b37540 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f53ebfff640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53e4039a70 0x7f53e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f53ebfff640 1 -- 172.21.15.66:0/1968156056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f5514034c30 con 0x55a697b37540 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551a0e5640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53e4039a70 0x7f53e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a697b48ef0 0x55a697b4b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b4bad0 con 0x55a697b48ef0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a697b48ef0 0x55a697b4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551a0e5640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53e4039a70 0x7f53e403bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550c01da60 tx=0x7f550c04b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a697b48ef0 0x55a697b4b380 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 realm 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b4bf00 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b4c7d0 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b4cb70 con 0x55a697b48ef0 2024-09-12T00:19:11.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b4d8d0 0x55a697b4fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b502d0 con 0x55a697b4d8d0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551a8e6640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b4d8d0 0x55a697b4fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.421+0000 7f551a8e6640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b4d8d0 0x55a697b4fcc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551c5df9c0 20 searching for the correct realm 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a8e6640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f551403d060 0x7f55140294f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a0e5640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f551403d060 0x7f55140294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a0e5640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f551403d060 0x7f55140294f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a0e5640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f550c0417e0 0x7f550c04e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f550c0417e0 0x7f550c04e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f550c0417e0 0x7f550c04e780 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.425+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.429+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.433+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b4d8d0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f550c0417e0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x55a697b48ef0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51b30 con 0x7f551403d060 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b50c20 con 0x55a697b48ef0 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51470 con 0x55a697b48ef0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b51f60 con 0x55a697b4d8d0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 zone default found 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 4 Realm: () 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:11.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 zonegroup default 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.437+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b52300 con 0x7f550c0417e0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b540e0 con 0x55a697b4d8d0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b544d0 con 0x55a697b4d8d0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 started sync module instance, tier type = 2024-09-12T00:19:11.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:11.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b53580 con 0x7f551403d060 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173998166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b54930 con 0x7f551403d060 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b55180 con 0x55a697b48ef0 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.441+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173998166224] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173998168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b55280 con 0x55a697b48ef0 2024-09-12T00:19:11.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b55d80 con 0x55a697b4d8d0 2024-09-12T00:19:11.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173998168480] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173998176368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b55d40 con 0x55a697b4d8d0 2024-09-12T00:19:11.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b567c0 con 0x7f551403d060 2024-09-12T00:19:11.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.445+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173998179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b57010 con 0x7f551403d060 2024-09-12T00:19:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b57a30 con 0x55a697b48ef0 2024-09-12T00:19:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173998176368] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173998179088] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173998183712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b56b60 con 0x55a697b48ef0 2024-09-12T00:19:11.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b582d0 con 0x7f550c0417e0 2024-09-12T00:19:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173998185584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b58540 con 0x7f550c0417e0 2024-09-12T00:19:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.449+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b58d90 con 0x7f550c0417e0 2024-09-12T00:19:11.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173998183712] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173998187840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b58e10 con 0x7f550c0417e0 2024-09-12T00:19:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b597d0 con 0x7f550c0417e0 2024-09-12T00:19:11.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173998185584] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.453+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173998187840] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173998188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b58d80 con 0x7f550c0417e0 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=0 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=1 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=2 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=3 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=4 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=5 2024-09-12T00:19:11.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=6 2024-09-12T00:19:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173998188896] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x7f550c0417e0 2024-09-12T00:19:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 add_watcher() i=7 2024-09-12T00:19:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:11.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b5c800 con 0x55a697b48ef0 2024-09-12T00:19:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173998191392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b59d00 con 0x55a697b48ef0 2024-09-12T00:19:11.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173998191392] v31'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55040aaa00 con 0x55a697b48ef0 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f53d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 5 note: GC not initialized 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f534b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.457+0000 7f551c5df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 Filter name: none 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f53497fa640 20 reqs_thread_entry: start 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7fc80 con 0x7f550c0417e0 2024-09-12T00:19:11.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b81d70 con 0x7f551403d060 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:11.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b837d0 con 0x55a697b4d8d0 2024-09-12T00:19:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:11.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:11.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.461+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b869d0 con 0x7f550c0417e0 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(65 fud.buckets [call] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b85ad0 con 0x7f551403d060 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b8add0 con 0x7f551403d060 2024-09-12T00:19:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T00:19:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:11.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.465+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94173998376400 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a697b88430 con 0x7f550c0417e0 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== watch-notify(notify (1) cookie 94173998187840 notify 133143986182 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55a6978c2ca0 con 0x7f550c0417e0 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(68 notify.6 [notify cookie 94173998376400 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f53fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94173998187840 notifier 4515 bl.length()=338 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f53fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f53fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f53fdffb640 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f53e0003eb0 con 0x7f550c0417e0 2024-09-12T00:19:11.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== watch-notify(notify_complete (2) cookie 94173998376400 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f55040bfc70 con 0x7f550c0417e0 2024-09-12T00:19:11.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f53d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173998191392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x55a697b48ef0 2024-09-12T00:19:11.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94173998191392] v31'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x55a697b48ef0 2024-09-12T00:19:11.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.469+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173998166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x7f551403d060 2024-09-12T00:19:11.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94173998166224] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551c5df9c0 20 remove_watcher() i=0 2024-09-12T00:19:11.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551c5df9c0 2 removed watcher, disabling cache 2024-09-12T00:19:11.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173998168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x55a697b48ef0 2024-09-12T00:19:11.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94173998168480] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x55a697b48ef0 2024-09-12T00:19:11.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551c5df9c0 20 remove_watcher() i=1 2024-09-12T00:19:11.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.473+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173998176368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x55a697b4d8d0 2024-09-12T00:19:11.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551a8e6640 1 -- 172.21.15.66:0/1968156056 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94173998176368] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551403a030 con 0x55a697b4d8d0 2024-09-12T00:19:11.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551c5df9c0 20 remove_watcher() i=2 2024-09-12T00:19:11.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173998179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x7f551403d060 2024-09-12T00:19:11.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551a0e5640 1 -- 172.21.15.66:0/1968156056 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94173998179088] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c00f030 con 0x7f551403d060 2024-09-12T00:19:11.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551c5df9c0 20 remove_watcher() i=3 2024-09-12T00:19:11.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.477+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173998183712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x55a697b48ef0 2024-09-12T00:19:11.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94173998183712] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x55a697b48ef0 2024-09-12T00:19:11.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f551c5df9c0 20 remove_watcher() i=4 2024-09-12T00:19:11.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173998185584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x7f550c0417e0 2024-09-12T00:19:11.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94173998185584] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f551c5df9c0 20 remove_watcher() i=5 2024-09-12T00:19:11.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.481+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173998187840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x7f550c0417e0 2024-09-12T00:19:11.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94173998187840] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 20 remove_watcher() i=6 2024-09-12T00:19:11.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173998188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a697b7da00 con 0x7f550c0417e0 2024-09-12T00:19:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94173998188896] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d5040 con 0x7f550c0417e0 2024-09-12T00:19:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 20 remove_watcher() i=7 2024-09-12T00:19:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f550c0417e0 msgr2=0x7f550c04e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f550c0417e0 0x7f550c04e780 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a697b48ef0 msgr2=0x55a697b4b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a697b48ef0 0x55a697b4b380 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f551403d060 msgr2=0x7f55140294f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f551403d060 0x7f55140294f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b4d8d0 msgr2=0x55a697b4fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b4d8d0 0x55a697b4fcc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53e4039a70 msgr2=0x7f53e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53e4039a70 0x7f53e403bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f550c01da60 tx=0x7f550c04b000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f55198e4640 1 -- 172.21.15.66:0/1968156056 reap_dead start 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 msgr2=0x55a697b3d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5514041040 tx=0x7f5514050090 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 shutdown_connections 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/1968156056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b37540 0x55a697b3d9a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 >> 172.21.15.66:0/1968156056 conn(0x55a697b32900 msgr2=0x55a697b30b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 shutdown_connections 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.485+0000 7f551c5df9c0 1 -- 172.21.15.66:0/1968156056 wait complete. 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 msgr2=0x7f53f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 0x7f53f403bf30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55a697b10570 tx=0x7f550c006340 comp rx=0 tx=0).stop 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 msgr2=0x55a697b2a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a697b10440 tx=0x7f551400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 shutdown_connections 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f53f4039a70 0x7f53f403bf30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/2154719484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a697b29c10 0x55a697b2a030 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 >> 172.21.15.66:0/2154719484 conn(0x55a697b1f5c0 msgr2=0x55a697b1f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 shutdown_connections 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/2154719484 wait complete. 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 msgr2=0x55a697b16220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 0x55a697b16220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 msgr2=0x55a697b1adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 0x55a697b1adb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 msgr2=0x7f540003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 0x7f540003bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55040ae000 tx=0x7f55040a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 msgr2=0x55a697b0f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55a697b08a00 tx=0x7f550c000f50 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 shutdown_connections 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a697b189c0 0x55a697b1adb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a69798eb50 0x55a697b16220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5400039a70 0x7f540003bf30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 --2- 172.21.15.66:0/3435893892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a69798e770 0x55a697b0f0b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 >> 172.21.15.66:0/3435893892 conn(0x55a697a14e90 msgr2=0x55a697b02140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 shutdown_connections 2024-09-12T00:19:11.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.489+0000 7f551c5df9c0 1 -- 172.21.15.66:0/3435893892 wait complete. 2024-09-12T00:19:11.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1'] 2024-09-12T00:19:11.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1'] 2024-09-12T00:19:11.504 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:11.585 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:11.585 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:11.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21c81b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557b4bf5d4f0 0x557b4bf5f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21c81b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b4be0e9c0 con 0x557b4bf59300 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21c81b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557b4be5e6d0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd219b20640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557b4bf5d4f0 0x557b4bf5f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21a321640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x557b4bf59300 0x557b4bf596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43016/0 (socket says 172.21.15.66:43016) 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd219b20640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557b4bf5d4f0 0x557b4bf5f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45320/0 (socket says 172.21.15.66:45320) 2024-09-12T00:19:11.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.581+0000 7fd21a321640 1 -- 172.21.15.66:0/2596709448 learned_addr learned my addr 172.21.15.66:0/2596709448 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:11.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd219b20640 1 -- 172.21.15.66:0/2596709448 >> v1:172.21.15.31:6789/0 conn(0x557b4bf59300 legacy=0x557b4bf596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd219b20640 1 -- 172.21.15.66:0/2596709448 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4be02ca0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd219b20640 1 --2- 172.21.15.66:0/2596709448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf5d4f0 0x557b4bf5f8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd20400a480 tx=0x7fd20401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1db763d56f8d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd21931f640 1 -- 172.21.15.66:0/2596709448 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2040aa570 con 0x557b4bf5d4f0 2024-09-12T00:19:11.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd21931f640 1 -- 172.21.15.66:0/2596709448 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2040af070 con 0x557b4bf5d4f0 2024-09-12T00:19:11.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.585+0000 7fd21931f640 1 -- 172.21.15.66:0/2596709448 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2040aa860 con 0x557b4bf5d4f0 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2596709448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf5d4f0 msgr2=0x557b4bf5f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2596709448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf5d4f0 0x557b4bf5f8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd20400a480 tx=0x7fd20401b310 comp rx=0 tx=0).stop 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2596709448 shutdown_connections 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2596709448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf5d4f0 0x557b4bf5f8e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2596709448 >> 172.21.15.66:0/2596709448 conn(0x557b4bf54e20 msgr2=0x557b4bf57240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2596709448 shutdown_connections 2024-09-12T00:19:11.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.589+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2596709448 wait complete. 2024-09-12T00:19:11.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.601+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.601+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.601+0000 7fd21c81b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.601+0000 7fd21c81b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557b4be62680 con 0x557b4bf59300 2024-09-12T00:19:11.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45330/0 (socket says 172.21.15.66:45330) 2024-09-12T00:19:11.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 -- 172.21.15.66:0/1747385169 learned_addr learned my addr 172.21.15.66:0/1747385169 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 -- 172.21.15.66:0/1747385169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4bdddda0 con 0x557b4bf59300 2024-09-12T00:19:11.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 --2- 172.21.15.66:0/1747385169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d5f0 tx=0x7fd21400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c30b540730987f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd108608640 1 -- 172.21.15.66:0/1747385169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd214014020 con 0x557b4bf59300 2024-09-12T00:19:11.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd108608640 1 -- 172.21.15.66:0/1747385169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214004530 con 0x557b4bf59300 2024-09-12T00:19:11.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd108608640 1 -- 172.21.15.66:0/1747385169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd214004830 con 0x557b4bf59300 2024-09-12T00:19:11.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/1747385169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 msgr2=0x557b4c0447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/1747385169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d5f0 tx=0x7fd21400dab0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/1747385169 shutdown_connections 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/1747385169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c0447c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/1747385169 >> 172.21.15.66:0/1747385169 conn(0x557b4bf54e20 msgr2=0x557b4c040460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/1747385169 shutdown_connections 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/1747385169 wait complete. 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21c81b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557b4be04a50 con 0x557b4bf59300 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45338/0 (socket says 172.21.15.66:45338) 2024-09-12T00:19:11.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.605+0000 7fd21a321640 1 -- 172.21.15.66:0/2860083860 learned_addr learned my addr 172.21.15.66:0/2860083860 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21a321640 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4c04b2c0 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21a321640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd21400daf0 tx=0x7fd214001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 -- 172.21.15.66:0/2860083860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd214014030 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b4c04b550 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 -- 172.21.15.66:0/2860083860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214001920 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 -- 172.21.15.66:0/2860083860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd214001c00 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4c04bf80 con 0x557b4bf59300 2024-09-12T00:19:11.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 -- 172.21.15.66:0/2860083860 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd214017020 con 0x557b4bf59300 2024-09-12T00:19:11.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 0x7fd10003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd106e05640 1 -- 172.21.15.66:0/2860083860 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd214022030 con 0x557b4bf59300 2024-09-12T00:19:11.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd219b20640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 0x7fd10003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 0x557b4c051ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c052410 con 0x557b4bf5d4f0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21ab22640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 0x557b4c051ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd219b20640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 0x7fd10003bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2040ae000 tx=0x7fd2040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21ab22640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 0x557b4c051ed0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21ab22640 1 -- 172.21.15.66:0/2860083860 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd20c0083f0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c052810 con 0x557b4bf5d4f0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.609+0000 7fd21ab22640 1 -- 172.21.15.66:0/2860083860 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd20c0083f0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 0x557b4c056a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0570e0 con 0x557b4c054620 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21a321640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 0x557b4c056a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21a321640 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 0x557b4c056a10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21a321640 1 -- 172.21.15.66:0/2860083860 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd214018590 con 0x557b4c054620 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0534c0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 -- 172.21.15.66:0/2860083860 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd20c0083f0 con 0x557b4bf5d4f0 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0539a0 con 0x557b4c054620 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21a321640 1 -- 172.21.15.66:0/2860083860 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd214018590 con 0x557b4c054620 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557b4be6f450 con 0x557b4c065830 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45352/0 (socket says 172.21.15.66:45352) 2024-09-12T00:19:11.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 -- 172.21.15.66:0/2734387363 learned_addr learned my addr 172.21.15.66:0/2734387363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 -- 172.21.15.66:0/2734387363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4c066290 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21ab22640 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x557b4c04bd90 tx=0x7fd20c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd0fffff640 1 -- 172.21.15.66:0/2734387363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c01c020 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd0fffff640 1 -- 172.21.15.66:0/2734387363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c007d00 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd0fffff640 1 -- 172.21.15.66:0/2734387363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c018440 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b4c066af0 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.613+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4c067060 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fffff640 1 -- 172.21.15.66:0/2734387363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd20c01f020 con 0x557b4c065830 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fffff640 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 0x7fd0f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fffff640 1 -- 172.21.15.66:0/2734387363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd20c051ca0 con 0x557b4c065830 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21a321640 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 0x7fd0f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21a321640 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 0x7fd0f403bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd21401afd0 tx=0x7fd214050a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557b4c045010 con 0x557b4c0721d0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45358/0 (socket says 172.21.15.66:45358) 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21ab22640 1 -- 172.21.15.66:0/3869668100 learned_addr learned my addr 172.21.15.66:0/3869668100 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21ab22640 1 -- 172.21.15.66:0/3869668100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4c072b80 con 0x557b4c0721d0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21ab22640 1 --2- 172.21.15.66:0/3869668100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd20c021fd0 tx=0x7fd20c0168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4d6233e5a2d70b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fdffb640 1 -- 172.21.15.66:0/3869668100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c021400 con 0x557b4c0721d0 2024-09-12T00:19:11.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fdffb640 1 -- 172.21.15.66:0/3869668100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c029350 con 0x557b4c0721d0 2024-09-12T00:19:11.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd0fdffb640 1 -- 172.21.15.66:0/3869668100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c0215a0 con 0x557b4c0721d0 2024-09-12T00:19:11.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/3869668100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 msgr2=0x557b4c0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/3869668100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd20c021fd0 tx=0x7fd20c0168b0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/3869668100 shutdown_connections 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.617+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/3869668100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c0725b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/3869668100 >> 172.21.15.66:0/3869668100 conn(0x557b4c06e600 msgr2=0x557b4c06c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/3869668100 shutdown_connections 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/3869668100 wait complete. 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 Processor -- start 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- start start 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557b4c0731e0 con 0x557b4c0721d0 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21ab22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45366/0 (socket says 172.21.15.66:45366) 2024-09-12T00:19:11.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 learned_addr learned my addr 172.21.15.66:0/4197708035 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4c07dfb0 con 0x557b4c0721d0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21ab22640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd20c021fd0 tx=0x7fd20c050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd0ebfff640 1 -- 172.21.15.66:0/4197708035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c016e00 con 0x557b4c0721d0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b4c07e240 con 0x557b4c0721d0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd0ebfff640 1 -- 172.21.15.66:0/4197708035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c028bd0 con 0x557b4c0721d0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd0ebfff640 1 -- 172.21.15.66:0/4197708035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd20c0203b0 con 0x557b4c0721d0 2024-09-12T00:19:11.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4c07ebf0 con 0x557b4c0721d0 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.621+0000 7fd0ebfff640 1 -- 172.21.15.66:0/4197708035 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd20c016040 con 0x557b4c0721d0 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd0ebfff640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0e4039a70 0x7fd0e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd0ebfff640 1 -- 172.21.15.66:0/4197708035 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fd20c032070 con 0x557b4c0721d0 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4c089060 0x557b4c08b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21a321640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0e4039a70 0x7fd0e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c08bc40 con 0x557b4c089060 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4c089060 0x557b4c08b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21a321640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0e4039a70 0x7fd0e403bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557b4c04c220 tx=0x7fd214047000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4c089060 0x557b4c08b4f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 realm 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c08c070 con 0x557b4c089060 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c08c940 con 0x557b4c089060 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c08cce0 con 0x557b4c089060 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c08da40 0x557b4c08fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c090480 con 0x557b4c08da40 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c08da40 0x557b4c08fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c08da40 0x557b4c08fe30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 20 searching for the correct realm 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd20c021020 0x7fd20c049a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21a321640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd20c021020 0x7fd20c049a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.625+0000 7fd21a321640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd20c021020 0x7fd20c049a60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd21a321640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd21403c040 0x7fd214042a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd21403c040 0x7fd214042a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd21403c040 0x7fd214042a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.629+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.633+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.637+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c08da40 2024-09-12T00:19:11.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd21403c040 2024-09-12T00:19:11.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x557b4c089060 2024-09-12T00:19:11.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091ce0 con 0x7fd20c021020 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c090dd0 con 0x557b4c089060 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c091620 con 0x557b4c089060 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c090a10 con 0x557b4c08da40 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 zone default found 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 4 Realm: () 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:11.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 zonegroup default 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0925c0 con 0x7fd21403c040 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c094800 con 0x557b4c08da40 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.641+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c094ba0 con 0x557b4c08da40 2024-09-12T00:19:11.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c093c40 con 0x7fd20c021020 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988045013040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c094450 con 0x7fd20c021020 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c095560 con 0x557b4c089060 2024-09-12T00:19:11.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.645+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988045013040] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988045015968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c095950 con 0x557b4c089060 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c096310 con 0x557b4c08da40 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988045020768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c096280 con 0x557b4c08da40 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c097290 con 0x7fd20c021020 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988045015968] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988045024640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c097680 con 0x7fd20c021020 2024-09-12T00:19:11.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c098040 con 0x557b4c089060 2024-09-12T00:19:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.649+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988045020768] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.653+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.653+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988045028240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c097fb0 con 0x557b4c089060 2024-09-12T00:19:11.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.653+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c098d90 con 0x7fd21403c040 2024-09-12T00:19:11.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.653+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988045024640] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988045028240] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988045017024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c098850 con 0x7fd21403c040 2024-09-12T00:19:11.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c099100 con 0x7fd21403c040 2024-09-12T00:19:11.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988045017024] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988045030224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0992e0 con 0x7fd21403c040 2024-09-12T00:19:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.657+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c099b30 con 0x7fd21403c040 2024-09-12T00:19:11.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988045030224] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988045034208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c099bb0 con 0x7fd21403c040 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=0 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=1 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=2 2024-09-12T00:19:11.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=3 2024-09-12T00:19:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=4 2024-09-12T00:19:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=5 2024-09-12T00:19:11.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=6 2024-09-12T00:19:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988045034208] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 20 add_watcher() i=7 2024-09-12T00:19:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c09ce50 con 0x557b4c089060 2024-09-12T00:19:11.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.661+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988045035632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c09a140 con 0x557b4c089060 2024-09-12T00:19:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988045035632] v31'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd0d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 5 note: GC not initialized 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd04b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 Filter name: none 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd0497fa640 20 reqs_thread_entry: start 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0c0520 con 0x557b4c089060 2024-09-12T00:19:11.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd2040a8070 con 0x557b4c089060 2024-09-12T00:19:11.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:11.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:11.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0c2610 con 0x7fd20c021020 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0c4280 con 0x557b4c08da40 2024-09-12T00:19:11.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:11.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.665+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0c8590 con 0x7fd21403c040 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(65 fud.buckets [call] v31'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd2040a8070 con 0x7fd21403c040 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0ce840 con 0x557b4c08da40 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v31'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:11.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.669+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93988045210096 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0cc0b0 con 0x7fd21403c040 2024-09-12T00:19:11.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== watch-notify(notify (1) cookie 93988045030224 notify 133143986183 ret 0) ==== 802+0+0 (crc 0 0 0) 0x557b4be02ca0 con 0x7fd21403c040 2024-09-12T00:19:11.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd0fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 93988045030224 notifier 4522 bl.length()=760 2024-09-12T00:19:11.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd0fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:11.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd0fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:11.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd0fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:11.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd0fdffb640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd0e0003eb0 con 0x7fd21403c040 2024-09-12T00:19:11.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(67 notify.6 [notify cookie 93988045210096 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== watch-notify(notify_complete (2) cookie 93988045210096 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2040c1940 con 0x7fd21403c040 2024-09-12T00:19:11.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:11.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:11.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:11.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:11.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0cbc00 con 0x7fd20c021020 2024-09-12T00:19:11.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(69 foo.buckets [call] v31'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.673+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0c7000 con 0x7fd20c021020 2024-09-12T00:19:11.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd21c81b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:11.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd21c81b9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd21c81b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:11.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93988045210096 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0cc0b0 con 0x7fd21403c040 2024-09-12T00:19:11.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== watch-notify(notify (1) cookie 93988045030224 notify 133143986184 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fd2040c1be0 con 0x7fd21403c040 2024-09-12T00:19:11.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd0fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 93988045030224 notifier 4522 bl.length()=314 2024-09-12T00:19:11.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd0fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:11.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd0fd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:11.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd0fd7fa640 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd050003410 con 0x7fd21403c040 2024-09-12T00:19:11.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(71 notify.6 [notify cookie 93988045210096 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.677+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== watch-notify(notify_complete (2) cookie 93988045210096 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd2040b5410 con 0x7fd21403c040 2024-09-12T00:19:11.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd0d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988045035632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x557b4c089060 2024-09-12T00:19:11.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93988045035632] v31'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x557b4c089060 2024-09-12T00:19:11.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988045013040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x7fd20c021020 2024-09-12T00:19:11.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93988045013040] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21c81b9c0 20 remove_watcher() i=0 2024-09-12T00:19:11.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21c81b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:11.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.681+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988045015968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x557b4c089060 2024-09-12T00:19:11.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93988045015968] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x557b4c089060 2024-09-12T00:19:11.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd21c81b9c0 20 remove_watcher() i=1 2024-09-12T00:19:11.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988045020768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x557b4c08da40 2024-09-12T00:19:11.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd21ab22640 1 -- 172.21.15.66:0/4197708035 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93988045020768] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd20c03c020 con 0x557b4c08da40 2024-09-12T00:19:11.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd21c81b9c0 20 remove_watcher() i=2 2024-09-12T00:19:11.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.685+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988045024640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x7fd20c021020 2024-09-12T00:19:11.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd21a321640 1 -- 172.21.15.66:0/4197708035 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93988045024640] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd214018590 con 0x7fd20c021020 2024-09-12T00:19:11.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd21c81b9c0 20 remove_watcher() i=3 2024-09-12T00:19:11.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988045028240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x557b4c089060 2024-09-12T00:19:11.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93988045028240] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x557b4c089060 2024-09-12T00:19:11.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd21c81b9c0 20 remove_watcher() i=4 2024-09-12T00:19:11.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.689+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988045017024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x7fd21403c040 2024-09-12T00:19:11.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93988045017024] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd21c81b9c0 20 remove_watcher() i=5 2024-09-12T00:19:11.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988045030224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x7fd21403c040 2024-09-12T00:19:11.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93988045030224] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd21c81b9c0 20 remove_watcher() i=6 2024-09-12T00:19:11.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.693+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988045034208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b4c0be2c0 con 0x7fd21403c040 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93988045034208] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2040d5040 con 0x7fd21403c040 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 20 remove_watcher() i=7 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd21403c040 msgr2=0x7fd214042a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd21403c040 0x7fd214042a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4c089060 msgr2=0x557b4c08b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4c089060 0x557b4c08b4f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd20c021020 msgr2=0x7fd20c049a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd20c021020 0x7fd20c049a60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c08da40 msgr2=0x557b4c08fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c08da40 0x557b4c08fe30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0e4039a70 msgr2=0x7fd0e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0e4039a70 0x7fd0e403bf30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557b4c04c220 tx=0x7fd214047000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 msgr2=0x557b4c07da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd219b20640 1 -- 172.21.15.66:0/4197708035 reap_dead start 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd20c021fd0 tx=0x7fd20c050040 comp rx=0 tx=0).stop 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 shutdown_connections 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/4197708035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c0721d0 0x557b4c07da50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 >> 172.21.15.66:0/4197708035 conn(0x557b4c06e600 msgr2=0x557b4c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 shutdown_connections 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/4197708035 wait complete. 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 msgr2=0x7fd0f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 0x7fd0f403bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd21401afd0 tx=0x7fd214050a00 comp rx=0 tx=0).stop 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 msgr2=0x557b4c065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x557b4c04bd90 tx=0x7fd20c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 shutdown_connections 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd0f4039a70 0x7fd0f403bf30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2734387363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4c065830 0x557b4c065c50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 >> 172.21.15.66:0/2734387363 conn(0x557b4c05b1e0 msgr2=0x557b4c05b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 shutdown_connections 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2734387363 wait complete. 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 msgr2=0x557b4c051ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 0x557b4c051ed0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 msgr2=0x557b4c056a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 0x557b4c056a10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 msgr2=0x7fd10003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 0x7fd10003bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2040ae000 tx=0x7fd2040a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 msgr2=0x557b4c04ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd21400daf0 tx=0x7fd214001260 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 shutdown_connections 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557b4c054620 0x557b4c056a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557b4bf5d4f0 0x557b4c051ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd100039a70 0x7fd10003bf30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 --2- 172.21.15.66:0/2860083860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557b4bf59300 0x557b4c04ad60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 >> 172.21.15.66:0/2860083860 conn(0x557b4bf54e20 msgr2=0x557b4c03eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 shutdown_connections 2024-09-12T00:19:11.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.697+0000 7fd21c81b9c0 1 -- 172.21.15.66:0/2860083860 wait complete. 2024-09-12T00:19:11.712 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:11.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T00:19:11.713 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T00:19:11.792 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28561b59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556efde1a560 0x556efde1c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28561b59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556efdccb9c0 con 0x556efde16370 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28561b59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x556efdd1b6d0 con 0x556efde1a560 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28534ba640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556efde1a560 0x556efde1c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f2853cbb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x556efde16370 0x556efde16750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43032/0 (socket says 172.21.15.66:43032) 2024-09-12T00:19:11.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f2853cbb640 1 -- 172.21.15.66:0/2988534247 learned_addr learned my addr 172.21.15.66:0/2988534247 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28534ba640 1 -- 172.21.15.66:0/2988534247 >> v1:172.21.15.31:6789/0 conn(0x556efde16370 legacy=0x556efde16750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.789+0000 7f28534ba640 1 -- 172.21.15.66:0/2988534247 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efdcbfca0 con 0x556efde1a560 2024-09-12T00:19:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28534ba640 1 --2- 172.21.15.66:0/2988534247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde1a560 0x556efde1c950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f284800a480 tx=0x7f284801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0aa92543a38638 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f2852cb9640 1 -- 172.21.15.66:0/2988534247 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28480aa570 con 0x556efde1a560 2024-09-12T00:19:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f2852cb9640 1 -- 172.21.15.66:0/2988534247 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28480af070 con 0x556efde1a560 2024-09-12T00:19:11.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f2852cb9640 1 -- 172.21.15.66:0/2988534247 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28480aa860 con 0x556efde1a560 2024-09-12T00:19:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 -- 172.21.15.66:0/2988534247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde1a560 msgr2=0x556efde1c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 --2- 172.21.15.66:0/2988534247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde1a560 0x556efde1c950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f284800a480 tx=0x7f284801b310 comp rx=0 tx=0).stop 2024-09-12T00:19:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 -- 172.21.15.66:0/2988534247 shutdown_connections 2024-09-12T00:19:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 --2- 172.21.15.66:0/2988534247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde1a560 0x556efde1c950 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 -- 172.21.15.66:0/2988534247 >> 172.21.15.66:0/2988534247 conn(0x556efde11e90 msgr2=0x556efde142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 -- 172.21.15.66:0/2988534247 shutdown_connections 2024-09-12T00:19:11.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.793+0000 7f28561b59c0 1 -- 172.21.15.66:0/2988534247 wait complete. 2024-09-12T00:19:11.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556efdd1f680 con 0x556efde16370 2024-09-12T00:19:11.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2853cbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2853cbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45382/0 (socket says 172.21.15.66:45382) 2024-09-12T00:19:11.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2853cbb640 1 -- 172.21.15.66:0/609171260 learned_addr learned my addr 172.21.15.66:0/609171260 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2853cbb640 1 -- 172.21.15.66:0/609171260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efdc9ada0 con 0x556efde16370 2024-09-12T00:19:11.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2853cbb640 1 --2- 172.21.15.66:0/609171260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f284c001810 tx=0x7f284c001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65d21f4df4ef812 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2741e0b640 1 -- 172.21.15.66:0/609171260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c004530 con 0x556efde16370 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2741e0b640 1 -- 172.21.15.66:0/609171260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0046d0 con 0x556efde16370 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f2741e0b640 1 -- 172.21.15.66:0/609171260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c0049f0 con 0x556efde16370 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- 172.21.15.66:0/609171260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 msgr2=0x556efdf027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 --2- 172.21.15.66:0/609171260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f284c001810 tx=0x7f284c001cd0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- 172.21.15.66:0/609171260 shutdown_connections 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 --2- 172.21.15.66:0/609171260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efdf027f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- 172.21.15.66:0/609171260 >> 172.21.15.66:0/609171260 conn(0x556efde11e90 msgr2=0x556efdefe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- 172.21.15.66:0/609171260 shutdown_connections 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.809+0000 7f28561b59c0 1 -- 172.21.15.66:0/609171260 wait complete. 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556efdcc1a50 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f2853cbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f2853cbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45384/0 (socket says 172.21.15.66:45384) 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f2853cbb640 1 -- 172.21.15.66:0/3496535325 learned_addr learned my addr 172.21.15.66:0/3496535325 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f2853cbb640 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efde1fd30 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f2853cbb640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f284c000f90 tx=0x7f284c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 -- 172.21.15.66:0/3496535325 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013820 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 -- 172.21.15.66:0/3496535325 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0139c0 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556efde1e110 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 -- 172.21.15.66:0/3496535325 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013ce0 con 0x556efde16370 2024-09-12T00:19:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efde1e6a0 con 0x556efde16370 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 -- 172.21.15.66:0/3496535325 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f284c010070 con 0x556efde16370 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 0x7f273c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.813+0000 7f273bfff640 1 -- 172.21.15.66:0/3496535325 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f284c018070 con 0x556efde16370 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28534ba640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 0x7f273c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 0x556efdf13270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf137b0 con 0x556efde1a560 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 0x556efdf13270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28534ba640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 0x7f273c03bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28480ae000 tx=0x7f28480a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 0x556efdf13270 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 -- 172.21.15.66:0/3496535325 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28440083f0 con 0x556efde1a560 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf13b70 con 0x556efde1a560 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 -- 172.21.15.66:0/3496535325 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28440083f0 con 0x556efde1a560 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 0x556efdf17d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf18440 con 0x556efdf15980 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f2853cbb640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 0x556efdf17d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f2853cbb640 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 0x556efdf17d70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f2853cbb640 1 -- 172.21.15.66:0/3496535325 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f284c01b030 con 0x556efdf15980 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf14820 con 0x556efde1a560 2024-09-12T00:19:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 -- 172.21.15.66:0/3496535325 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28440083f0 con 0x556efde1a560 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf14ce0 con 0x556efdf15980 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f2853cbb640 1 -- 172.21.15.66:0/3496535325 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f284c01b030 con 0x556efdf15980 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28561b59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556efdd2c450 con 0x556efdf26b70 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45398/0 (socket says 172.21.15.66:45398) 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.817+0000 7f28544bc640 1 -- 172.21.15.66:0/503511282 learned_addr learned my addr 172.21.15.66:0/503511282 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 -- 172.21.15.66:0/503511282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efdf275d0 con 0x556efdf26b70 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x556efde1f230 tx=0x7f284400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 -- 172.21.15.66:0/503511282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284401c020 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 -- 172.21.15.66:0/503511282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844007d00 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556efdf27e30 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 -- 172.21.15.66:0/503511282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844018440 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efdf283a0 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 -- 172.21.15.66:0/503511282 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f284401f020 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 0x7f272c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f27397fa640 1 -- 172.21.15.66:0/503511282 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2844051ca0 con 0x556efdf26b70 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f2853cbb640 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 0x7f272c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f2853cbb640 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 0x7f272c03bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x556efde1e990 tx=0x7f284c04e8b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28561b59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556efdf03040 con 0x556efdf334f0 2024-09-12T00:19:11.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45414/0 (socket says 172.21.15.66:45414) 2024-09-12T00:19:11.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 -- 172.21.15.66:0/3573404932 learned_addr learned my addr 172.21.15.66:0/3573404932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.821+0000 7f28544bc640 1 -- 172.21.15.66:0/3573404932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efdf33ea0 con 0x556efdf334f0 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 --2- 172.21.15.66:0/3573404932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2844021fd0 tx=0x7f28440168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae1ee8d0263d83b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f2732ffd640 1 -- 172.21.15.66:0/3573404932 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844021400 con 0x556efdf334f0 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f2732ffd640 1 -- 172.21.15.66:0/3573404932 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844029350 con 0x556efdf334f0 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f2732ffd640 1 -- 172.21.15.66:0/3573404932 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28440215a0 con 0x556efdf334f0 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/3573404932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 msgr2=0x556efdf338d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3573404932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2844021fd0 tx=0x7f28440168b0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/3573404932 shutdown_connections 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3573404932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf338d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/3573404932 >> 172.21.15.66:0/3573404932 conn(0x556efdf2f920 msgr2=0x556efdf2db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/3573404932 shutdown_connections 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/3573404932 wait complete. 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 Processor -- start 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- start start 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556efdf34500 con 0x556efdf334f0 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45420/0 (socket says 172.21.15.66:45420) 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 learned_addr learned my addr 172.21.15.66:0/1381048819 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:11.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efdf3aed0 con 0x556efdf334f0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28544bc640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2844021fd0 tx=0x7f2844050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f27317fa640 1 -- 172.21.15.66:0/1381048819 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844016e00 con 0x556efdf334f0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556efdf3b160 con 0x556efdf334f0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f27317fa640 1 -- 172.21.15.66:0/1381048819 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844028bd0 con 0x556efdf334f0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f27317fa640 1 -- 172.21.15.66:0/1381048819 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28440203b0 con 0x556efdf334f0 2024-09-12T00:19:11.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.825+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efdf3bb10 con 0x556efdf334f0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f27317fa640 1 -- 172.21.15.66:0/1381048819 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2844016040 con 0x556efdf334f0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f27317fa640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f271c039a70 0x7f271c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f27317fa640 1 -- 172.21.15.66:0/1381048819 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f2844032070 con 0x556efdf334f0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f2853cbb640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f271c039a70 0x7f271c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efdf45f90 0x556efdf48420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf48b70 con 0x556efdf45f90 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efdf45f90 0x556efdf48420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f2853cbb640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f271c039a70 0x7f271c03bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f284c050480 tx=0x7f284c041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efdf45f90 0x556efdf48420 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 realm 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf48fa0 con 0x556efdf45f90 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf49870 con 0x556efdf45f90 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf49c10 con 0x556efdf45f90 2024-09-12T00:19:11.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf4a970 0x556efdf4cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4d3b0 con 0x556efdf4a970 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf4a970 0x556efdf4cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf4a970 0x556efdf4cd60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 20 searching for the correct realm 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2844021020 0x7f2844049a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.829+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f2853cbb640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2844021020 0x7f2844049a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f2853cbb640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2844021020 0x7f2844049a60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f2853cbb640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f284c04e0f0 0x7f284c01d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f284c04e0f0 0x7f284c01d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f284c04e0f0 0x7f284c01d530 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.833+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.837+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.841+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf4a970 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f284c04e0f0 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x556efdf45f90 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4ec10 con 0x7f2844021020 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4dd00 con 0x556efdf45f90 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4e550 con 0x556efdf45f90 2024-09-12T00:19:11.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4d940 con 0x556efdf4a970 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 zone default found 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 4 Realm: () 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 zonegroup default 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.845+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf4f4f0 con 0x7f284c04e0f0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf51730 con 0x556efdf4a970 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf51ad0 con 0x556efdf4a970 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 started sync module instance, tier type = 2024-09-12T00:19:11.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:11.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf50b70 con 0x7f2844021020 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93935195459424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf51380 con 0x7f2844021020 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf524b0 con 0x556efdf45f90 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.849+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93935195459424] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93935195462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf528a0 con 0x556efdf45f90 2024-09-12T00:19:11.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf53260 con 0x556efdf4a970 2024-09-12T00:19:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93935195462352] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93935195463408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf53260 con 0x556efdf4a970 2024-09-12T00:19:11.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf53c70 con 0x7f2844021020 2024-09-12T00:19:11.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93935195469760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf54510 con 0x7f2844021020 2024-09-12T00:19:11.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.853+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf54f50 con 0x556efdf45f90 2024-09-12T00:19:11.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93935195469760] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93935195463408] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93935195474464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf54060 con 0x556efdf45f90 2024-09-12T00:19:11.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf557f0 con 0x7f284c04e0f0 2024-09-12T00:19:11.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93935195476368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf55a60 con 0x7f284c04e0f0 2024-09-12T00:19:11.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf562b0 con 0x7f284c04e0f0 2024-09-12T00:19:11.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.857+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93935195474464] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.861+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93935195476368] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.861+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.861+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93935195477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf55e80 con 0x7f284c04e0f0 2024-09-12T00:19:11.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.861+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf56710 con 0x7f284c04e0f0 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93935195479680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf56da0 con 0x7f284c04e0f0 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=0 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=1 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=2 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=3 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=4 2024-09-12T00:19:11.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=5 2024-09-12T00:19:11.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93935195477424] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=6 2024-09-12T00:19:11.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93935195479680] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 add_watcher() i=7 2024-09-12T00:19:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf59cc0 con 0x556efdf45f90 2024-09-12T00:19:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93935195482080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf570b0 con 0x556efdf45f90 2024-09-12T00:19:11.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93935195482080] v31'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f2709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:11.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:11.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.865+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62460 con 0x556efdf45f90 2024-09-12T00:19:11.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.869+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.869+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62460 con 0x7f284c04e0f0 2024-09-12T00:19:11.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62f80 con 0x556efdf4a970 2024-09-12T00:19:11.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf63360 con 0x556efdf45f90 2024-09-12T00:19:11.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'128 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.873+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf63580 con 0x7f2844021020 2024-09-12T00:19:11.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf60af0 con 0x556efdf4a970 2024-09-12T00:19:11.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf60ac0 con 0x556efdf45f90 2024-09-12T00:19:11.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.877+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62460 con 0x7f284c04e0f0 2024-09-12T00:19:11.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.881+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.881+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62460 con 0x7f2844021020 2024-09-12T00:19:11.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf62460 con 0x556efdf4a970 2024-09-12T00:19:11.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61900 con 0x7f2844021020 2024-09-12T00:19:11.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.885+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61ad0 con 0x7f284c04e0f0 2024-09-12T00:19:11.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.889+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.889+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61ad0 con 0x7f2844021020 2024-09-12T00:19:11.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.889+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.889+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61ad0 con 0x7f284c04e0f0 2024-09-12T00:19:11.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.893+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'43 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.893+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf619c0 con 0x556efdf45f90 2024-09-12T00:19:11.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.893+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'129 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.893+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf619c0 con 0x556efdf4a970 2024-09-12T00:19:11.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f2844021020 2024-09-12T00:19:11.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.897+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf45f90 2024-09-12T00:19:11.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.901+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.901+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf45f90 2024-09-12T00:19:11.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.901+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'130 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x556efdf45f90 2024-09-12T00:19:11.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.901+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f2844021020 2024-09-12T00:19:11.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.905+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'36 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.909+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f284c04e0f0 2024-09-12T00:19:11.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.913+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.913+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.913+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'27 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.913+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f284c04e0f0 2024-09-12T00:19:11.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.917+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.917+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x556efdf4a970 2024-09-12T00:19:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.921+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.921+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f284c04e0f0 2024-09-12T00:19:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.921+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'44 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.921+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61990 con 0x7f2844021020 2024-09-12T00:19:11.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f2708fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:11.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:11.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 20 Filter name: none 2024-09-12T00:19:11.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f26827fc640 20 reqs_thread_entry: start 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf61470 con 0x7f284c04e0f0 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f28480a8070 con 0x7f284c04e0f0 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:19:11.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T00:19:11.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:19:11.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:11.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.925+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf81aa0 con 0x7f284c04e0f0 2024-09-12T00:19:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28561b59c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf7fa80 con 0x7f284c04e0f0 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28561b59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93935195653600 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf82040 con 0x556efdf4a970 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== watch-notify(notify (1) cookie 93935195463408 notify 133143986179 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556efdf62b60 con 0x556efdf4a970 2024-09-12T00:19:11.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f2732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 93935195463408 notifier 4529 bl.length()=170 2024-09-12T00:19:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(97 notify.2 [notify cookie 93935195653600 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f2732ffd640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2718003d70 con 0x556efdf4a970 2024-09-12T00:19:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.929+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== watch-notify(notify_complete (2) cookie 93935195653600 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556efdf3aed0 con 0x556efdf4a970 2024-09-12T00:19:11.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28561b59c0 10 removing email index: 2024-09-12T00:19:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28561b59c0 10 removing user buckets index 2024-09-12T00:19:11.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf81fa0 con 0x7f284c04e0f0 2024-09-12T00:19:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(99 fud.buckets [delete] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28561b59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T00:19:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93935195660192 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf815f0 con 0x7f284c04e0f0 2024-09-12T00:19:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== watch-notify(notify (1) cookie 93935195477424 notify 133143986185 ret 0) ==== 202+0+0 (crc 0 0 0) 0x556efdf62630 con 0x7f284c04e0f0 2024-09-12T00:19:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f2732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 93935195477424 notifier 4529 bl.length()=160 2024-09-12T00:19:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f2732ffd640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2718003d70 con 0x7f284c04e0f0 2024-09-12T00:19:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(100 notify.6 [notify cookie 93935195660192 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.933+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== watch-notify(notify_complete (2) cookie 93935195660192 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556efdf3b160 con 0x7f284c04e0f0 2024-09-12T00:19:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28561b59c0 10 removing user index: fud 2024-09-12T00:19:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf81fa0 con 0x7f284c04e0f0 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(102 fud [call,call,delete] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28561b59c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28561b59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93935195660192 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556efdf805e0 con 0x7f284c04e0f0 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== watch-notify(notify (1) cookie 93935195476368 notify 133143986186 ret 0) ==== 194+0+0 (crc 0 0 0) 0x556efdf3b160 con 0x7f284c04e0f0 2024-09-12T00:19:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f27327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 93935195476368 notifier 4529 bl.length()=152 2024-09-12T00:19:11.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f27327fc640 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f26880032d0 con 0x7f284c04e0f0 2024-09-12T00:19:11.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.937+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(103 notify.5 [notify cookie 93935195660192 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== watch-notify(notify_complete (2) cookie 93935195660192 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556efdf5bfb0 con 0x7f284c04e0f0 2024-09-12T00:19:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f2709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93935195482080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf81fa0 con 0x556efdf45f90 2024-09-12T00:19:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93935195482080] v31'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x556efdf45f90 2024-09-12T00:19:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.941+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93935195459424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf81fa0 con 0x7f2844021020 2024-09-12T00:19:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93935195459424] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28561b59c0 20 remove_watcher() i=0 2024-09-12T00:19:11.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28561b59c0 2 removed watcher, disabling cache 2024-09-12T00:19:11.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93935195462352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf50f60 con 0x556efdf45f90 2024-09-12T00:19:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93935195462352] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x556efdf45f90 2024-09-12T00:19:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28561b59c0 20 remove_watcher() i=1 2024-09-12T00:19:11.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.945+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93935195463408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf51ad0 con 0x556efdf4a970 2024-09-12T00:19:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f28544bc640 1 -- 172.21.15.66:0/1381048819 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93935195463408] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284403c020 con 0x556efdf4a970 2024-09-12T00:19:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f28561b59c0 20 remove_watcher() i=2 2024-09-12T00:19:11.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93935195469760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf50f60 con 0x7f2844021020 2024-09-12T00:19:11.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f2853cbb640 1 -- 172.21.15.66:0/1381048819 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93935195469760] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c01b030 con 0x7f2844021020 2024-09-12T00:19:11.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f28561b59c0 20 remove_watcher() i=3 2024-09-12T00:19:11.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.949+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93935195474464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf50f60 con 0x556efdf45f90 2024-09-12T00:19:11.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93935195474464] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x556efdf45f90 2024-09-12T00:19:11.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28561b59c0 20 remove_watcher() i=4 2024-09-12T00:19:11.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93935195476368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf54a20 con 0x7f284c04e0f0 2024-09-12T00:19:11.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93935195476368] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28561b59c0 20 remove_watcher() i=5 2024-09-12T00:19:11.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.953+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93935195477424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf50f60 con 0x7f284c04e0f0 2024-09-12T00:19:11.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.957+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93935195477424] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.957+0000 7f28561b59c0 20 remove_watcher() i=6 2024-09-12T00:19:11.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.957+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93935195479680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556efdf54a20 con 0x7f284c04e0f0 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.957+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93935195479680] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28480d5020 con 0x7f284c04e0f0 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.957+0000 7f28561b59c0 20 remove_watcher() i=7 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f284c04e0f0 msgr2=0x7f284c01d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f284c04e0f0 0x7f284c01d530 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efdf45f90 msgr2=0x556efdf48420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efdf45f90 0x556efdf48420 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2844021020 msgr2=0x7f2844049a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2844021020 0x7f2844049a60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf4a970 msgr2=0x556efdf4cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf4a970 0x556efdf4cd60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f271c039a70 msgr2=0x7f271c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f271c039a70 0x7f271c03bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f284c050480 tx=0x7f284c041000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 msgr2=0x556efdf3a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28534ba640 1 -- 172.21.15.66:0/1381048819 reap_dead start 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2844021fd0 tx=0x7f2844050040 comp rx=0 tx=0).stop 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 shutdown_connections 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/1381048819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf334f0 0x556efdf3a970 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 >> 172.21.15.66:0/1381048819 conn(0x556efdf2f920 msgr2=0x556efdf2db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 shutdown_connections 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/1381048819 wait complete. 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 msgr2=0x7f272c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 0x7f272c03bf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x556efde1e990 tx=0x7f284c04e8b0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 msgr2=0x556efdf26f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x556efde1f230 tx=0x7f284400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 shutdown_connections 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f272c039a70 0x7f272c03bf30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/503511282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efdf26b70 0x556efdf26f90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 >> 172.21.15.66:0/503511282 conn(0x556efdf1c520 msgr2=0x556efdf1c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 shutdown_connections 2024-09-12T00:19:11.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/503511282 wait complete. 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 msgr2=0x556efdf13270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 0x556efdf13270 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 msgr2=0x556efdf17d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 0x556efdf17d70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 msgr2=0x7f273c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 0x7f273c03bf30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f28480ae000 tx=0x7f28480a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 msgr2=0x556efde1f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f284c000f90 tx=0x7f284c001260 comp rx=0 tx=0).stop 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 shutdown_connections 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556efdf15980 0x556efdf17d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556efde1a560 0x556efdf13270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f273c039a70 0x7f273c03bf30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 --2- 172.21.15.66:0/3496535325 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556efde16370 0x556efde1f7d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:11.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 >> 172.21.15.66:0/3496535325 conn(0x556efde11e90 msgr2=0x556efdefcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:11.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 shutdown_connections 2024-09-12T00:19:11.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:11.961+0000 7f28561b59c0 1 -- 172.21.15.66:0/3496535325 wait complete. 2024-09-12T00:19:11.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T00:19:11.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T00:19:11.980 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T00:19:12.076 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:12.077 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:12.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcf0d19c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ea47f2aae0 0x55ea47fbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcf0d19c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea47e6a9c0 con 0x55ea47f2a700 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcf0d19c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ea47eba6d0 con 0x55ea47f2aae0 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcc3d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ea47f2aae0 0x55ea47fbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdccbd7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ea47f2a700 0x55ea47fbb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43038/0 (socket says 172.21.15.66:43038) 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcc3d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ea47f2aae0 0x55ea47fbec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45430/0 (socket says 172.21.15.66:45430) 2024-09-12T00:19:12.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdccbd7640 1 -- 172.21.15.66:0/4211014045 learned_addr learned my addr 172.21.15.66:0/4211014045 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:12.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/4211014045 >> v1:172.21.15.31:6789/0 conn(0x55ea47f2a700 legacy=0x55ea47fbb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.073+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/4211014045 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea47e5eca0 con 0x55ea47f2aae0 2024-09-12T00:19:12.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/4211014045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2aae0 0x55ea47fbec60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a480 tx=0x7fcdc001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a5197cebec77d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcbbd5640 1 -- 172.21.15.66:0/4211014045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc00b0070 con 0x55ea47f2aae0 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcbbd5640 1 -- 172.21.15.66:0/4211014045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc00ab540 con 0x55ea47f2aae0 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcbbd5640 1 -- 172.21.15.66:0/4211014045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc00ab840 con 0x55ea47f2aae0 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/4211014045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2aae0 msgr2=0x55ea47fbec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/4211014045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2aae0 0x55ea47fbec60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a480 tx=0x7fcdc001b280 comp rx=0 tx=0).stop 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/4211014045 shutdown_connections 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/4211014045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2aae0 0x55ea47fbec60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/4211014045 >> 172.21.15.66:0/4211014045 conn(0x55ea47fb0e20 msgr2=0x55ea47fb3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/4211014045 shutdown_connections 2024-09-12T00:19:12.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.077+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/4211014045 wait complete. 2024-09-12T00:19:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdcf0d19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdcf0d19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ea47ebe680 con 0x55ea47f2a700 2024-09-12T00:19:12.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdccbd7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdccbd7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45436/0 (socket says 172.21.15.66:45436) 2024-09-12T00:19:12.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1945524229 learned_addr learned my addr 172.21.15.66:0/1945524229 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1945524229 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea47e39da0 con 0x55ea47f2a700 2024-09-12T00:19:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1945524229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc001e50 tx=0x7fcdbc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42418c49b1bd744e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.093+0000 7fccbae0d640 1 -- 172.21.15.66:0/1945524229 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc012020 con 0x55ea47f2a700 2024-09-12T00:19:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fccbae0d640 1 -- 172.21.15.66:0/1945524229 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00e7c0 con 0x55ea47f2a700 2024-09-12T00:19:12.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fccbae0d640 1 -- 172.21.15.66:0/1945524229 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc00eaa0 con 0x55ea47f2a700 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1945524229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 msgr2=0x55ea480a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1945524229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc001e50 tx=0x7fcdbc001e80 comp rx=0 tx=0).stop 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1945524229 shutdown_connections 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1945524229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480a3a70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1945524229 >> 172.21.15.66:0/1945524229 conn(0x55ea47fb0e20 msgr2=0x55ea4809f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1945524229 shutdown_connections 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1945524229 wait complete. 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ea47e60a50 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdccbd7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdccbd7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45448/0 (socket says 172.21.15.66:45448) 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1342118535 learned_addr learned my addr 172.21.15.66:0/1342118535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea480ab660 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55ea480a4a60 tx=0x7fcdbc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fccb960a640 1 -- 172.21.15.66:0/1342118535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc012030 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea480ab8f0 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fccb960a640 1 -- 172.21.15.66:0/1342118535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc01a680 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fccb960a640 1 -- 172.21.15.66:0/1342118535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc01a980 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.097+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea480ac2a0 con 0x55ea47f2a700 2024-09-12T00:19:12.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fccb960a640 1 -- 172.21.15.66:0/1342118535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcdbc015020 con 0x55ea47f2a700 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fccb960a640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 0x7fccb403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fccb960a640 1 -- 172.21.15.66:0/1342118535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fcdbc020070 con 0x55ea47f2a700 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 0x7fccb403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 0x55ea480b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480b27b0 con 0x55ea47f2aae0 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 0x55ea480b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 0x7fccb403bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ad000 tx=0x7fcdc00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 0x55ea480b2270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1342118535 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea47f2aae0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480b2bd0 con 0x55ea47f2aae0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1342118535 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea47f2aae0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 0x55ea480b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480b7470 con 0x55ea480b49e0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 0x55ea480b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 0x55ea480b6dd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1342118535 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcdbc008030 con 0x55ea480b49e0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480b3850 con 0x55ea47f2aae0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1342118535 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea47f2aae0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.101+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480b3d80 con 0x55ea480b49e0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1342118535 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcdbc008030 con 0x55ea480b49e0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ea47ecb450 con 0x55ea480c5be0 2024-09-12T00:19:12.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45456/0 (socket says 172.21.15.66:45456) 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/3959842535 learned_addr learned my addr 172.21.15.66:0/3959842535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/3959842535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea480c6640 con 0x55ea480c5be0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55ea480ad240 tx=0x7fcdc40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fccb27fc640 1 -- 172.21.15.66:0/3959842535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4013640 con 0x55ea480c5be0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fccb27fc640 1 -- 172.21.15.66:0/3959842535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc40137e0 con 0x55ea480c5be0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea480c6ea0 con 0x55ea480c5be0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fccb27fc640 1 -- 172.21.15.66:0/3959842535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4013ac0 con 0x55ea480c5be0 2024-09-12T00:19:12.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea480c7410 con 0x55ea480c5be0 2024-09-12T00:19:12.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fccb27fc640 1 -- 172.21.15.66:0/3959842535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcdc4011040 con 0x55ea480c5be0 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.105+0000 7fccb27fc640 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 0x7fcca403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fccb27fc640 1 -- 172.21.15.66:0/3959842535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fcdc400e040 con 0x55ea480c5be0 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 0x7fcca403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 0x7fcca403bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc04ed50 tx=0x7fcdbc04ee30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ea480a42a0 con 0x55ea480d3550 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45472/0 (socket says 172.21.15.66:45472) 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/3173660540 learned_addr learned my addr 172.21.15.66:0/3173660540 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/3173660540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea480d3f00 con 0x55ea480d3550 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/3173660540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40508f0 tx=0x7fcdc40206f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c83f74e25e018d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcca3fff640 1 -- 172.21.15.66:0/3173660540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4041e60 con 0x55ea480d3550 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcca3fff640 1 -- 172.21.15.66:0/3173660540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4052110 con 0x55ea480d3550 2024-09-12T00:19:12.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcca3fff640 1 -- 172.21.15.66:0/3173660540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc402a3f0 con 0x55ea480d3550 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3173660540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 msgr2=0x55ea480d3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3173660540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40508f0 tx=0x7fcdc40206f0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3173660540 shutdown_connections 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3173660540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d3930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3173660540 >> 172.21.15.66:0/3173660540 conn(0x55ea480ce970 msgr2=0x55ea480ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3173660540 shutdown_connections 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3173660540 wait complete. 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 Processor -- start 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- start start 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcf0d19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ea480d24a0 con 0x55ea480d3550 2024-09-12T00:19:12.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45476/0 (socket says 172.21.15.66:45476) 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.109+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 learned_addr learned my addr 172.21.15.66:0/1235073429 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea480d9fb0 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4029550 tx=0x7fcdc404b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 -- 172.21.15.66:0/1235073429 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc402e070 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 -- 172.21.15.66:0/1235073429 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc403ecb0 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea480da240 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 -- 172.21.15.66:0/1235073429 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc4050a30 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea480da240 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 -- 172.21.15.66:0/1235073429 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcdc4050bd0 con 0x55ea480d3550 2024-09-12T00:19:12.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcc98039ac0 0x7fcc9803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcca27fc640 1 -- 172.21.15.66:0/1235073429 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fcdc4046070 con 0x55ea480d3550 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcc98039ac0 0x7fcc9803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea480e4da0 0x55ea480e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480e79b0 con 0x55ea480e4da0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea480e4da0 0x55ea480e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcc98039ac0 0x7fcc9803bf80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ea480ac550 tx=0x7fcdbc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea480e4da0 0x55ea480e7260 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 20 realm 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.113+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480e7d80 con 0x55ea480e4da0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480e8650 con 0x55ea480e4da0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480e89f0 con 0x55ea480e4da0 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480e9750 0x55ea480ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ec150 con 0x55ea480e9750 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480e9750 0x55ea480ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480e9750 0x55ea480ebb40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 20 searching for the correct realm 2024-09-12T00:19:12.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcdc4033460 0x7fcdc4008a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcdc4033460 0x7fcdc4008a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcdc4033460 0x7fcdc4008a80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdccbd7640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcdbc017050 0x7fcdbc050a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.117+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcdbc017050 0x7fcdbc050a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcdbc017050 0x7fcdbc050a60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.121+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.125+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e9750 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.129+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdbc017050 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x55ea480e4da0 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ea480eda20 con 0x7fcdc4033460 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:12.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ecaa0 con 0x55ea480e4da0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ed2f0 con 0x55ea480e4da0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ede50 con 0x55ea480e9750 2024-09-12T00:19:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 zone default found 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 4 Realm: () 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 zonegroup default 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ee1f0 con 0x7fcdbc017050 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f0090 con 0x55ea480e9750 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f0430 con 0x55ea480e9750 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 started sync module instance, tier type = 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.133+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480ef4d0 con 0x7fcdc4033460 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464719648960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480efce0 con 0x7fcdc4033460 2024-09-12T00:19:12.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f0f00 con 0x55ea480e4da0 2024-09-12T00:19:12.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464719648960] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464719653456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f0e70 con 0x55ea480e4da0 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.137+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f1cb0 con 0x55ea480e9750 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464719653456] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464719655664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f1c70 con 0x55ea480e9750 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f26c0 con 0x7fcdc4033460 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464719659536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f2f10 con 0x7fcdc4033460 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f3930 con 0x55ea480e4da0 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.141+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464719655664] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464719659536] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464719664160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f2a60 con 0x55ea480e4da0 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f41d0 con 0x7fcdbc017050 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464719664160] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464719656720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f2a60 con 0x7fcdbc017050 2024-09-12T00:19:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.145+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f46f0 con 0x7fcdbc017050 2024-09-12T00:19:12.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.149+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464719656720] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.149+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.149+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464719667648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f46b0 con 0x7fcdbc017050 2024-09-12T00:19:12.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.149+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f50d0 con 0x7fcdbc017050 2024-09-12T00:19:12.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464719667648] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464719670208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f5090 con 0x7fcdbc017050 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=0 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=1 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=2 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=3 2024-09-12T00:19:12.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=4 2024-09-12T00:19:12.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=5 2024-09-12T00:19:12.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=6 2024-09-12T00:19:12.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464719670208] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00b3040 con 0x7fcdbc017050 2024-09-12T00:19:12.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 20 add_watcher() i=7 2024-09-12T00:19:12.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:12.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f84c0 con 0x55ea480e4da0 2024-09-12T00:19:12.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcdc00b3040 con 0x55ea480e4da0 2024-09-12T00:19:12.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.153+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464719665952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea480f5a10 con 0x55ea480e4da0 2024-09-12T00:19:12.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464719665952] v31'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x55ea480e4da0 2024-09-12T00:19:12.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcc82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 5 note: GC not initialized 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcc81fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 Filter name: none 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcbf37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811bcf0 con 0x7fcdbc017050 2024-09-12T00:19:12.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811a2e0 con 0x7fcdbc017050 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:19:12.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.157+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811ee10 con 0x7fcdbc017050 2024-09-12T00:19:12.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v31'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T00:19:12.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T00:19:12.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T00:19:12.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94464719841200 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811f980 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== watch-notify(notify (1) cookie 94464719659536 notify 133143986188 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fcdbc056040 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcca3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94464719659536 notifier 4536 bl.length()=610 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcca3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcca3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.3 [notify cookie 94464719841200 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcca3fff640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc90003eb0 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== watch-notify(notify_complete (2) cookie 94464719841200 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea480ac2a0 con 0x7fcdc4033460 2024-09-12T00:19:12.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811e780 con 0x7fcdbc017050 2024-09-12T00:19:12.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:12.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:12.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:12.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.161+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94464719841152 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ea4811dcf0 con 0x55ea480e9750 2024-09-12T00:19:12.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94464719655664 notify 133143986180 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55ea480d9fb0 con 0x55ea480e9750 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcca3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94464719655664 notifier 4536 bl.length()=192 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcca3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcca3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcca3fff640 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fcc90003eb0 con 0x55ea480e9750 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 notify.2 [notify cookie 94464719841152 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== watch-notify(notify_complete (2) cookie 94464719841152 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea480d3f00 con 0x55ea480e9750 2024-09-12T00:19:12.169 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T00:19:12.162801Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:12.162787Z","tags":[],"group_ids":[]} 2024-09-12T00:19:12.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcc82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464719665952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x55ea480e4da0 2024-09-12T00:19:12.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94464719665952] v31'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x55ea480e4da0 2024-09-12T00:19:12.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.165+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464719648960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x7fcdc4033460 2024-09-12T00:19:12.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94464719648960] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcf0d19c0 20 remove_watcher() i=0 2024-09-12T00:19:12.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcf0d19c0 2 removed watcher, disabling cache 2024-09-12T00:19:12.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464719653456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x55ea480e4da0 2024-09-12T00:19:12.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94464719653456] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x55ea480e4da0 2024-09-12T00:19:12.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcf0d19c0 20 remove_watcher() i=1 2024-09-12T00:19:12.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.169+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464719655664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x55ea480e9750 2024-09-12T00:19:12.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcd3d8640 1 -- 172.21.15.66:0/1235073429 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94464719655664] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc400a4d0 con 0x55ea480e9750 2024-09-12T00:19:12.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 20 remove_watcher() i=2 2024-09-12T00:19:12.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464719659536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x7fcdc4033460 2024-09-12T00:19:12.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdccbd7640 1 -- 172.21.15.66:0/1235073429 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94464719659536] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdbc035050 con 0x7fcdc4033460 2024-09-12T00:19:12.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 20 remove_watcher() i=3 2024-09-12T00:19:12.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464719664160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x55ea480e4da0 2024-09-12T00:19:12.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94464719664160] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x55ea480e4da0 2024-09-12T00:19:12.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 20 remove_watcher() i=4 2024-09-12T00:19:12.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.173+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464719656720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x7fcdbc017050 2024-09-12T00:19:12.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94464719656720] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcf0d19c0 20 remove_watcher() i=5 2024-09-12T00:19:12.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464719667648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x7fcdbc017050 2024-09-12T00:19:12.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94464719667648] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcf0d19c0 20 remove_watcher() i=6 2024-09-12T00:19:12.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.177+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464719670208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ea48119840 con 0x7fcdbc017050 2024-09-12T00:19:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94464719670208] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc00d7040 con 0x7fcdbc017050 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 20 remove_watcher() i=7 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcdbc017050 msgr2=0x7fcdbc050a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcdbc017050 0x7fcdbc050a60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea480e4da0 msgr2=0x55ea480e7260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea480e4da0 0x55ea480e7260 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcdc4033460 msgr2=0x7fcdc4008a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcdc4033460 0x7fcdc4008a80 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480e9750 msgr2=0x55ea480ebb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480e9750 0x55ea480ebb40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcc98039ac0 msgr2=0x7fcc9803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcc98039ac0 0x7fcc9803bf80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ea480ac550 tx=0x7fcdbc032000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcc3d6640 1 -- 172.21.15.66:0/1235073429 reap_dead start 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 msgr2=0x55ea480d9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4029550 tx=0x7fcdc404b040 comp rx=0 tx=0).stop 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 shutdown_connections 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1235073429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480d3550 0x55ea480d9a50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 >> 172.21.15.66:0/1235073429 conn(0x55ea480ce970 msgr2=0x55ea480ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 shutdown_connections 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1235073429 wait complete. 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 msgr2=0x7fcca403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 0x7fcca403bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc04ed50 tx=0x7fcdbc04ee30 comp rx=0 tx=0).stop 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 msgr2=0x55ea480c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55ea480ad240 tx=0x7fcdc40167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 shutdown_connections 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcca4039a70 0x7fcca403bf30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/3959842535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea480c5be0 0x55ea480c6000 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 >> 172.21.15.66:0/3959842535 conn(0x55ea480bb590 msgr2=0x55ea480bb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 shutdown_connections 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/3959842535 wait complete. 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 msgr2=0x55ea480b2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 0x55ea480b2270 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 msgr2=0x55ea480b6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 0x55ea480b6dd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 msgr2=0x7fccb403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 0x7fccb403bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ad000 tx=0x7fcdc00a5040 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 msgr2=0x55ea480ab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55ea480a4a60 tx=0x7fcdbc000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 shutdown_connections 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ea480b49e0 0x55ea480b6dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ea47f2aae0 0x55ea480b2270 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fccb4039a70 0x7fccb403bf30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 --2- 172.21.15.66:0/1342118535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ea47f2a700 0x55ea480ab100 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 >> 172.21.15.66:0/1342118535 conn(0x55ea47fb0e20 msgr2=0x55ea4809e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 shutdown_connections 2024-09-12T00:19:12.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.181+0000 7fcdcf0d19c0 1 -- 172.21.15.66:0/1342118535 wait complete. 2024-09-12T00:19:12.198 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T00:19:12.162801Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:12.162787Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:12.199 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T00:19:12.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T00:19:12.199 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-12T00:19:12.235 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:12.235 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.229+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bf65a9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ce0a0f3850 0x55ce0a0f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bf65a9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce09fa19c0 con 0x55ce0a0ef700 2024-09-12T00:19:12.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bf65a9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ce09ff16d0 con 0x55ce0a0f3850 2024-09-12T00:19:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bc95f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ce0a0f3850 0x55ce0a0f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bd160640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55ce0a0ef700 0x55ce0a0efae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43046/0 (socket says 172.21.15.66:43046) 2024-09-12T00:19:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bd160640 1 -- 172.21.15.66:0/1934590907 learned_addr learned my addr 172.21.15.66:0/1934590907 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bc95f640 1 -- 172.21.15.66:0/1934590907 >> v1:172.21.15.31:6789/0 conn(0x55ce0a0ef700 legacy=0x55ce0a0efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bc95f640 1 -- 172.21.15.66:0/1934590907 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce09f95ca0 con 0x55ce0a0f3850 2024-09-12T00:19:12.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/1934590907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0f3850 0x55ce0a0f5c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400a480 tx=0x7fb0b401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f40de87baab959 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.233+0000 7fb0affff640 1 -- 172.21.15.66:0/1934590907 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b40aa570 con 0x55ce0a0f3850 2024-09-12T00:19:12.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0affff640 1 -- 172.21.15.66:0/1934590907 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b40af070 con 0x55ce0a0f3850 2024-09-12T00:19:12.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0affff640 1 -- 172.21.15.66:0/1934590907 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b40aa860 con 0x55ce0a0f3850 2024-09-12T00:19:12.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/1934590907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0f3850 msgr2=0x55ce0a0f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/1934590907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0f3850 0x55ce0a0f5c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400a480 tx=0x7fb0b401b310 comp rx=0 tx=0).stop 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/1934590907 shutdown_connections 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/1934590907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0f3850 0x55ce0a0f5c40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/1934590907 >> 172.21.15.66:0/1934590907 conn(0x55ce0a063010 msgr2=0x55ce0a063420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/1934590907 shutdown_connections 2024-09-12T00:19:12.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.237+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/1934590907 wait complete. 2024-09-12T00:19:12.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.249+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.249+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.249+0000 7fb0bf65a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.249+0000 7fb0bf65a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ce09ff5680 con 0x55ce0a0ef700 2024-09-12T00:19:12.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45488/0 (socket says 172.21.15.66:45488) 2024-09-12T00:19:12.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 -- 172.21.15.66:0/2336689667 learned_addr learned my addr 172.21.15.66:0/2336689667 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 -- 172.21.15.66:0/2336689667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce09f70da0 con 0x55ce0a0ef700 2024-09-12T00:19:12.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 --2- 172.21.15.66:0/2336689667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0001e00 tx=0x7fb0b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ca635e555d8ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fafab606640 1 -- 172.21.15.66:0/2336689667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0012020 con 0x55ce0a0ef700 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fafab606640 1 -- 172.21.15.66:0/2336689667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b000e690 con 0x55ce0a0ef700 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fafab606640 1 -- 172.21.15.66:0/2336689667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b000ea10 con 0x55ce0a0ef700 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2336689667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 msgr2=0x55ce0a1da9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2336689667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0001e00 tx=0x7fb0b000b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2336689667 shutdown_connections 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2336689667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1da9c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2336689667 >> 172.21.15.66:0/2336689667 conn(0x55ce0a063010 msgr2=0x55ce0a1d6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2336689667 shutdown_connections 2024-09-12T00:19:12.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2336689667 wait complete. 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bf65a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ce09f97a50 con 0x55ce0a0ef700 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45494/0 (socket says 172.21.15.66:45494) 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.253+0000 7fb0bd160640 1 -- 172.21.15.66:0/937428019 learned_addr learned my addr 172.21.15.66:0/937428019 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bd160640 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a1e2610 con 0x55ce0a0ef700 2024-09-12T00:19:12.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bd160640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55ce0a1db9b0 tx=0x7fb0b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 -- 172.21.15.66:0/937428019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b0012030 con 0x55ce0a0ef700 2024-09-12T00:19:12.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 -- 172.21.15.66:0/937428019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0001460 con 0x55ce0a0ef700 2024-09-12T00:19:12.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce0a1e28a0 con 0x55ce0a0ef700 2024-09-12T00:19:12.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 -- 172.21.15.66:0/937428019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b001a7a0 con 0x55ce0a0ef700 2024-09-12T00:19:12.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0a1e3250 con 0x55ce0a0ef700 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 -- 172.21.15.66:0/937428019 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b0015020 con 0x55ce0a0ef700 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 0x7fafa403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fafa9e03640 1 -- 172.21.15.66:0/937428019 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0b0020030 con 0x55ce0a0ef700 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 0x7fafa403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 0x55ce0a1e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a1e9760 con 0x55ce0a0f3850 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bd961640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 0x55ce0a1e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 0x7fafa403bf80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40ae000 tx=0x7fb0b40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bd961640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 0x55ce0a1e9220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bd961640 1 -- 172.21.15.66:0/937428019 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55ce0a0f3850 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.257+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a1e9bb0 con 0x55ce0a0f3850 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 -- 172.21.15.66:0/937428019 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55ce0a0f3850 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 0x55ce0a1eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a1ee450 con 0x55ce0a1eb9c0 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd160640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 0x55ce0a1eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd160640 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 0x55ce0a1eddb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd160640 1 -- 172.21.15.66:0/937428019 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0b0008030 con 0x55ce0a1eb9c0 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a1ea800 con 0x55ce0a0f3850 2024-09-12T00:19:12.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 -- 172.21.15.66:0/937428019 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b800a4d0 con 0x55ce0a0f3850 2024-09-12T00:19:12.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a1ead30 con 0x55ce0a1eb9c0 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd160640 1 -- 172.21.15.66:0/937428019 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0b0008030 con 0x55ce0a1eb9c0 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a002450 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45502/0 (socket says 172.21.15.66:45502) 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 -- 172.21.15.66:0/2059779262 learned_addr learned my addr 172.21.15.66:0/2059779262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 -- 172.21.15.66:0/2059779262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a1fd620 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bd961640 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55ce0a1e9b00 tx=0x7fb0b80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fafa2ffd640 1 -- 172.21.15.66:0/2059779262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b8013640 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fafa2ffd640 1 -- 172.21.15.66:0/2059779262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80137e0 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fafa2ffd640 1 -- 172.21.15.66:0/2059779262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b8013ac0 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.261+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce0a1fde80 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0a1fe3f0 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa2ffd640 1 -- 172.21.15.66:0/2059779262 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b8011040 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa2ffd640 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 0x7faf9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa2ffd640 1 -- 172.21.15.66:0/2059779262 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0b800e040 con 0x55ce0a1fcbc0 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd160640 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 0x7faf9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd160640 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 0x7faf9403bf30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c720 tx=0x7fb0b000c390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bf65a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bf65a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a1db210 con 0x55ce0a209500 2024-09-12T00:19:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45504/0 (socket says 172.21.15.66:45504) 2024-09-12T00:19:12.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd961640 1 -- 172.21.15.66:0/3808043073 learned_addr learned my addr 172.21.15.66:0/3808043073 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd961640 1 -- 172.21.15.66:0/3808043073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a209eb0 con 0x55ce0a209500 2024-09-12T00:19:12.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fb0bd961640 1 --2- 172.21.15.66:0/3808043073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8050870 tx=0x7fb0b801fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed168d0412b1947c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa0ff9640 1 -- 172.21.15.66:0/3808043073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b802a910 con 0x55ce0a209500 2024-09-12T00:19:12.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa0ff9640 1 -- 172.21.15.66:0/3808043073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b8013c60 con 0x55ce0a209500 2024-09-12T00:19:12.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.265+0000 7fafa0ff9640 1 -- 172.21.15.66:0/3808043073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b802aab0 con 0x55ce0a209500 2024-09-12T00:19:12.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3808043073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 msgr2=0x55ce0a2098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3808043073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8050870 tx=0x7fb0b801fe60 comp rx=0 tx=0).stop 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3808043073 shutdown_connections 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3808043073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2098e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3808043073 >> 172.21.15.66:0/3808043073 conn(0x55ce0a205930 msgr2=0x55ce0a203b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3808043073 shutdown_connections 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3808043073 wait complete. 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 Processor -- start 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- start start 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ce0a20a510 con 0x55ce0a209500 2024-09-12T00:19:12.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bd961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45516/0 (socket says 172.21.15.66:45516) 2024-09-12T00:19:12.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 learned_addr learned my addr 172.21.15.66:0/3281902475 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0a210f40 con 0x55ce0a209500 2024-09-12T00:19:12.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bd961640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb0b801fea0 tx=0x7fb0b8050800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7faf92ffd640 1 -- 172.21.15.66:0/3281902475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b802a3f0 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7faf92ffd640 1 -- 172.21.15.66:0/3281902475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b802a590 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce0a2111d0 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7faf92ffd640 1 -- 172.21.15.66:0/3281902475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0b804f400 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0a211b80 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.269+0000 7faf92ffd640 1 -- 172.21.15.66:0/3281902475 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb0b803ea20 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7faf92ffd640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf88039a70 0x7faf8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7faf92ffd640 1 -- 172.21.15.66:0/3281902475 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fb0b8048040 con 0x55ce0a209500 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd160640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf88039a70 0x7faf8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a21bf10 0x55ce0a21e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a21eb20 con 0x55ce0a21bf10 2024-09-12T00:19:12.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a21bf10 0x55ce0a21e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd160640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf88039a70 0x7faf8803bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0042010 tx=0x7fb0b0044000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a21bf10 0x55ce0a21e3d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 realm 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a21ef50 con 0x55ce0a21bf10 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a21f820 con 0x55ce0a21bf10 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a21fbc0 con 0x55ce0a21bf10 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a220920 0x55ce0a222d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a223320 con 0x55ce0a220920 2024-09-12T00:19:12.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a220920 0x55ce0a222d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a220920 0x55ce0a222d10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 20 searching for the correct realm 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb0b803c440 0x7fb0b8011790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.273+0000 7fb0bd160640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb0b803c440 0x7fb0b8011790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bd160640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb0b803c440 0x7fb0b8011790 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bd160640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb0b0017050 0x7fb0b00409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb0b0017050 0x7fb0b00409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb0b0017050 0x7fb0b00409e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.277+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.281+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.285+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a220920 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b0017050 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x55ce0a21bf10 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224bf0 con 0x7fb0b803c440 2024-09-12T00:19:12.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a223d70 con 0x55ce0a21bf10 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a2245c0 con 0x55ce0a21bf10 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a224f90 con 0x55ce0a220920 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 zone default found 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 4 Realm: () 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:12.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 zonegroup default 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a2253c0 con 0x7fb0b0017050 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a2276a0 con 0x55ce0a220920 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.289+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a227a70 con 0x55ce0a220920 2024-09-12T00:19:12.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 20 started sync module instance, tier type = 2024-09-12T00:19:12.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:12.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a226b30 con 0x7fb0b803c440 2024-09-12T00:19:12.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343421652768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a226790 con 0x7fb0b803c440 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a2289a0 con 0x55ce0a21bf10 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.293+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343421652768] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343421658352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a228dc0 con 0x55ce0a21bf10 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a229670 con 0x55ce0a220920 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343421660608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a2291e0 con 0x55ce0a220920 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22a5a0 con 0x7fb0b803c440 2024-09-12T00:19:12.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343421658352] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343421665456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22a9c0 con 0x7fb0b803c440 2024-09-12T00:19:12.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.297+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22b380 con 0x55ce0a21bf10 2024-09-12T00:19:12.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343421660608] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343421665456] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343421659408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22aed0 con 0x55ce0a21bf10 2024-09-12T00:19:12.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22bc20 con 0x7fb0b0017050 2024-09-12T00:19:12.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343421659408] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343421663840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22b940 con 0x7fb0b0017050 2024-09-12T00:19:12.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.301+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22c190 con 0x7fb0b0017050 2024-09-12T00:19:12.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.305+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343421663840] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.305+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.305+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343421670816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22bfd0 con 0x7fb0b0017050 2024-09-12T00:19:12.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.305+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22caf0 con 0x7fb0b0017050 2024-09-12T00:19:12.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.305+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343421670816] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343421674944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22cab0 con 0x7fb0b0017050 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=0 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=1 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=2 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=3 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=4 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=5 2024-09-12T00:19:12.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=6 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343421674944] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x7fb0b0017050 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 20 add_watcher() i=7 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22ff10 con 0x55ce0a21bf10 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343421671968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a22d430 con 0x55ce0a21bf10 2024-09-12T00:19:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343421671968] v31'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0b40a8070 con 0x55ce0a21bf10 2024-09-12T00:19:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.309+0000 7faf73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 5 note: GC not initialized 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7faf72fe5640 20 reqs_thread_entry: start 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 Filter name: none 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7faf70fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T00:19:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a253620 con 0x7fb0b0017050 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a252f70 con 0x7fb0b803c440 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a256e30 con 0x55ce0a220920 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:12.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:12.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.313+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25b050 con 0x7fb0b803c440 2024-09-12T00:19:12.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 foo.buckets [call] v31'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 8.19 8:9d8444c3:root::.bucket.meta.testx%3amyfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25ed20 con 0x55ce0a21bf10 2024-09-12T00:19:12.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [create,call,writefull 0~420,setxattr (203)] v31'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x7 2024-09-12T00:19:12.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.317+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94343421879936 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cb80 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== watch-notify(notify (1) cookie 94343421663840 notify 133143986187 ret 0) ==== 897+0+0 (crc 0 0 0) 0x55ce0a25f110 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fafa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94343421663840 notifier 4543 bl.length()=855 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fafa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x7 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fafa0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fafa0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fafa0ff9640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faf80003eb0 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(67 notify.5 [notify cookie 94343421879936 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== watch-notify(notify_complete (2) cookie 94343421879936 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce0a25d4a0 con 0x7fb0b0017050 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 20 handle_bi_update(): bucket=testx:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:12.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 20 handle_bi_update(): bucket=testx:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:12.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 20 handle_bi_update(): bucket=testx:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:12.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 20 handle_bi_update(): bucket=testx:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:12.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cc60 con 0x55ce0a21bf10 2024-09-12T00:19:12.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cc60 con 0x55ce0a21bf10 2024-09-12T00:19:12.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.321+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94343421872048 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cbd0 con 0x55ce0a21bf10 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== watch-notify(notify (1) cookie 94343421659408 notify 133143986193 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55ce0a25d000 con 0x55ce0a21bf10 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7faf93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94343421659408 notifier 4543 bl.length()=348 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7faf93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7faf93fff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7faf93fff640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faee4003410 con 0x55ce0a21bf10 2024-09-12T00:19:12.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(71 notify.4 [notify cookie 94343421872048 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94343421872048 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce0a25e680 con 0x55ce0a21bf10 2024-09-12T00:19:12.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cc60 con 0x7fb0b803c440 2024-09-12T00:19:12.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(73 myfoo [call,delete] v31'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bf65a9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T00:19:12.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bf65a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:12.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94343421872048 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cbd0 con 0x7fb0b0017050 2024-09-12T00:19:12.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== watch-notify(notify (1) cookie 94343421670816 notify 133143986188 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ce0a25e680 con 0x7fb0b0017050 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fafa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94343421670816 notifier 4543 bl.length()=149 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fafa0ff9640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faf80003eb0 con 0x7fb0b0017050 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.325+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(74 notify.6 [notify cookie 94343421872048 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== watch-notify(notify_complete (2) cookie 94343421872048 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce0a25d4a0 con 0x7fb0b0017050 2024-09-12T00:19:12.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:76 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cc60 con 0x55ce0a220920 2024-09-12T00:19:12.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(76 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call,delete] v31'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bf65a9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 from cache 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bf65a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94343421848992 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a25cc60 con 0x7fb0b0017050 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== watch-notify(notify (1) cookie 94343421670816 notify 133143986189 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ce0a25d4a0 con 0x7fb0b0017050 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7faf93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94343421670816 notifier 4543 bl.length()=206 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7faf93fff640 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faee4003410 con 0x7fb0b0017050 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(77 notify.6 [notify cookie 94343421848992 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.329+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== watch-notify(notify_complete (2) cookie 94343421848992 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce09f95ca0 con 0x7fb0b0017050 2024-09-12T00:19:12.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7faf73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343421671968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x55ce0a21bf10 2024-09-12T00:19:12.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94343421671968] v31'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343421652768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x7fb0b803c440 2024-09-12T00:19:12.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94343421652768] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bf65a9c0 20 remove_watcher() i=0 2024-09-12T00:19:12.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bf65a9c0 2 removed watcher, disabling cache 2024-09-12T00:19:12.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.333+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343421658352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x55ce0a21bf10 2024-09-12T00:19:12.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94343421658352] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bf65a9c0 20 remove_watcher() i=1 2024-09-12T00:19:12.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343421660608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x55ce0a220920 2024-09-12T00:19:12.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bd961640 1 -- 172.21.15.66:0/3281902475 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94343421660608] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b8039020 con 0x55ce0a220920 2024-09-12T00:19:12.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bf65a9c0 20 remove_watcher() i=2 2024-09-12T00:19:12.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.337+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343421665456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x7fb0b803c440 2024-09-12T00:19:12.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bd160640 1 -- 172.21.15.66:0/3281902475 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94343421665456] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b0008030 con 0x7fb0b803c440 2024-09-12T00:19:12.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bf65a9c0 20 remove_watcher() i=3 2024-09-12T00:19:12.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343421659408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x55ce0a21bf10 2024-09-12T00:19:12.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94343421659408] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x55ce0a21bf10 2024-09-12T00:19:12.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bf65a9c0 20 remove_watcher() i=4 2024-09-12T00:19:12.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.341+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343421663840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x7fb0b0017050 2024-09-12T00:19:12.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94343421663840] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bf65a9c0 20 remove_watcher() i=5 2024-09-12T00:19:12.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343421670816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x7fb0b0017050 2024-09-12T00:19:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94343421670816] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bf65a9c0 20 remove_watcher() i=6 2024-09-12T00:19:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.345+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343421674944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ce0a251200 con 0x7fb0b0017050 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94343421674944] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0b40d5040 con 0x7fb0b0017050 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 20 remove_watcher() i=7 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb0b0017050 msgr2=0x7fb0b00409e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb0b0017050 0x7fb0b00409e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a21bf10 msgr2=0x55ce0a21e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a21bf10 0x55ce0a21e3d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb0b803c440 msgr2=0x7fb0b8011790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb0b803c440 0x7fb0b8011790 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a220920 msgr2=0x55ce0a222d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a220920 0x55ce0a222d10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf88039a70 msgr2=0x7faf8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf88039a70 0x7faf8803bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0042010 tx=0x7fb0b0044000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bc95f640 1 -- 172.21.15.66:0/3281902475 reap_dead start 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 msgr2=0x55ce0a2109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb0b801fea0 tx=0x7fb0b8050800 comp rx=0 tx=0).stop 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 shutdown_connections 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/3281902475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a209500 0x55ce0a2109e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 >> 172.21.15.66:0/3281902475 conn(0x55ce0a205930 msgr2=0x55ce0a203b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 shutdown_connections 2024-09-12T00:19:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/3281902475 wait complete. 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 msgr2=0x7faf9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 0x7faf9403bf30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c720 tx=0x7fb0b000c390 comp rx=0 tx=0).stop 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 msgr2=0x55ce0a1fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55ce0a1e9b00 tx=0x7fb0b80167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 shutdown_connections 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faf94039a70 0x7faf9403bf30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/2059779262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a1fcbc0 0x55ce0a1fcfe0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 >> 172.21.15.66:0/2059779262 conn(0x55ce0a1f2570 msgr2=0x55ce0a1f2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 shutdown_connections 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/2059779262 wait complete. 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 msgr2=0x55ce0a1e9220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 0x55ce0a1e9220 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 msgr2=0x55ce0a1eddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 0x55ce0a1eddb0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 msgr2=0x7fafa403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 0x7fafa403bf80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40ae000 tx=0x7fb0b40a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 msgr2=0x55ce0a1e20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55ce0a1db9b0 tx=0x7fb0b0000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 shutdown_connections 2024-09-12T00:19:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ce0a1eb9c0 0x55ce0a1eddb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ce0a0f3850 0x55ce0a1e9220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fafa4039ac0 0x7fafa403bf80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 --2- 172.21.15.66:0/937428019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ce0a0ef700 0x55ce0a1e20b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 >> 172.21.15.66:0/937428019 conn(0x55ce0a063010 msgr2=0x55ce0a1d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 shutdown_connections 2024-09-12T00:19:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.349+0000 7fb0bf65a9c0 1 -- 172.21.15.66:0/937428019 wait complete. 2024-09-12T00:19:12.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T00:19:12.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T00:19:12.366 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-12T00:19:12.443 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:12.443 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:12.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6c9939c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56443206f770 0x56443206fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6c9939c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564431f219c0 con 0x5644320728b0 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6c9939c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564431f716d0 con 0x56443206f770 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6a499640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56443206f770 0x56443206fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6a499640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56443206f770 0x56443206fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45518/0 (socket says 172.21.15.66:45518) 2024-09-12T00:19:12.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6a499640 1 -- 172.21.15.66:0/2053109192 learned_addr learned my addr 172.21.15.66:0/2053109192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe69c98640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5644320728b0 0x564432074ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43062/0 (socket says 172.21.15.66:43062) 2024-09-12T00:19:12.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6a499640 1 -- 172.21.15.66:0/2053109192 >> v1:172.21.15.31:6789/0 conn(0x5644320728b0 legacy=0x564432074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.441+0000 7fbe6a499640 1 -- 172.21.15.66:0/2053109192 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564431f15ca0 con 0x56443206f770 2024-09-12T00:19:12.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6a499640 1 --2- 172.21.15.66:0/2053109192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443206fb50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00a4e0 tx=0x7fbe5c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab90992e9666e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe69497640 1 -- 172.21.15.66:0/2053109192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0aa540 con 0x56443206f770 2024-09-12T00:19:12.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe69497640 1 -- 172.21.15.66:0/2053109192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0aa6e0 con 0x56443206f770 2024-09-12T00:19:12.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe69497640 1 -- 172.21.15.66:0/2053109192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0aaa40 con 0x56443206f770 2024-09-12T00:19:12.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2053109192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 msgr2=0x56443206fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2053109192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443206fb50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00a4e0 tx=0x7fbe5c01b090 comp rx=0 tx=0).stop 2024-09-12T00:19:12.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2053109192 shutdown_connections 2024-09-12T00:19:12.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2053109192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443206fb50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2053109192 >> 172.21.15.66:0/2053109192 conn(0x564431fe3080 msgr2=0x564431fe3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2053109192 shutdown_connections 2024-09-12T00:19:12.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.445+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2053109192 wait complete. 2024-09-12T00:19:12.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6c9939c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6c9939c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564431f75680 con 0x56443206f770 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6a499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6a499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45522/0 (socket says 172.21.15.66:45522) 2024-09-12T00:19:12.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6a499640 1 -- 172.21.15.66:0/4175287662 learned_addr learned my addr 172.21.15.66:0/4175287662 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6a499640 1 -- 172.21.15.66:0/4175287662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564431ef0da0 con 0x56443206f770 2024-09-12T00:19:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbe6a499640 1 --2- 172.21.15.66:0/4175287662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c017ca0 tx=0x7fbe5c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163f4c56d25cee9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbd58608640 1 -- 172.21.15.66:0/4175287662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b9030 con 0x56443206f770 2024-09-12T00:19:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbd58608640 1 -- 172.21.15.66:0/4175287662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0aaa80 con 0x56443206f770 2024-09-12T00:19:12.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.461+0000 7fbd58608640 1 -- 172.21.15.66:0/4175287662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0aada0 con 0x56443206f770 2024-09-12T00:19:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/4175287662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 msgr2=0x56443215aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/4175287662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c017ca0 tx=0x7fbe5c0033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/4175287662 shutdown_connections 2024-09-12T00:19:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/4175287662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x56443215aa40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/4175287662 >> 172.21.15.66:0/4175287662 conn(0x564431fe3080 msgr2=0x5644321566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/4175287662 shutdown_connections 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/4175287662 wait complete. 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564431f17a50 con 0x56443206f770 2024-09-12T00:19:12.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6a499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6a499640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45524/0 (socket says 172.21.15.66:45524) 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6a499640 1 -- 172.21.15.66:0/2271209669 learned_addr learned my addr 172.21.15.66:0/2271209669 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6a499640 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644321624d0 con 0x56443206f770 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6a499640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c017ca0 tx=0x7fbe5c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbd56e05640 1 -- 172.21.15.66:0/2271209669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b9070 con 0x56443206f770 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564432162760 con 0x56443206f770 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbd56e05640 1 -- 172.21.15.66:0/2271209669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0c3030 con 0x56443206f770 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbd56e05640 1 -- 172.21.15.66:0/2271209669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b5bf0 con 0x56443206f770 2024-09-12T00:19:12.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.465+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644321630c0 con 0x56443206f770 2024-09-12T00:19:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbd56e05640 1 -- 172.21.15.66:0/2271209669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe5c0b3040 con 0x56443206f770 2024-09-12T00:19:12.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbd56e05640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 0x7fbd5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbd56e05640 1 -- 172.21.15.66:0/2271209669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fbe5c0ba070 con 0x56443206f770 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe69c98640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 0x7fbd5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 0x564432169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321695d0 con 0x5644320728b0 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 0x564432169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe69c98640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 0x7fbd5003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe60001e90 tx=0x7fbe600013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 0x564432169090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/2271209669 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe640083f0 con 0x5644320728b0 2024-09-12T00:19:12.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321634a0 con 0x5644320728b0 2024-09-12T00:19:12.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/2271209669 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe640083f0 con 0x5644320728b0 2024-09-12T00:19:12.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 0x56443216dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443216e300 con 0x56443216b840 2024-09-12T00:19:12.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6a499640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 0x56443216dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6a499640 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 0x56443216dc30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6a499640 1 -- 172.21.15.66:0/2271209669 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe5c0cf070 con 0x56443216b840 2024-09-12T00:19:12.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443216a6e0 con 0x5644320728b0 2024-09-12T00:19:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/2271209669 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe640083f0 con 0x5644320728b0 2024-09-12T00:19:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443216aba0 con 0x56443216b840 2024-09-12T00:19:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6a499640 1 -- 172.21.15.66:0/2271209669 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe5c0cf070 con 0x56443216b840 2024-09-12T00:19:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.469+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564431f82450 con 0x56443217ca30 2024-09-12T00:19:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45538/0 (socket says 172.21.15.66:45538) 2024-09-12T00:19:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/164277476 learned_addr learned my addr 172.21.15.66:0/164277476 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/164277476 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443217d490 con 0x56443217ca30 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5644321632b0 tx=0x7fbe6400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 -- 172.21.15.66:0/164277476 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6401c020 con 0x56443217ca30 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 -- 172.21.15.66:0/164277476 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe64007d00 con 0x56443217ca30 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 -- 172.21.15.66:0/164277476 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe64018440 con 0x56443217ca30 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56443217dcf0 con 0x56443217ca30 2024-09-12T00:19:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443217e260 con 0x56443217ca30 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 -- 172.21.15.66:0/164277476 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe6401f020 con 0x56443217ca30 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 0x7fbd4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbd4ffff640 1 -- 172.21.15.66:0/164277476 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fbe64051db0 con 0x56443217ca30 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6a499640 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 0x7fbd4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.473+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56443215b1b0 con 0x564432189330 2024-09-12T00:19:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6a499640 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 0x7fbd4403bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56443216e6d0 tx=0x7fbe5c0aa670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45550/0 (socket says 172.21.15.66:45550) 2024-09-12T00:19:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/916463379 learned_addr learned my addr 172.21.15.66:0/916463379 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/916463379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564432189ce0 con 0x564432189330 2024-09-12T00:19:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/916463379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbe64050100 tx=0x7fbe64050300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb02d4c721eb079 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbd4dffb640 1 -- 172.21.15.66:0/916463379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe64021400 con 0x564432189330 2024-09-12T00:19:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbd4dffb640 1 -- 172.21.15.66:0/916463379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe64029c50 con 0x564432189330 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbd4dffb640 1 -- 172.21.15.66:0/916463379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe640215a0 con 0x564432189330 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/916463379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 msgr2=0x564432189710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/916463379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbe64050100 tx=0x7fbe64050300 comp rx=0 tx=0).stop 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/916463379 shutdown_connections 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/916463379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432189710 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/916463379 >> 172.21.15.66:0/916463379 conn(0x564432185760 msgr2=0x5644321839a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/916463379 shutdown_connections 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/916463379 wait complete. 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 Processor -- start 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- start start 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6c9939c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56443218a340 con 0x564432189330 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45564/0 (socket says 172.21.15.66:45564) 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 learned_addr learned my addr 172.21.15.66:0/554122091 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.477+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564432190d60 con 0x564432189330 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe6404efd0 tx=0x7fbe64050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 -- 172.21.15.66:0/554122091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe64028af0 con 0x564432189330 2024-09-12T00:19:12.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564432190ff0 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 -- 172.21.15.66:0/554122091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe64028c90 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 -- 172.21.15.66:0/554122091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe640203b0 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644321919a0 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 -- 172.21.15.66:0/554122091 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbe64016040 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd34039a70 0x7fbd3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbd3bfff640 1 -- 172.21.15.66:0/554122091 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fbe64035c80 con 0x564432189330 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6a499640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd34039a70 0x7fbd3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56443219bd20 0x56443219e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443219e900 con 0x56443219bd20 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe69c98640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56443219bd20 0x56443219e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6a499640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd34039a70 0x7fbd3403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5644321699e0 tx=0x7fbe5c0d5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe69c98640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56443219bd20 0x56443219e1b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6000f660 con 0x56443219bd20 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 realm 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443219b130 con 0x56443219bd20 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6000f660 con 0x56443219bd20 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443219f400 con 0x56443219bd20 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6000f660 con 0x56443219bd20 2024-09-12T00:19:12.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.481+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56443219fcd0 con 0x56443219bd20 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe6000f660 con 0x56443219bd20 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5644321a0580 0x5644321a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a30d0 con 0x5644321a0580 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5644321a0580 0x5644321a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5644321a0580 0x5644321a2970 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:12.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 20 searching for the correct realm 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbe64021020 0x7fbe64024940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6a499640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbe64021020 0x7fbe64024940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6a499640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbe64021020 0x7fbe64024940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6a499640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbe5c0f8040 0x7fbe5c0be410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe69c98640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbe5c0f8040 0x7fbe5c0be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.485+0000 7fbe69c98640 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbe5c0f8040 0x7fbe5c0be410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6000f660 con 0x7fbe5c0f8040 2024-09-12T00:19:12.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6000f660 con 0x56443219bd20 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.489+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.493+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6002b040 con 0x56443219bd20 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x5644321a0580 2024-09-12T00:19:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x56443219bd20 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5644321a49f0 con 0x7fbe64021020 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:12.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.497+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a3b10 con 0x56443219bd20 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a43b0 con 0x56443219bd20 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a3750 con 0x5644321a0580 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 zone default found 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 4 Realm: () 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 zonegroup default 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a3fe0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a6dc0 con 0x5644321a0580 2024-09-12T00:19:12.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321a7210 con 0x5644321a0580 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 started sync module instance, tier type = 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a6260 con 0x7fbe64021020 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94850898353584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a7670 con 0x7fbe64021020 2024-09-12T00:19:12.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.501+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a7ec0 con 0x56443219bd20 2024-09-12T00:19:12.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.505+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94850898353584] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.505+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.505+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94850898355840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a8000 con 0x56443219bd20 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.505+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a8b20 con 0x5644321a0580 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94850898355840] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94850898363888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a8ae0 con 0x5644321a0580 2024-09-12T00:19:12.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a9530 con 0x7fbe64021020 2024-09-12T00:19:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94850898366592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321a9dd0 con 0x7fbe64021020 2024-09-12T00:19:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321aa7d0 con 0x56443219bd20 2024-09-12T00:19:12.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94850898363888] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94850898366592] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94850898368800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321aa2e0 con 0x56443219bd20 2024-09-12T00:19:12.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.509+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ab070 con 0x7fbe5c0f8040 2024-09-12T00:19:12.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.513+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94850898368800] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.513+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.513+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94850898360912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321aafe0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.513+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ab9a0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94850898360912] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94850898373696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ab9a0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ac360 con 0x7fbe5c0f8040 2024-09-12T00:19:12.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94850898373696] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94850898376400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ac360 con 0x7fbe5c0f8040 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=0 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=1 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=2 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=3 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=4 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=5 2024-09-12T00:19:12.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.517+0000 7fbe6c9939c0 20 add_watcher() i=6 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94850898376400] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 add_watcher() i=7 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321af7a0 con 0x56443219bd20 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94850898391408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321ac580 con 0x56443219bd20 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94850898391408] v31'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbd20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 5 note: GC not initialized 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbc9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:12.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 Filter name: none 2024-09-12T00:19:12.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbc997fa640 20 reqs_thread_entry: start 2024-09-12T00:19:12.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.521+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5644321d2800 con 0x56443219bd20 2024-09-12T00:19:12.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:19:12.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbd20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94850898391408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x56443219bd20 2024-09-12T00:19:12.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94850898391408] v31'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94850898353584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x7fbe64021020 2024-09-12T00:19:12.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94850898353584] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 20 remove_watcher() i=0 2024-09-12T00:19:12.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 2 removed watcher, disabling cache 2024-09-12T00:19:12.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.525+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94850898355840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x56443219bd20 2024-09-12T00:19:12.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94850898355840] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe6c9939c0 20 remove_watcher() i=1 2024-09-12T00:19:12.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94850898363888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x5644321a0580 2024-09-12T00:19:12.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe6ac9a640 1 -- 172.21.15.66:0/554122091 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94850898363888] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6403a020 con 0x5644321a0580 2024-09-12T00:19:12.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe6c9939c0 20 remove_watcher() i=2 2024-09-12T00:19:12.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.529+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94850898366592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x7fbe64021020 2024-09-12T00:19:12.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe6a499640 1 -- 172.21.15.66:0/554122091 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94850898366592] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe5c0db030 con 0x7fbe64021020 2024-09-12T00:19:12.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe6c9939c0 20 remove_watcher() i=3 2024-09-12T00:19:12.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94850898368800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x56443219bd20 2024-09-12T00:19:12.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94850898368800] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x56443219bd20 2024-09-12T00:19:12.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe6c9939c0 20 remove_watcher() i=4 2024-09-12T00:19:12.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.533+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94850898360912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94850898360912] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe6c9939c0 20 remove_watcher() i=5 2024-09-12T00:19:12.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94850898373696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94850898373696] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe6c9939c0 20 remove_watcher() i=6 2024-09-12T00:19:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.537+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94850898376400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5644321d06f0 con 0x7fbe5c0f8040 2024-09-12T00:19:12.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94850898376400] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6003b040 con 0x7fbe5c0f8040 2024-09-12T00:19:12.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 20 remove_watcher() i=7 2024-09-12T00:19:12.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbe5c0f8040 msgr2=0x7fbe5c0be410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbe5c0f8040 0x7fbe5c0be410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56443219bd20 msgr2=0x56443219e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56443219bd20 0x56443219e1b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbe64021020 msgr2=0x7fbe64024940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbe64021020 0x7fbe64024940 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5644321a0580 msgr2=0x5644321a2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5644321a0580 0x5644321a2970 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd34039a70 msgr2=0x7fbd3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd34039a70 0x7fbd3403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x5644321699e0 tx=0x7fbe5c0d5000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 msgr2=0x564432190800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbe6404efd0 tx=0x7fbe64050090 comp rx=0 tx=0).stop 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe69c98640 1 -- 172.21.15.66:0/554122091 reap_dead start 2024-09-12T00:19:12.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 shutdown_connections 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/554122091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564432189330 0x564432190800 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 >> 172.21.15.66:0/554122091 conn(0x564432185760 msgr2=0x564432183970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 shutdown_connections 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/554122091 wait complete. 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 msgr2=0x7fbd4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 0x7fbd4403bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56443216e6d0 tx=0x7fbe5c0aa670 comp rx=0 tx=0).stop 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 msgr2=0x56443217ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x5644321632b0 tx=0x7fbe6400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 shutdown_connections 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd44039a70 0x7fbd4403bf30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/164277476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443217ca30 0x56443217ce50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 >> 172.21.15.66:0/164277476 conn(0x5644321723e0 msgr2=0x5644321727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 shutdown_connections 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/164277476 wait complete. 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 msgr2=0x564432169090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 0x564432169090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 msgr2=0x56443216dc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 0x56443216dc30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 msgr2=0x7fbd5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 0x7fbd5003bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe60001e90 tx=0x7fbe600013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 msgr2=0x564432161f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c017ca0 tx=0x7fbe5c017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 shutdown_connections 2024-09-12T00:19:12.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56443216b840 0x56443216dc30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5644320728b0 0x564432169090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd50039a70 0x7fbd5003bf30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 --2- 172.21.15.66:0/2271209669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56443206f770 0x564432161f70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 >> 172.21.15.66:0/2271209669 conn(0x564431fe3080 msgr2=0x564432155170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 shutdown_connections 2024-09-12T00:19:12.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.541+0000 7fbe6c9939c0 1 -- 172.21.15.66:0/2271209669 wait complete. 2024-09-12T00:19:12.558 INFO:teuthology.orchestra.run.smithi066.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"DobFGBAl57CH3HrdRTWrpGSe","ver":2},"mtime":"2024-09-12T00:19:12.326899Z","data":{"bucket":{"name":"myfoo","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","bucket_id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-12T00:19:08.903952Z","linked":true,"has_bucket_info":false}} 2024-09-12T00:19:12.559 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'DobFGBAl57CH3HrdRTWrpGSe', 'ver': 2}, 'mtime': '2024-09-12T00:19:12.326899Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'bucket_id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-12T00:19:08.903952Z', 'linked': True, 'has_bucket_info': False}} 2024-09-12T00:19:12.559 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T00:19:12.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T00:19:12.559 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-12T00:19:12.642 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:12.642 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.637+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.637+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.637+0000 7f6dbc6049c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5653db74d8c0 0x5653db74fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.637+0000 7f6dbc6049c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653db5fb9c0 con 0x5653db749770 2024-09-12T00:19:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.637+0000 7f6dbc6049c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5653db64b6d0 con 0x5653db74d8c0 2024-09-12T00:19:12.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5653db74d8c0 0x5653db74fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5653db74d8c0 0x5653db74fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45566/0 (socket says 172.21.15.66:45566) 2024-09-12T00:19:12.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 -- 172.21.15.66:0/1613069416 learned_addr learned my addr 172.21.15.66:0/1613069416 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6dba10a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5653db749770 0x5653db749b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43070/0 (socket says 172.21.15.66:43070) 2024-09-12T00:19:12.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 -- 172.21.15.66:0/1613069416 >> v1:172.21.15.31:6789/0 conn(0x5653db749770 legacy=0x5653db749b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 -- 172.21.15.66:0/1613069416 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db5efca0 con 0x5653db74d8c0 2024-09-12T00:19:12.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9909640 1 --2- 172.21.15.66:0/1613069416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db74d8c0 0x5653db74fcb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6db000a5c0 tx=0x7f6db001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a0aa79c5b077a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9108640 1 -- 172.21.15.66:0/1613069416 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db00a9590 con 0x5653db74d8c0 2024-09-12T00:19:12.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9108640 1 -- 172.21.15.66:0/1613069416 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db00ae070 con 0x5653db74d8c0 2024-09-12T00:19:12.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.641+0000 7f6db9108640 1 -- 172.21.15.66:0/1613069416 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db00a9880 con 0x5653db74d8c0 2024-09-12T00:19:12.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1613069416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db74d8c0 msgr2=0x5653db74fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1613069416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db74d8c0 0x5653db74fcb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6db000a5c0 tx=0x7f6db001b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1613069416 shutdown_connections 2024-09-12T00:19:12.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1613069416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db74d8c0 0x5653db74fcb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1613069416 >> 172.21.15.66:0/1613069416 conn(0x5653db6bd080 msgr2=0x5653db6bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1613069416 shutdown_connections 2024-09-12T00:19:12.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.645+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1613069416 wait complete. 2024-09-12T00:19:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dbc6049c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dbc6049c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5653db64f680 con 0x5653db749770 2024-09-12T00:19:12.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dba10a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dba10a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45572/0 (socket says 172.21.15.66:45572) 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dba10a640 1 -- 172.21.15.66:0/571235278 learned_addr learned my addr 172.21.15.66:0/571235278 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dba10a640 1 -- 172.21.15.66:0/571235278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db5cada0 con 0x5653db749770 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6dba10a640 1 --2- 172.21.15.66:0/571235278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6dac001680 tx=0x7f6dac001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b024999ba54daf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6ca8608640 1 -- 172.21.15.66:0/571235278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dac013420 con 0x5653db749770 2024-09-12T00:19:12.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6ca8608640 1 -- 172.21.15.66:0/571235278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac0135c0 con 0x5653db749770 2024-09-12T00:19:12.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.661+0000 7f6ca8608640 1 -- 172.21.15.66:0/571235278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dac0138e0 con 0x5653db749770 2024-09-12T00:19:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/571235278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 msgr2=0x5653db8349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/571235278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6dac001680 tx=0x7f6dac001b40 comp rx=0 tx=0).stop 2024-09-12T00:19:12.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/571235278 shutdown_connections 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/571235278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db8349b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/571235278 >> 172.21.15.66:0/571235278 conn(0x5653db6bd080 msgr2=0x5653db830650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/571235278 shutdown_connections 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/571235278 wait complete. 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5653db5f1a50 con 0x5653db749770 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dba10a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dba10a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45584/0 (socket says 172.21.15.66:45584) 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dba10a640 1 -- 172.21.15.66:0/1083046372 learned_addr learned my addr 172.21.15.66:0/1083046372 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dba10a640 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db83c5b0 con 0x5653db749770 2024-09-12T00:19:12.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dba10a640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5653db8359a0 tx=0x7f6dac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6ca6e05640 1 -- 172.21.15.66:0/1083046372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dac0037a0 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6ca6e05640 1 -- 172.21.15.66:0/1083046372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac023070 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653db83c840 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6ca6e05640 1 -- 172.21.15.66:0/1083046372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dac003ad0 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.665+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653db83d1f0 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6ca6e05640 1 -- 172.21.15.66:0/1083046372 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6dac010070 con 0x5653db749770 2024-09-12T00:19:12.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6ca6e05640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 0x7f6ca003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6ca6e05640 1 -- 172.21.15.66:0/1083046372 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6dac0502f0 con 0x5653db749770 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6db9909640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 0x7f6ca003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 0x5653db8431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db843700 con 0x5653db74d8c0 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba90b640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 0x5653db8431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6db9909640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 0x7f6ca003bf80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ad000 tx=0x7f6db00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba90b640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 0x5653db8431c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba90b640 1 -- 172.21.15.66:0/1083046372 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db40083f0 con 0x5653db74d8c0 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db843b50 con 0x5653db74d8c0 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba90b640 1 -- 172.21.15.66:0/1083046372 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6db40083f0 con 0x5653db74d8c0 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 0x5653db847d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db848420 con 0x5653db845960 2024-09-12T00:19:12.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba10a640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 0x5653db847d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba10a640 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 0x5653db847d50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dba10a640 1 -- 172.21.15.66:0/1083046372 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6dac00f030 con 0x5653db845960 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.669+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8447d0 con 0x5653db74d8c0 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 -- 172.21.15.66:0/1083046372 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6db40083f0 con 0x5653db74d8c0 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db844cb0 con 0x5653db845960 2024-09-12T00:19:12.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba10a640 1 -- 172.21.15.66:0/1083046372 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6dac00f030 con 0x5653db845960 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5653db65c450 con 0x5653db856b70 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45588/0 (socket says 172.21.15.66:45588) 2024-09-12T00:19:12.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 -- 172.21.15.66:0/3388696044 learned_addr learned my addr 172.21.15.66:0/3388696044 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 -- 172.21.15.66:0/3388696044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db8575d0 con 0x5653db856b70 2024-09-12T00:19:12.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dba90b640 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5653db83d080 tx=0x7f6db400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6c9ffff640 1 -- 172.21.15.66:0/3388696044 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db401c020 con 0x5653db856b70 2024-09-12T00:19:12.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653db857e30 con 0x5653db856b70 2024-09-12T00:19:12.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6c9ffff640 1 -- 172.21.15.66:0/3388696044 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db4007d00 con 0x5653db856b70 2024-09-12T00:19:12.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6c9ffff640 1 -- 172.21.15.66:0/3388696044 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db4018440 con 0x5653db856b70 2024-09-12T00:19:12.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.673+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653db8583a0 con 0x5653db856b70 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9ffff640 1 -- 172.21.15.66:0/3388696044 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6db401f020 con 0x5653db856b70 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9ffff640 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 0x7f6c9403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9ffff640 1 -- 172.21.15.66:0/3388696044 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6db4051db0 con 0x5653db856b70 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba10a640 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 0x7f6c9403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5653db835200 con 0x5653db863430 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba10a640 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 0x7f6c9403bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6dac01da60 tx=0x7f6dac006340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45604/0 (socket says 172.21.15.66:45604) 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba90b640 1 -- 172.21.15.66:0/1795287633 learned_addr learned my addr 172.21.15.66:0/1795287633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba90b640 1 -- 172.21.15.66:0/1795287633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db863e00 con 0x5653db863430 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dba90b640 1 --2- 172.21.15.66:0/1795287633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6db4050130 tx=0x7f6db4050240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34dd3a007cece3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9dffb640 1 -- 172.21.15.66:0/1795287633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db4021400 con 0x5653db863430 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9dffb640 1 -- 172.21.15.66:0/1795287633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db4018b50 con 0x5653db863430 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6c9dffb640 1 -- 172.21.15.66:0/1795287633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db40215a0 con 0x5653db863430 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1795287633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 msgr2=0x5653db863810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1795287633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6db4050130 tx=0x7f6db4050240 comp rx=0 tx=0).stop 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1795287633 shutdown_connections 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1795287633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db863810 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1795287633 >> 172.21.15.66:0/1795287633 conn(0x5653db85f860 msgr2=0x5653db85daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1795287633 shutdown_connections 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1795287633 wait complete. 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 Processor -- start 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- start start 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.677+0000 7f6dbc6049c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5653db864440 con 0x5653db863430 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba90b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45614/0 (socket says 172.21.15.66:45614) 2024-09-12T00:19:12.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 learned_addr learned my addr 172.21.15.66:0/212402457 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653db86ae30 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba90b640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6db4050280 tx=0x7f6db4050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 -- 172.21.15.66:0/212402457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db4038070 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653db86b0c0 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 -- 172.21.15.66:0/212402457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db4029c70 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 -- 172.21.15.66:0/212402457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db4020a30 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653db86ba70 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 -- 172.21.15.66:0/212402457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6db403b070 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c84039a70 0x7f6c8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6c8bfff640 1 -- 172.21.15.66:0/212402457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6db4034c30 con 0x5653db863430 2024-09-12T00:19:12.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba10a640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c84039a70 0x7f6c8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db875e70 0x5653db878330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db878a80 con 0x5653db875e70 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6db9909640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db875e70 0x5653db878330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6dba10a640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c84039a70 0x7f6c8403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6dac010fd0 tx=0x7f6dac035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.681+0000 7f6db9909640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db875e70 0x5653db878330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 realm 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db878eb0 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db879780 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db879b20 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db87a880 0x5653db87cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db87d280 con 0x5653db87a880 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db87a880 0x5653db87cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db87a880 0x5653db87cc70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 20 searching for the correct realm 2024-09-12T00:19:12.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6db403d060 0x7f6db401aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba10a640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6db403d060 0x7f6db401aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba10a640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6db403d060 0x7f6db401aa00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba10a640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6dac0417e0 0x7f6dac04e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.685+0000 7f6db9909640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6dac0417e0 0x7f6dac04e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6dac0417e0 0x7f6dac04e780 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.689+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.693+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db87a880 2024-09-12T00:19:12.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.697+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6dac0417e0 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x5653db875e70 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eb50 con 0x7f6db403d060 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:12.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db87dcd0 con 0x5653db875e70 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db87e520 con 0x5653db875e70 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db87eef0 con 0x5653db87a880 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:12.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 zone default found 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 4 Realm: () 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 zonegroup default 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db87f300 con 0x7f6dac0417e0 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db881130 con 0x5653db87a880 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8815c0 con 0x5653db87a880 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 started sync module instance, tier type = 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.701+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8805d0 con 0x7f6db403d060 2024-09-12T00:19:12.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94918165397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db881a20 con 0x7f6db403d060 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db882270 con 0x5653db875e70 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94918165397792] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94918165400000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8822f0 con 0x5653db875e70 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.705+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db882e10 con 0x5653db87a880 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94918165400000] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94918165407968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db882dd0 con 0x5653db87a880 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db883820 con 0x7f6db403d060 2024-09-12T00:19:12.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94918165410672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db884070 con 0x7f6db403d060 2024-09-12T00:19:12.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db884a70 con 0x5653db875e70 2024-09-12T00:19:12.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.709+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94918165407968] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94918165410672] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94918165405120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db883bc0 con 0x5653db875e70 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db885310 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94918165405120] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94918165415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db883bc0 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.713+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db885860 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94918165415296] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94918165418800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db885820 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db886240 con 0x7f6dac0417e0 2024-09-12T00:19:12.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94918165418800] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94918165421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db886200 con 0x7f6dac0417e0 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=0 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=1 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=2 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=3 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=4 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=5 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.717+0000 7f6dbc6049c0 20 add_watcher() i=6 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94918165421360] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 20 add_watcher() i=7 2024-09-12T00:19:12.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db889690 con 0x5653db875e70 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94918165417056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db886bb0 con 0x5653db875e70 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94918165417056] v31'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6db00a99f0 con 0x5653db875e70 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6c70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:12.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6dbc6049c0 5 note: GC not initialized 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.721+0000 7f6beb7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 Filter name: none 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6be97fa640 20 reqs_thread_entry: start 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8acbc0 con 0x5653db875e70 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aecb0 con 0x5653db875e70 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 8.19 8:9d8444c3:root::.bucket.meta.testx%3amyfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b0500 con 0x5653db875e70 2024-09-12T00:19:12.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T00:19:12.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b4c00 con 0x5653db875e70 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.725+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b87d0 con 0x5653db87a880 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [create,call,writefull 0~387,setxattr (123)] v31'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x7 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:12.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94918165628800 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b7500 con 0x7f6dac0417e0 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify (1) cookie 94918165418800 notify 133143986190 ret 0) ==== 778+0+0 (crc 0 0 0) 0x5653db8b08f0 con 0x7f6dac0417e0 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94918165418800 notifier 4557 bl.length()=736 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(67 notify.6 [notify cookie 94918165628800 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6c9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x7 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6c9dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6c9dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:12.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6c9dffb640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6c80003eb0 con 0x7f6dac0417e0 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== watch-notify(notify_complete (2) cookie 94918165628800 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653db8afa70 con 0x7f6dac0417e0 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.729+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b8780 con 0x7f6db403d060 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(69 foo.buckets [call] v31'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b74b0 con 0x7f6db403d060 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dbc6049c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dbc6049c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dbc6049c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94918165625424 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b74b0 con 0x7f6dac0417e0 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== watch-notify(notify (1) cookie 94918165418800 notify 133143986191 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5653db5efca0 con 0x7f6dac0417e0 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94918165418800 notifier 4557 bl.length()=314 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(71 notify.6 [notify cookie 94918165625424 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6c9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6c9dffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:12.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.733+0000 7f6c9dffb640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6c80003eb0 con 0x7f6dac0417e0 2024-09-12T00:19:12.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== watch-notify(notify_complete (2) cookie 94918165625424 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6db00d6880 con 0x7f6dac0417e0 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b5ff0 con 0x5653db875e70 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6dbc6049c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6dbc6049c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94918165625424 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b5490 con 0x5653db875e70 2024-09-12T00:19:12.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify (1) cookie 94918165405120 notify 133143986194 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f6db00d6880 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6c9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94918165405120 notifier 4557 bl.length()=155 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6c9dffb640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6c80003eb0 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(74 notify.4 [notify cookie 94918165625424 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== watch-notify(notify_complete (2) cookie 94918165625424 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6db00d6a50 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.737+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 8.19 8:9d8444c3:root::.bucket.meta.testx%3amyfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b4fe0 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call,delete] v31'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6dbc6049c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 from cache 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6dbc6049c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94918165597088 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653db8b35b0 con 0x7f6dac0417e0 2024-09-12T00:19:12.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== watch-notify(notify (1) cookie 94918165415296 notify 133143986192 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f6db00d6a50 con 0x7f6dac0417e0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(77 notify.5 [notify cookie 94918165597088 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6c9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94918165415296 notifier 4557 bl.length()=212 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6c9d7fa640 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6bf0003340 con 0x7f6dac0417e0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== watch-notify(notify_complete (2) cookie 94918165597088 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6db00d6dc0 con 0x7f6dac0417e0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6c70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.741+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94918165417056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8afea0 con 0x5653db875e70 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94918165417056] v31'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94918165397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x7f6db403d060 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94918165397792] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 20 remove_watcher() i=0 2024-09-12T00:19:12.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 2 removed watcher, disabling cache 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94918165400000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x5653db875e70 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94918165400000] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 20 remove_watcher() i=1 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.745+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94918165407968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x5653db87a880 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dba90b640 1 -- 172.21.15.66:0/212402457 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94918165407968] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db403a030 con 0x5653db87a880 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dbc6049c0 20 remove_watcher() i=2 2024-09-12T00:19:12.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94918165410672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x7f6db403d060 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dba10a640 1 -- 172.21.15.66:0/212402457 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94918165410672] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dac00f030 con 0x7f6db403d060 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dbc6049c0 20 remove_watcher() i=3 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.749+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94918165405120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x5653db875e70 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94918165405120] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x5653db875e70 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6dbc6049c0 20 remove_watcher() i=4 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94918165415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x7f6dac0417e0 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94918165415296] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6dbc6049c0 20 remove_watcher() i=5 2024-09-12T00:19:12.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.753+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94918165418800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x7f6dac0417e0 2024-09-12T00:19:12.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94918165418800] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 20 remove_watcher() i=6 2024-09-12T00:19:12.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94918165421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653db8aa940 con 0x7f6dac0417e0 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94918165421360] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6db00d5040 con 0x7f6dac0417e0 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 20 remove_watcher() i=7 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6dac0417e0 msgr2=0x7f6dac04e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6dac0417e0 0x7f6dac04e780 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db875e70 msgr2=0x5653db878330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db875e70 0x5653db878330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6db403d060 msgr2=0x7f6db401aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6db403d060 0x7f6db401aa00 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db87a880 msgr2=0x5653db87cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.757+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db87a880 0x5653db87cc70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c84039a70 msgr2=0x7f6c8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c84039a70 0x7f6c8403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6dac010fd0 tx=0x7f6dac035000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 msgr2=0x5653db86a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6db9909640 1 -- 172.21.15.66:0/212402457 reap_dead start 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6db4050280 tx=0x7f6db4050090 comp rx=0 tx=0).stop 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 shutdown_connections 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/212402457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db863430 0x5653db86a8d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 >> 172.21.15.66:0/212402457 conn(0x5653db85f860 msgr2=0x5653db85da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 shutdown_connections 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/212402457 wait complete. 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 msgr2=0x7f6c9403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 0x7f6c9403bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6dac01da60 tx=0x7f6dac006340 comp rx=0 tx=0).stop 2024-09-12T00:19:12.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 msgr2=0x5653db856f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x5653db83d080 tx=0x7f6db400bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 shutdown_connections 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6c94039a70 0x7f6c9403bf30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/3388696044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db856b70 0x5653db856f90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 >> 172.21.15.66:0/3388696044 conn(0x5653db84c520 msgr2=0x5653db84c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 shutdown_connections 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/3388696044 wait complete. 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 msgr2=0x5653db8431c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 0x5653db8431c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 msgr2=0x5653db847d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 0x5653db847d50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 msgr2=0x7f6ca003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 0x7f6ca003bf80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ad000 tx=0x7f6db00a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 msgr2=0x5653db83c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5653db8359a0 tx=0x7f6dac000f50 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 shutdown_connections 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5653db845960 0x5653db847d50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5653db74d8c0 0x5653db8431c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f6ca0039ac0 0x7f6ca003bf80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 --2- 172.21.15.66:0/1083046372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653db749770 0x5653db83c050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 >> 172.21.15.66:0/1083046372 conn(0x5653db6bd080 msgr2=0x5653db82f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 shutdown_connections 2024-09-12T00:19:12.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.761+0000 7f6dbc6049c0 1 -- 172.21.15.66:0/1083046372 wait complete. 2024-09-12T00:19:12.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T00:19:12.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T00:19:12.777 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-12T00:19:12.855 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:12.855 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e2522f9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5564676aeb50 0x556467742cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e2522f9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5564675ee9c0 con 0x5564676ae770 2024-09-12T00:19:12.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e2522f9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55646763e6d0 con 0x5564676aeb50 2024-09-12T00:19:12.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e22534640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5564676aeb50 0x556467742cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e22d35640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5564676ae770 0x55646773f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43080/0 (socket says 172.21.15.66:43080) 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e22d35640 1 -- 172.21.15.66:0/214190224 learned_addr learned my addr 172.21.15.66:0/214190224 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e21d33640 1 -- 172.21.15.66:0/214190224 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352053299 0 0) 0x5564675ee9c0 con 0x5564676ae770 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e21d33640 1 -- 172.21.15.66:0/214190224 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e10001e20 con 0x5564676ae770 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e22534640 1 -- 172.21.15.66:0/214190224 >> v1:172.21.15.31:6789/0 conn(0x5564676ae770 legacy=0x55646773f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.853+0000 7f8e22534640 1 -- 172.21.15.66:0/214190224 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564675e2ca0 con 0x5564676aeb50 2024-09-12T00:19:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e22534640 1 --2- 172.21.15.66:0/214190224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676aeb50 0x556467742cd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00a480 tx=0x7f8e0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df05dbaf771fc47c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e21d33640 1 -- 172.21.15.66:0/214190224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e0c0b0070 con 0x5564676aeb50 2024-09-12T00:19:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e21d33640 1 -- 172.21.15.66:0/214190224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c0ab540 con 0x5564676aeb50 2024-09-12T00:19:12.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e21d33640 1 -- 172.21.15.66:0/214190224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e0c0ab820 con 0x5564676aeb50 2024-09-12T00:19:12.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/214190224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676aeb50 msgr2=0x556467742cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/214190224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676aeb50 0x556467742cd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00a480 tx=0x7f8e0c01b280 comp rx=0 tx=0).stop 2024-09-12T00:19:12.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/214190224 shutdown_connections 2024-09-12T00:19:12.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/214190224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676aeb50 0x556467742cd0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/214190224 >> 172.21.15.66:0/214190224 conn(0x556467734e90 msgr2=0x5564677372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/214190224 shutdown_connections 2024-09-12T00:19:12.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.857+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/214190224 wait complete. 2024-09-12T00:19:12.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556467642680 con 0x5564676ae770 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e22d35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e22d35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45630/0 (socket says 172.21.15.66:45630) 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e22d35640 1 -- 172.21.15.66:0/2992898905 learned_addr learned my addr 172.21.15.66:0/2992898905 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e22d35640 1 -- 172.21.15.66:0/2992898905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564675bdda0 con 0x5564676ae770 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e22d35640 1 --2- 172.21.15.66:0/2992898905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8e140016a0 tx=0x7f8e14001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6376a1a4753a762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8d10e09640 1 -- 172.21.15.66:0/2992898905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e14004530 con 0x5564676ae770 2024-09-12T00:19:12.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8d10e09640 1 -- 172.21.15.66:0/2992898905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140046d0 con 0x5564676ae770 2024-09-12T00:19:12.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8d10e09640 1 -- 172.21.15.66:0/2992898905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e140049f0 con 0x5564676ae770 2024-09-12T00:19:12.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2992898905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 msgr2=0x556467827850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2992898905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8e140016a0 tx=0x7f8e14001b60 comp rx=0 tx=0).stop 2024-09-12T00:19:12.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2992898905 shutdown_connections 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2992898905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x556467827850 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2992898905 >> 172.21.15.66:0/2992898905 conn(0x556467734e90 msgr2=0x5564678234f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2992898905 shutdown_connections 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.873+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2992898905 wait complete. 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5564675e4a50 con 0x5564676ae770 2024-09-12T00:19:12.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e22d35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e22d35640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45632/0 (socket says 172.21.15.66:45632) 2024-09-12T00:19:12.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e22d35640 1 -- 172.21.15.66:0/2834682691 learned_addr learned my addr 172.21.15.66:0/2834682691 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e22d35640 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646782f430 con 0x5564676ae770 2024-09-12T00:19:12.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e22d35640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8e14001ba0 tx=0x7f8e14004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 -- 172.21.15.66:0/2834682691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e14013760 con 0x5564676ae770 2024-09-12T00:19:12.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 -- 172.21.15.66:0/2834682691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e14013900 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 -- 172.21.15.66:0/2834682691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e14013c00 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55646782f6c0 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556467830070 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 -- 172.21.15.66:0/2834682691 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e14010070 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 0x7f8d0803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.877+0000 7f8d0f606640 1 -- 172.21.15.66:0/2834682691 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8e14018070 con 0x5564676ae770 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22534640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 0x7f8d0803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 0x556467836040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467836580 con 0x5564676aeb50 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e23536640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 0x556467836040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22534640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 0x7f8d0803bf80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ad000 tx=0x7f8e0c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e23536640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 0x556467836040 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e23536640 1 -- 172.21.15.66:0/2834682691 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e1c0083f0 con 0x5564676aeb50 2024-09-12T00:19:12.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678303e0 con 0x5564676aeb50 2024-09-12T00:19:12.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e23536640 1 -- 172.21.15.66:0/2834682691 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e1c0083f0 con 0x5564676aeb50 2024-09-12T00:19:12.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 0x55646783ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646783b350 con 0x556467838870 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22d35640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 0x55646783ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22d35640 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 0x55646783ac60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22d35640 1 -- 172.21.15.66:0/2834682691 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8e1401b030 con 0x556467838870 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467837710 con 0x5564676aeb50 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e23536640 1 -- 172.21.15.66:0/2834682691 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e1c0083f0 con 0x5564676aeb50 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467837bf0 con 0x556467838870 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e22d35640 1 -- 172.21.15.66:0/2834682691 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8e1401b030 con 0x556467838870 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.881+0000 7f8e2522f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55646764f450 con 0x556467849aa0 2024-09-12T00:19:12.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45642/0 (socket says 172.21.15.66:45642) 2024-09-12T00:19:12.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e23536640 1 -- 172.21.15.66:0/3216255327 learned_addr learned my addr 172.21.15.66:0/3216255327 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e23536640 1 -- 172.21.15.66:0/3216255327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646784a500 con 0x556467849aa0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e23536640 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556467830260 tx=0x7f8e1c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 -- 172.21.15.66:0/3216255327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c01c020 con 0x556467849aa0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 -- 172.21.15.66:0/3216255327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c007d20 con 0x556467849aa0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 -- 172.21.15.66:0/3216255327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c018440 con 0x556467849aa0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55646784ad60 con 0x556467849aa0 2024-09-12T00:19:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646784b2d0 con 0x556467849aa0 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 -- 172.21.15.66:0/3216255327 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e1c01f020 con 0x556467849aa0 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 0x7f8cfc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8d0ce01640 1 -- 172.21.15.66:0/3216255327 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8e1c051c30 con 0x556467849aa0 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e22d35640 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 0x7f8cfc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e22d35640 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 0x7f8cfc03bf80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x556467836a10 tx=0x7f8e1404e890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.885+0000 7f8e2522f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556467828080 con 0x556467857430 2024-09-12T00:19:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45654/0 (socket says 172.21.15.66:45654) 2024-09-12T00:19:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 -- 172.21.15.66:0/2856345882 learned_addr learned my addr 172.21.15.66:0/2856345882 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 -- 172.21.15.66:0/2856345882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556467857e20 con 0x556467857430 2024-09-12T00:19:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 --2- 172.21.15.66:0/2856345882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c050070 tx=0x7f8e1c043130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc060f9d73f57c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8d067fc640 1 -- 172.21.15.66:0/2856345882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c021400 con 0x556467857430 2024-09-12T00:19:12.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8d067fc640 1 -- 172.21.15.66:0/2856345882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c051040 con 0x556467857430 2024-09-12T00:19:12.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8d067fc640 1 -- 172.21.15.66:0/2856345882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c029350 con 0x556467857430 2024-09-12T00:19:12.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2856345882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 msgr2=0x556467857830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2856345882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c050070 tx=0x7f8e1c043130 comp rx=0 tx=0).stop 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2856345882 shutdown_connections 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2856345882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x556467857830 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2856345882 >> 172.21.15.66:0/2856345882 conn(0x556467852850 msgr2=0x556467850a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2856345882 shutdown_connections 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2856345882 wait complete. 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 Processor -- start 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- start start 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e2522f9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556467856380 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45656/0 (socket says 172.21.15.66:45656) 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 learned_addr learned my addr 172.21.15.66:0/403779695 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.889+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55646785de40 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e23536640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c016a50 tx=0x7f8e1c04ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 -- 172.21.15.66:0/403779695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c043030 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55646785e0d0 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 -- 172.21.15.66:0/403779695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c051050 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 -- 172.21.15.66:0/403779695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c020a50 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646785ea80 con 0x556467857430 2024-09-12T00:19:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 -- 172.21.15.66:0/403779695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8e1c016040 con 0x556467857430 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cec039a70 0x7f8cec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8d04ff9640 1 -- 172.21.15.66:0/403779695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f8e1c031070 con 0x556467857430 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22d35640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cec039a70 0x7f8cec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556467868ea0 0x55646786b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646786bab0 con 0x556467868ea0 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22534640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556467868ea0 0x55646786b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22d35640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cec039a70 0x7f8cec03bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e14010fd0 tx=0x7f8e14036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22534640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556467868ea0 0x55646786b360 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 realm 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646786bee0 con 0x556467868ea0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:12.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646786c7b0 con 0x556467868ea0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.893+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646786cb50 con 0x556467868ea0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55646786d8b0 0x55646786fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678702b0 con 0x55646786d8b0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55646786d8b0 0x55646786fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55646786d8b0 0x55646786fca0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 20 searching for the correct realm 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8e1c021020 0x7f8e1c048880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22d35640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8e1c021020 0x7f8e1c048880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22d35640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8e1c021020 0x7f8e1c048880 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22d35640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8e1401d350 0x7f8e14041430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:12.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22534640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8e1401d350 0x7f8e14041430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.897+0000 7f8e22534640 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8e1401d350 0x7f8e14041430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.901+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.905+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x55646786d8b0 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1401d350 2024-09-12T00:19:12.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.909+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x556467868ea0 2024-09-12T00:19:12.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556467871b80 con 0x7f8e1c021020 2024-09-12T00:19:12.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467870c00 con 0x556467868ea0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467870840 con 0x556467868ea0 2024-09-12T00:19:12.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467870850 con 0x55646786d8b0 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 zone default found 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 4 Realm: () 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 zonegroup default 2024-09-12T00:19:12.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467871fb0 con 0x7f8e1401d350 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467873e50 con 0x55646786d8b0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678741f0 con 0x55646786d8b0 2024-09-12T00:19:12.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 started sync module instance, tier type = 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.913+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467873300 con 0x7f8e1c021020 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93889722005232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467872f60 con 0x7f8e1c021020 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467874cc0 con 0x556467868ea0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93889722005232] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93889722008048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467874cc0 con 0x556467868ea0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.917+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467875680 con 0x55646786d8b0 2024-09-12T00:19:12.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93889722008048] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93889722009888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467875680 con 0x55646786d8b0 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467876040 con 0x7f8e1c021020 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93889722014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467876460 con 0x7f8e1c021020 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467876eb0 con 0x556467868ea0 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93889722009888] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.921+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93889722014608] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93889722018208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467875fb0 con 0x556467868ea0 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467877780 con 0x7f8e1401d350 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93889722020112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678779e0 con 0x7f8e1401d350 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467878230 con 0x7f8e1401d350 2024-09-12T00:19:12.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.925+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93889722018208] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93889722020112] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93889722021168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467877e00 con 0x7f8e1401d350 2024-09-12T00:19:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467878650 con 0x7f8e1401d350 2024-09-12T00:19:12.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93889722021168] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93889722022704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678784e0 con 0x7f8e1401d350 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=0 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=1 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=2 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=3 2024-09-12T00:19:12.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=4 2024-09-12T00:19:12.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=5 2024-09-12T00:19:12.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.929+0000 7f8e2522f9c0 20 add_watcher() i=6 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93889722022704] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0b3040 con 0x7f8e1401d350 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 20 add_watcher() i=7 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55646787ba50 con 0x556467868ea0 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8e0c0b3040 con 0x556467868ea0 2024-09-12T00:19:12.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93889722023824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467878f70 con 0x556467868ea0 2024-09-12T00:19:12.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93889722023824] v31'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8cd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:12.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:12.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:12.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.933+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55646787afb0 con 0x556467868ea0 2024-09-12T00:19:12.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.937+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.937+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467884aa0 con 0x7f8e1401d350 2024-09-12T00:19:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.937+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.937+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467884f50 con 0x55646786d8b0 2024-09-12T00:19:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467884f50 con 0x556467868ea0 2024-09-12T00:19:12.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678854c0 con 0x7f8e1c021020 2024-09-12T00:19:12.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.941+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885550 con 0x55646786d8b0 2024-09-12T00:19:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.945+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.945+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885650 con 0x556467868ea0 2024-09-12T00:19:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.945+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.945+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1401d350 2024-09-12T00:19:12.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.949+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.949+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1c021020 2024-09-12T00:19:12.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.949+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.949+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x55646786d8b0 2024-09-12T00:19:12.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.953+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.953+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1c021020 2024-09-12T00:19:12.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.953+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.953+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1401d350 2024-09-12T00:19:12.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.957+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.957+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1c021020 2024-09-12T00:19:12.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.957+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.957+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x7f8e1401d350 2024-09-12T00:19:12.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.961+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'45 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.961+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467885b60 con 0x556467868ea0 2024-09-12T00:19:12.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.961+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'142 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.961+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1c021020 2024-09-12T00:19:12.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'47 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.965+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x556467868ea0 2024-09-12T00:19:12.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.969+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.969+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x556467868ea0 2024-09-12T00:19:12.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.969+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'143 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:12.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.969+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1c021020 2024-09-12T00:19:12.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.973+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.977+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.977+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.977+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.977+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.981+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'38 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.981+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1401d350 2024-09-12T00:19:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.981+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.981+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.985+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'28 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.985+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1401d350 2024-09-12T00:19:12.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.985+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.985+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x55646786d8b0 2024-09-12T00:19:12.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.989+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:12.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.989+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1401d350 2024-09-12T00:19:12.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.989+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'46 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:12.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.989+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467886010 con 0x7f8e1c021020 2024-09-12T00:19:12.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:12.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8c53fff640 20 reqs_thread_entry: start 2024-09-12T00:19:12.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:12.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 20 Filter name: none 2024-09-12T00:19:12.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8c51ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:12.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T00:19:12.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:12.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678a1040 con 0x7f8e1401d350 2024-09-12T00:19:12.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.993+0000 7f8e2522f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678a0f90 con 0x556467868ea0 2024-09-12T00:19:13.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T00:19:13.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678a0f90 con 0x7f8e1401d350 2024-09-12T00:19:13.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:19:13.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93889722197328 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678a3e30 con 0x55646786d8b0 2024-09-12T00:19:13.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== watch-notify(notify (1) cookie 93889722009888 notify 133143986181 ret 0) ==== 212+0+0 (crc 0 0 0) 0x556467885820 con 0x55646786d8b0 2024-09-12T00:19:13.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8d067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 93889722009888 notifier 4564 bl.length()=170 2024-09-12T00:19:13.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8d067fc640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8ce8003d70 con 0x55646786d8b0 2024-09-12T00:19:13.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(97 notify.2 [notify cookie 93889722197328 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:13.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== watch-notify(notify_complete (2) cookie 93889722197328 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55646785de40 con 0x55646786d8b0 2024-09-12T00:19:13.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 10 removing email index: 2024-09-12T00:19:13.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:13.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 10 removing user buckets index 2024-09-12T00:19:13.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:12.997+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678a19f0 con 0x556467868ea0 2024-09-12T00:19:13.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v31'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e2522f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-12T00:19:13.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93889722197328 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5564678a3e30 con 0x556467868ea0 2024-09-12T00:19:13.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== watch-notify(notify (1) cookie 93889722018208 notify 133143986195 ret 0) ==== 217+0+0 (crc 0 0 0) 0x556467884bd0 con 0x556467868ea0 2024-09-12T00:19:13.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8d05ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 93889722018208 notifier 4564 bl.length()=175 2024-09-12T00:19:13.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8d05ffb640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8c580032d0 con 0x556467868ea0 2024-09-12T00:19:13.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(100 notify.4 [notify cookie 93889722197328 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== watch-notify(notify_complete (2) cookie 93889722197328 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55646785e0d0 con 0x556467868ea0 2024-09-12T00:19:13.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e2522f9c0 10 removing user index: testx$tenanteduser 2024-09-12T00:19:13.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.001+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678a5a30 con 0x7f8e1401d350 2024-09-12T00:19:13.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e2522f9c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-12T00:19:13.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e2522f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T00:19:13.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93889722070704 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556467883f80 con 0x7f8e1c021020 2024-09-12T00:19:13.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== watch-notify(notify (1) cookie 93889722014608 notify 133143986189 ret 0) ==== 209+0+0 (crc 0 0 0) 0x556467884da0 con 0x7f8e1c021020 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8d067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 93889722014608 notifier 4564 bl.length()=167 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(103 notify.3 [notify cookie 93889722070704 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8d067fc640 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8ce8003d70 con 0x7f8e1c021020 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== watch-notify(notify_complete (2) cookie 93889722070704 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8e1403b040 con 0x7f8e1c021020 2024-09-12T00:19:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8cd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.005+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93889722023824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467883680 con 0x556467868ea0 2024-09-12T00:19:13.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93889722023824] v31'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93889722005232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467877f50 con 0x7f8e1c021020 2024-09-12T00:19:13.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93889722005232] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:13.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e2522f9c0 20 remove_watcher() i=0 2024-09-12T00:19:13.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e2522f9c0 2 removed watcher, disabling cache 2024-09-12T00:19:13.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.009+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93889722008048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678736f0 con 0x556467868ea0 2024-09-12T00:19:13.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93889722008048] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e2522f9c0 20 remove_watcher() i=1 2024-09-12T00:19:13.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93889722009888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678741f0 con 0x55646786d8b0 2024-09-12T00:19:13.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e23536640 1 -- 172.21.15.66:0/403779695 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93889722009888] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1c05a040 con 0x55646786d8b0 2024-09-12T00:19:13.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e2522f9c0 20 remove_watcher() i=2 2024-09-12T00:19:13.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93889722014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467874920 con 0x7f8e1c021020 2024-09-12T00:19:13.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e22d35640 1 -- 172.21.15.66:0/403779695 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93889722014608] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e1401b030 con 0x7f8e1c021020 2024-09-12T00:19:13.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.013+0000 7f8e2522f9c0 20 remove_watcher() i=3 2024-09-12T00:19:13.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.017+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93889722018208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467875b90 con 0x556467868ea0 2024-09-12T00:19:13.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.017+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93889722018208] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x556467868ea0 2024-09-12T00:19:13.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.017+0000 7f8e2522f9c0 20 remove_watcher() i=4 2024-09-12T00:19:13.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.017+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93889722020112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678769a0 con 0x7f8e1401d350 2024-09-12T00:19:13.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93889722020112] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e2522f9c0 20 remove_watcher() i=5 2024-09-12T00:19:13.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93889722021168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5564678769a0 con 0x7f8e1401d350 2024-09-12T00:19:13.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93889722021168] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e2522f9c0 20 remove_watcher() i=6 2024-09-12T00:19:13.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.021+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93889722022704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556467875b90 con 0x7f8e1401d350 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93889722022704] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8e0c0d7040 con 0x7f8e1401d350 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 20 remove_watcher() i=7 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8e1401d350 msgr2=0x7f8e14041430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8e1401d350 0x7f8e14041430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556467868ea0 msgr2=0x55646786b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556467868ea0 0x55646786b360 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8e1c021020 msgr2=0x7f8e1c048880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8e1c021020 0x7f8e1c048880 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55646786d8b0 msgr2=0x55646786fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55646786d8b0 0x55646786fca0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cec039a70 msgr2=0x7f8cec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cec039a70 0x7f8cec03bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e14010fd0 tx=0x7f8e14036000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 msgr2=0x55646785d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e22534640 1 -- 172.21.15.66:0/403779695 reap_dead start 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c016a50 tx=0x7f8e1c04ffd0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 shutdown_connections 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/403779695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467857430 0x55646785d8e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 >> 172.21.15.66:0/403779695 conn(0x556467852850 msgr2=0x556467850a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 shutdown_connections 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/403779695 wait complete. 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 msgr2=0x7f8cfc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 0x7f8cfc03bf80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x556467836a10 tx=0x7f8e1404e890 comp rx=0 tx=0).stop 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 msgr2=0x556467849ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556467830260 tx=0x7f8e1c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 shutdown_connections 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8cfc039ac0 0x7f8cfc03bf80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/3216255327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556467849aa0 0x556467849ec0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 >> 172.21.15.66:0/3216255327 conn(0x55646783f450 msgr2=0x55646783f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 shutdown_connections 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/3216255327 wait complete. 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 msgr2=0x556467836040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 0x556467836040 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 msgr2=0x55646783ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 0x55646783ac60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 msgr2=0x7f8d0803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 0x7f8d0803bf80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ad000 tx=0x7f8e0c0a5040 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 msgr2=0x55646782eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8e14001ba0 tx=0x7f8e14004470 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 shutdown_connections 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556467838870 0x55646783ac60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5564676aeb50 0x556467836040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8d08039ac0 0x7f8d0803bf80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 --2- 172.21.15.66:0/2834682691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564676ae770 0x55646782eed0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 >> 172.21.15.66:0/2834682691 conn(0x556467734e90 msgr2=0x556467821f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 shutdown_connections 2024-09-12T00:19:13.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.025+0000 7f8e2522f9c0 1 -- 172.21.15.66:0/2834682691 wait complete. 2024-09-12T00:19:13.054 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T00:19:13.060 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-12T00:19:13.105 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:13.106 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T00:19:13.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T00:19:13.106 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-12T00:19:13.147 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:13.147 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:13.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a7c3d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563016bd7560 0x563016bd9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a7c3d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563016a889c0 con 0x563016bd3370 2024-09-12T00:19:13.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a7c3d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x563016ad86d0 con 0x563016bd7560 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a4f42640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563016bd7560 0x563016bd9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a4f42640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563016bd7560 0x563016bd9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45662/0 (socket says 172.21.15.66:45662) 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a4f42640 1 -- 172.21.15.66:0/3209391368 learned_addr learned my addr 172.21.15.66:0/3209391368 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a5743640 1 --1- 172.21.15.66:0/3209391368 >> v1:172.21.15.31:6789/0 conn(0x563016bd3370 0x563016bd3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43084/0 (socket says 172.21.15.66:43084) 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a4f42640 1 -- 172.21.15.66:0/3209391368 >> v1:172.21.15.31:6789/0 conn(0x563016bd3370 legacy=0x563016bd3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.145+0000 7f46a4f42640 1 -- 172.21.15.66:0/3209391368 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016a7cca0 con 0x563016bd7560 2024-09-12T00:19:13.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a4f42640 1 --2- 172.21.15.66:0/3209391368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016bd9950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f469c00a5c0 tx=0x7f469c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419cebeac4167b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f4697fff640 1 -- 172.21.15.66:0/3209391368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469c0a9590 con 0x563016bd7560 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f4697fff640 1 -- 172.21.15.66:0/3209391368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469c0ae070 con 0x563016bd7560 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f4697fff640 1 -- 172.21.15.66:0/3209391368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469c0a9880 con 0x563016bd7560 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3209391368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 msgr2=0x563016bd9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3209391368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016bd9950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f469c00a5c0 tx=0x7f469c01b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3209391368 shutdown_connections 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3209391368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016bd9950 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3209391368 >> 172.21.15.66:0/3209391368 conn(0x563016bcee90 msgr2=0x563016bd12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3209391368 shutdown_connections 2024-09-12T00:19:13.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.149+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3209391368 wait complete. 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a7c3d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a7c3d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563016adc680 con 0x563016bd3370 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a5743640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a5743640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45678/0 (socket says 172.21.15.66:45678) 2024-09-12T00:19:13.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a5743640 1 -- 172.21.15.66:0/812524488 learned_addr learned my addr 172.21.15.66:0/812524488 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a5743640 1 -- 172.21.15.66:0/812524488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016a57da0 con 0x563016bd3370 2024-09-12T00:19:13.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f46a5743640 1 --2- 172.21.15.66:0/812524488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4698001680 tx=0x7f4698001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808899768e064f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f4593606640 1 -- 172.21.15.66:0/812524488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698013420 con 0x563016bd3370 2024-09-12T00:19:13.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f4593606640 1 -- 172.21.15.66:0/812524488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46980135c0 con 0x563016bd3370 2024-09-12T00:19:13.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.165+0000 7f4593606640 1 -- 172.21.15.66:0/812524488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46980138e0 con 0x563016bd3370 2024-09-12T00:19:13.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/812524488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 msgr2=0x563016cbe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/812524488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4698001680 tx=0x7f4698001b40 comp rx=0 tx=0).stop 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/812524488 shutdown_connections 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/812524488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd3370 0x563016cbe6f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/812524488 >> 172.21.15.66:0/812524488 conn(0x563016bcee90 msgr2=0x563016cba390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/812524488 shutdown_connections 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/812524488 wait complete. 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563016a7ea50 con 0x563016bd7560 2024-09-12T00:19:13.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a5743640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a5743640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45684/0 (socket says 172.21.15.66:45684) 2024-09-12T00:19:13.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a5743640 1 -- 172.21.15.66:0/27836706 learned_addr learned my addr 172.21.15.66:0/27836706 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a5743640 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016b48ca0 con 0x563016bd7560 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a5743640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x563016cbf6e0 tx=0x7f4698000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f4591e03640 1 -- 172.21.15.66:0/27836706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46980037a0 con 0x563016bd7560 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563016cc9e50 con 0x563016bd7560 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f4591e03640 1 -- 172.21.15.66:0/27836706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698023070 con 0x563016bd7560 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f4591e03640 1 -- 172.21.15.66:0/27836706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4698003ad0 con 0x563016bd7560 2024-09-12T00:19:13.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.169+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563016cca2d0 con 0x563016bd7560 2024-09-12T00:19:13.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f4591e03640 1 -- 172.21.15.66:0/27836706 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4698010070 con 0x563016bd7560 2024-09-12T00:19:13.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f4591e03640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 0x7f458c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f4591e03640 1 -- 172.21.15.66:0/27836706 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f4698050030 con 0x563016bd7560 2024-09-12T00:19:13.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 0x563016cce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a4f42640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 0x7f458c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016cceac0 con 0x563016ccc080 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5f44640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 0x563016cce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5f44640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 0x563016cce470 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a4f42640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 0x7f458c03bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f469c0ad000 tx=0x7f469c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5f44640 1 -- 172.21.15.66:0/27836706 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46a00083f0 con 0x563016ccc080 2024-09-12T00:19:13.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016ccb640 con 0x563016ccc080 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5f44640 1 -- 172.21.15.66:0/27836706 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46a00083f0 con 0x563016ccc080 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 0x563016cd31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016cd3890 con 0x563016cd0dd0 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5743640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 0x563016cd31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.173+0000 7f46a5743640 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 0x563016cd31c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5743640 1 -- 172.21.15.66:0/27836706 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f469800f030 con 0x563016cd0dd0 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016ccfc70 con 0x563016ccc080 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 -- 172.21.15.66:0/27836706 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46a00083f0 con 0x563016ccc080 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016cd0150 con 0x563016cd0dd0 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5743640 1 -- 172.21.15.66:0/27836706 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f469800f030 con 0x563016cd0dd0 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563016ae9450 con 0x563016ce2020 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45690/0 (socket says 172.21.15.66:45690) 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 -- 172.21.15.66:0/3114652504 learned_addr learned my addr 172.21.15.66:0/3114652504 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 -- 172.21.15.66:0/3114652504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016ce2a80 con 0x563016ce2020 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a5f44640 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x563016b48310 tx=0x7f46a000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f458affd640 1 -- 172.21.15.66:0/3114652504 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a001c020 con 0x563016ce2020 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563016ce32e0 con 0x563016ce2020 2024-09-12T00:19:13.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f458affd640 1 -- 172.21.15.66:0/3114652504 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0007d00 con 0x563016ce2020 2024-09-12T00:19:13.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f458affd640 1 -- 172.21.15.66:0/3114652504 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0018440 con 0x563016ce2020 2024-09-12T00:19:13.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.177+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563016ce3850 con 0x563016ce2020 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f458affd640 1 -- 172.21.15.66:0/3114652504 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f46a001f020 con 0x563016ce2020 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f458affd640 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 0x7f457c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f458affd640 1 -- 172.21.15.66:0/3114652504 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f46a0051db0 con 0x563016ce2020 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5743640 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 0x7f457c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5743640 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 0x7f457c03bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f469801d770 tx=0x7f469804e3d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563016cbef40 con 0x563016cc5e10 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45706/0 (socket says 172.21.15.66:45706) 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5f44640 1 -- 172.21.15.66:0/594541768 learned_addr learned my addr 172.21.15.66:0/594541768 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5f44640 1 -- 172.21.15.66:0/594541768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016cc6800 con 0x563016cc5e10 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a5f44640 1 --2- 172.21.15.66:0/594541768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46a0050100 tx=0x7f46a0050240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bc9f9c6e33e2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f4588ff9640 1 -- 172.21.15.66:0/594541768 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0021400 con 0x563016cc5e10 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f4588ff9640 1 -- 172.21.15.66:0/594541768 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0029350 con 0x563016cc5e10 2024-09-12T00:19:13.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f4588ff9640 1 -- 172.21.15.66:0/594541768 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a00215a0 con 0x563016cc5e10 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/594541768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 msgr2=0x563016cc6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/594541768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46a0050100 tx=0x7f46a0050240 comp rx=0 tx=0).stop 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/594541768 shutdown_connections 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/594541768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cc6210 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/594541768 >> 172.21.15.66:0/594541768 conn(0x563016cead50 msgr2=0x563016ce8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/594541768 shutdown_connections 2024-09-12T00:19:13.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.181+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/594541768 wait complete. 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 Processor -- start 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 -- start start 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563016cc6ea0 con 0x563016cc5e10 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5f44640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45714/0 (socket says 172.21.15.66:45714) 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 learned_addr learned my addr 172.21.15.66:0/1410540398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563016cf8560 con 0x563016cc5e10 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5f44640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46a0016aa0 tx=0x7f46a0050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 -- 172.21.15.66:0/1410540398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0038070 con 0x563016cc5e10 2024-09-12T00:19:13.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563016cf87f0 con 0x563016cc5e10 2024-09-12T00:19:13.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 -- 172.21.15.66:0/1410540398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0028300 con 0x563016cc5e10 2024-09-12T00:19:13.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 -- 172.21.15.66:0/1410540398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46a0028620 con 0x563016cc5e10 2024-09-12T00:19:13.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563016cf91a0 con 0x563016cc5e10 2024-09-12T00:19:13.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 -- 172.21.15.66:0/1410540398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f46a003b070 con 0x563016cc5e10 2024-09-12T00:19:13.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4570039a70 0x7f457003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f457affd640 1 -- 172.21.15.66:0/1410540398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f46a0034c30 con 0x563016cc5e10 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.185+0000 7f46a5743640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4570039a70 0x7f457003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016d03590 0x563016d05a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d061a0 con 0x563016d03590 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016d03590 0x563016d05a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5743640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4570039a70 0x7f457003bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46980472a0 tx=0x7f4698045000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016d03590 0x563016d05a50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 realm 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d065d0 con 0x563016d03590 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d06ea0 con 0x563016d03590 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d07240 con 0x563016d03590 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016d07fa0 0x563016d0a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0a9a0 con 0x563016d07fa0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016d07fa0 0x563016d0a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016d07fa0 0x563016d0a390 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 20 searching for the correct realm 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f46a003d060 0x7f46a001a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5743640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f46a003d060 0x7f46a001a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.189+0000 7f46a5743640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f46a003d060 0x7f46a001a8f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a5743640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x563016bd3370 0x7f46980415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x563016bd3370 0x7f46980415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x563016bd3370 0x7f46980415e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.193+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.197+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.201+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d07fa0 2024-09-12T00:19:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016bd3370 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x563016d03590 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c270 con 0x7f46a003d060 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0b3f0 con 0x563016d03590 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0bc40 con 0x563016d03590 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0c610 con 0x563016d07fa0 2024-09-12T00:19:13.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 zone default found 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 4 Realm: () 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 zonegroup default 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.205+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0ca20 con 0x563016bd3370 2024-09-12T00:19:13.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0e850 con 0x563016d07fa0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d0ed10 con 0x563016d07fa0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0dcf0 con 0x7f46a003d060 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94764541204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0f170 con 0x7f46a003d060 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0f9c0 con 0x563016d03590 2024-09-12T00:19:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.209+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94764541204544] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94764541206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0fa00 con 0x563016d03590 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d10520 con 0x563016d07fa0 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94764541214704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d104e0 con 0x563016d07fa0 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d11480 con 0x7f46a003d060 2024-09-12T00:19:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.213+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94764541206752] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94764541218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d11480 con 0x7f46a003d060 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d11e90 con 0x563016d03590 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94764541214704] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94764541218656] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94764541211920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d119e0 con 0x563016d03590 2024-09-12T00:19:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d12230 con 0x563016bd3370 2024-09-12T00:19:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.217+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94764541211920] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94764541221344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d12620 con 0x563016bd3370 2024-09-12T00:19:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d12e70 con 0x563016bd3370 2024-09-12T00:19:13.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94764541221344] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94764541222400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d12ad0 con 0x563016bd3370 2024-09-12T00:19:13.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.221+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13590 con 0x563016bd3370 2024-09-12T00:19:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94764541222400] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94764541227104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13770 con 0x563016bd3370 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=0 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=1 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=2 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=3 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=4 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=5 2024-09-12T00:19:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=6 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94764541227104] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 20 add_watcher() i=7 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.225+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d16b40 con 0x563016d03590 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94764541228640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13f30 con 0x563016d03590 2024-09-12T00:19:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94764541228640] v31'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f455bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a7c3d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a7c3d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1f2b0 con 0x563016d03590 2024-09-12T00:19:13.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.229+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1f2b0 con 0x563016bd3370 2024-09-12T00:19:13.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.233+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.233+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1fdf0 con 0x563016d07fa0 2024-09-12T00:19:13.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.233+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.233+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d201b0 con 0x563016d03590 2024-09-12T00:19:13.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'146 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20390 con 0x7f46a003d060 2024-09-12T00:19:13.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1ec70 con 0x563016d07fa0 2024-09-12T00:19:13.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'39 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.237+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1ec70 con 0x563016d03590 2024-09-12T00:19:13.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.241+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.241+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1f120 con 0x563016bd3370 2024-09-12T00:19:13.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.241+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.241+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1f120 con 0x7f46a003d060 2024-09-12T00:19:13.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.245+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.245+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d1f120 con 0x563016d07fa0 2024-09-12T00:19:13.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.245+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.245+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x7f46a003d060 2024-09-12T00:19:13.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016bd3370 2024-09-12T00:19:13.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x7f46a003d060 2024-09-12T00:19:13.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.249+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016bd3370 2024-09-12T00:19:13.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.253+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'47 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.253+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d03590 2024-09-12T00:19:13.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.253+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'147 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.253+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.257+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.257+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x7f46a003d060 2024-09-12T00:19:13.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.257+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'50 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.257+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d03590 2024-09-12T00:19:13.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d03590 2024-09-12T00:19:13.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'148 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.261+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.265+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.265+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x7f46a003d060 2024-09-12T00:19:13.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.265+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.265+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.269+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20e90 con 0x563016d07fa0 2024-09-12T00:19:13.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.273+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'40 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.273+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f00 con 0x563016bd3370 2024-09-12T00:19:13.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.273+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.273+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f00 con 0x563016d07fa0 2024-09-12T00:19:13.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.277+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'29 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.277+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f40 con 0x563016bd3370 2024-09-12T00:19:13.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.277+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.277+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f00 con 0x563016d07fa0 2024-09-12T00:19:13.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.281+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.281+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f40 con 0x563016bd3370 2024-09-12T00:19:13.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.281+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'48 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.281+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d20f40 con 0x7f46a003d060 2024-09-12T00:19:13.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f455afe5640 20 reqs_thread_entry: start 2024-09-12T00:19:13.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a7c3d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:13.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a7c3d9c0 20 Filter name: none 2024-09-12T00:19:13.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f4558fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:13.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a7c3d9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:13.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.285+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d3c5e0 con 0x7f46a003d060 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:95 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d3dd40 con 0x563016d07fa0 2024-09-12T00:19:13.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(95 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 get_obj_state: octx=0x7f4698047ec0 obj=myfoo:four state=0x563016d3ef18 s->prefetch_data=0 2024-09-12T00:19:13.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 3.23s0 3:c7a848c9:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563016d3ffd0 con 0x563016bd3370 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(96 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 10 manifest: total_size = 4 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.16247588069883748115 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 get_obj_state: octx=0x7f4698047ec0 obj=myfoo:four state=0x563016d3ef18 s->prefetch_data=0 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 prepare_atomic_modification: state is not atomic. state=0x563016d3ef18 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 2024-09-12T00:19:13.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d449d0 con 0x563016d07fa0 2024-09-12T00:19:13.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(97 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.289+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 3.23s0 3:c7a848c9:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d449d0 con 0x563016bd3370 2024-09-12T00:19:13.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.293+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(98 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1_four [call] v31'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.293+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d45460 con 0x563016d07fa0 2024-09-12T00:19:13.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(99 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f4588ff9640 20 handle_completion(): completion ok for obj=four 2024-09-12T00:19:13.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f455bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94764541228640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d3e400 con 0x563016d03590 2024-09-12T00:19:13.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94764541228640] v31'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94764541204544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13660 con 0x7f46a003d060 2024-09-12T00:19:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94764541204544] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a7c3d9c0 20 remove_watcher() i=0 2024-09-12T00:19:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a7c3d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:13.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.297+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94764541206752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13660 con 0x563016d03590 2024-09-12T00:19:13.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.301+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94764541206752] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.301+0000 7f46a7c3d9c0 20 remove_watcher() i=1 2024-09-12T00:19:13.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.301+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94764541214704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0e0e0 con 0x563016d07fa0 2024-09-12T00:19:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a5f44640 1 -- 172.21.15.66:0/1410540398 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94764541214704] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46a003a030 con 0x563016d07fa0 2024-09-12T00:19:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 20 remove_watcher() i=2 2024-09-12T00:19:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94764541218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13660 con 0x7f46a003d060 2024-09-12T00:19:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a5743640 1 -- 172.21.15.66:0/1410540398 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94764541218656] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469800f030 con 0x7f46a003d060 2024-09-12T00:19:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 20 remove_watcher() i=3 2024-09-12T00:19:13.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94764541211920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d10f60 con 0x563016d03590 2024-09-12T00:19:13.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94764541211920] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016d03590 2024-09-12T00:19:13.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 20 remove_watcher() i=4 2024-09-12T00:19:13.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.305+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94764541221344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d13660 con 0x563016bd3370 2024-09-12T00:19:13.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.309+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94764541221344] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.309+0000 7f46a7c3d9c0 20 remove_watcher() i=5 2024-09-12T00:19:13.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.309+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94764541222400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d0f510 con 0x563016bd3370 2024-09-12T00:19:13.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94764541222400] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 20 remove_watcher() i=6 2024-09-12T00:19:13.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94764541227104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563016d10f60 con 0x563016bd3370 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94764541227104] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f469c0a99f0 con 0x563016bd3370 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 20 remove_watcher() i=7 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x563016bd3370 msgr2=0x7f46980415e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x563016bd3370 0x7f46980415e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016d03590 msgr2=0x563016d05a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016d03590 0x563016d05a50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f46a003d060 msgr2=0x7f46a001a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f46a003d060 0x7f46a001a8f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016d07fa0 msgr2=0x563016d0a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016d07fa0 0x563016d0a390 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4570039a70 msgr2=0x7f457003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4570039a70 0x7f457003bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f46980472a0 tx=0x7f4698045000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 msgr2=0x563016cf8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f46a0016aa0 tx=0x7f46a0050090 comp rx=0 tx=0).stop 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a4f42640 1 -- 172.21.15.66:0/1410540398 reap_dead start 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 shutdown_connections 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/1410540398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016cc5e10 0x563016cf8000 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 >> 172.21.15.66:0/1410540398 conn(0x563016cead50 msgr2=0x563016ce8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 shutdown_connections 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/1410540398 wait complete. 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 msgr2=0x7f457c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 0x7f457c03bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f469801d770 tx=0x7f469804e3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 msgr2=0x563016ce2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x563016b48310 tx=0x7f46a000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 shutdown_connections 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f457c039a70 0x7f457c03bf30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/3114652504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016ce2020 0x563016ce2440 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.313+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 >> 172.21.15.66:0/3114652504 conn(0x563016cd79d0 msgr2=0x563016cd7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 shutdown_connections 2024-09-12T00:19:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/3114652504 wait complete. 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 msgr2=0x563016cce470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 0x563016cce470 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 msgr2=0x563016cd31c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 0x563016cd31c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 msgr2=0x7f458c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 0x7f458c03bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f469c0ad000 tx=0x7f469c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 msgr2=0x563016b48740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x563016cbf6e0 tx=0x7f4698000f50 comp rx=0 tx=0).stop 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 shutdown_connections 2024-09-12T00:19:13.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563016cd0dd0 0x563016cd31c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563016ccc080 0x563016cce470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f458c039a70 0x7f458c03bf30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 --2- 172.21.15.66:0/27836706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563016bd7560 0x563016b48740 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 >> 172.21.15.66:0/27836706 conn(0x563016bcee90 msgr2=0x563016cb8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 shutdown_connections 2024-09-12T00:19:13.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.317+0000 7f46a7c3d9c0 1 -- 172.21.15.66:0/27836706 wait complete. 2024-09-12T00:19:13.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:13.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T00:19:13.334 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T00:19:13.415 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:13.415 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:13.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608a3989c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd4f42f880 0x55cd4f431c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608a3989c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd4f2df9c0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608a3989c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55cd4f32f6d0 con 0x55cd4f42f880 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608769d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd4f42f880 0x55cd4f431c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608769d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cd4f42f880 0x55cd4f431c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45716/0 (socket says 172.21.15.66:45716) 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608769d640 1 -- 172.21.15.66:0/467209612 learned_addr learned my addr 172.21.15.66:0/467209612 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f6087e9e640 1 --1- 172.21.15.66:0/467209612 >> v1:172.21.15.31:6789/0 conn(0x55cd4f39f7b0 0x55cd4f42e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43092/0 (socket says 172.21.15.66:43092) 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608769d640 1 -- 172.21.15.66:0/467209612 >> v1:172.21.15.31:6789/0 conn(0x55cd4f39f7b0 legacy=0x55cd4f42e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.413+0000 7f608769d640 1 -- 172.21.15.66:0/467209612 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f2d3ca0 con 0x55cd4f42f880 2024-09-12T00:19:13.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608769d640 1 --2- 172.21.15.66:0/467209612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f42f880 0x55cd4f431c70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f607c00a5c0 tx=0x7f607c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a536cd7fcd025c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f6086e9c640 1 -- 172.21.15.66:0/467209612 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c0b1070 con 0x55cd4f42f880 2024-09-12T00:19:13.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f6086e9c640 1 -- 172.21.15.66:0/467209612 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607c0a8070 con 0x55cd4f42f880 2024-09-12T00:19:13.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f6086e9c640 1 -- 172.21.15.66:0/467209612 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607c0ac5b0 con 0x55cd4f42f880 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 -- 172.21.15.66:0/467209612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f42f880 msgr2=0x55cd4f431c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 --2- 172.21.15.66:0/467209612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f42f880 0x55cd4f431c70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f607c00a5c0 tx=0x7f607c01b340 comp rx=0 tx=0).stop 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 -- 172.21.15.66:0/467209612 shutdown_connections 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 --2- 172.21.15.66:0/467209612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f42f880 0x55cd4f431c70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 -- 172.21.15.66:0/467209612 >> 172.21.15.66:0/467209612 conn(0x55cd4f425e90 msgr2=0x55cd4f4282b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 -- 172.21.15.66:0/467209612 shutdown_connections 2024-09-12T00:19:13.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.417+0000 7f608a3989c0 1 -- 172.21.15.66:0/467209612 wait complete. 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f608a3989c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f608a3989c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4f333680 con 0x55cd4f39f7b0 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f6087e9e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f6087e9e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45724/0 (socket says 172.21.15.66:45724) 2024-09-12T00:19:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f6087e9e640 1 -- 172.21.15.66:0/3976760138 learned_addr learned my addr 172.21.15.66:0/3976760138 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f6087e9e640 1 -- 172.21.15.66:0/3976760138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f2aeda0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3976760138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f607800b270 tx=0x7f607800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb70dd7f0ffb64e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f5f75e0b640 1 -- 172.21.15.66:0/3976760138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607800e5d0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f5f75e0b640 1 -- 172.21.15.66:0/3976760138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607800e770 con 0x55cd4f39f7b0 2024-09-12T00:19:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.433+0000 7f5f75e0b640 1 -- 172.21.15.66:0/3976760138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607800ea70 con 0x55cd4f39f7b0 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/3976760138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 msgr2=0x55cd4f516910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3976760138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f607800b270 tx=0x7f607800b670 comp rx=0 tx=0).stop 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/3976760138 shutdown_connections 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3976760138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f516910 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/3976760138 >> 172.21.15.66:0/3976760138 conn(0x55cd4f425e90 msgr2=0x55cd4f5125b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/3976760138 shutdown_connections 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/3976760138 wait complete. 2024-09-12T00:19:13.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4f2d5a50 con 0x55cd4f39f7b0 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f6087e9e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f6087e9e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45732/0 (socket says 172.21.15.66:45732) 2024-09-12T00:19:13.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f6087e9e640 1 -- 172.21.15.66:0/2788702807 learned_addr learned my addr 172.21.15.66:0/2788702807 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f6087e9e640 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f51e510 con 0x55cd4f39f7b0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f6087e9e640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55cd4f517900 tx=0x7f6078000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f5f6ffff640 1 -- 172.21.15.66:0/2788702807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607800be70 con 0x55cd4f39f7b0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f5f6ffff640 1 -- 172.21.15.66:0/2788702807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607800f9f0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd4f51e7a0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f5f6ffff640 1 -- 172.21.15.66:0/2788702807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607800fcf0 con 0x55cd4f39f7b0 2024-09-12T00:19:13.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4f51f150 con 0x55cd4f39f7b0 2024-09-12T00:19:13.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.437+0000 7f5f6ffff640 1 -- 172.21.15.66:0/2788702807 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6078017070 con 0x55cd4f39f7b0 2024-09-12T00:19:13.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f5f6ffff640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 0x7f5f7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f5f6ffff640 1 -- 172.21.15.66:0/2788702807 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6078015020 con 0x55cd4f39f7b0 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608769d640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 0x7f5f7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 0x55cd4f525120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f525660 con 0x55cd4f42f880 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608869f640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 0x55cd4f525120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608769d640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 0x7f5f7003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ae000 tx=0x7f607c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608869f640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 0x55cd4f525120 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608869f640 1 -- 172.21.15.66:0/2788702807 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f608000a4d0 con 0x55cd4f42f880 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f51f4b0 con 0x55cd4f42f880 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608869f640 1 -- 172.21.15.66:0/2788702807 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f608000a4d0 con 0x55cd4f42f880 2024-09-12T00:19:13.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 0x55cd4f529d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f52a480 con 0x55cd4f527950 2024-09-12T00:19:13.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f6087e9e640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 0x55cd4f529d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f6087e9e640 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 0x55cd4f529d40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f6087e9e640 1 -- 172.21.15.66:0/2788702807 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f607802e070 con 0x55cd4f527950 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5267f0 con 0x55cd4f42f880 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608869f640 1 -- 172.21.15.66:0/2788702807 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f608000a4d0 con 0x55cd4f42f880 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f526c10 con 0x55cd4f527950 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f6087e9e640 1 -- 172.21.15.66:0/2788702807 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f607802e070 con 0x55cd4f527950 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.441+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608a3989c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608a3989c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4f340450 con 0x55cd4f538ad0 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45736/0 (socket says 172.21.15.66:45736) 2024-09-12T00:19:13.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608869f640 1 -- 172.21.15.66:0/3030000754 learned_addr learned my addr 172.21.15.66:0/3030000754 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608869f640 1 -- 172.21.15.66:0/3030000754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f539530 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608869f640 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55cd4f51ed30 tx=0x7f60800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 -- 172.21.15.66:0/3030000754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6080013640 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd4f539d90 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 -- 172.21.15.66:0/3030000754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60800137e0 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4f53a300 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 -- 172.21.15.66:0/3030000754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6080013ac0 con 0x55cd4f538ad0 2024-09-12T00:19:13.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 -- 172.21.15.66:0/3030000754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6080011040 con 0x55cd4f538ad0 2024-09-12T00:19:13.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 0x7f5f6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f5f6d7fa640 1 -- 172.21.15.66:0/3030000754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f608000e040 con 0x55cd4f538ad0 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.445+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 0x7f5f6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 0x7f5f6003bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55cd4f51f850 tx=0x7f607801af30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4f517160 con 0x55cd4f5453d0 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45752/0 (socket says 172.21.15.66:45752) 2024-09-12T00:19:13.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 -- 172.21.15.66:0/1001055892 learned_addr learned my addr 172.21.15.66:0/1001055892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 -- 172.21.15.66:0/1001055892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f545da0 con 0x55cd4f5453d0 2024-09-12T00:19:13.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 --2- 172.21.15.66:0/1001055892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6080020000 tx=0x7f6080013ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c565005dbe69274 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f5f66ffd640 1 -- 172.21.15.66:0/1001055892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6080021a90 con 0x55cd4f5453d0 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f5f66ffd640 1 -- 172.21.15.66:0/1001055892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6080021440 con 0x55cd4f5453d0 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f5f66ffd640 1 -- 172.21.15.66:0/1001055892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60800520d0 con 0x55cd4f5453d0 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- 172.21.15.66:0/1001055892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 msgr2=0x55cd4f5457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 --2- 172.21.15.66:0/1001055892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6080020000 tx=0x7f6080013ef0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- 172.21.15.66:0/1001055892 shutdown_connections 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 --2- 172.21.15.66:0/1001055892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f5457b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- 172.21.15.66:0/1001055892 >> 172.21.15.66:0/1001055892 conn(0x55cd4f541800 msgr2=0x55cd4f53fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- 172.21.15.66:0/1001055892 shutdown_connections 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- 172.21.15.66:0/1001055892 wait complete. 2024-09-12T00:19:13.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 Processor -- start 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- start start 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608a3989c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cd4f5463e0 con 0x55cd4f5453d0 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.449+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608869f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45766/0 (socket says 172.21.15.66:45766) 2024-09-12T00:19:13.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 learned_addr learned my addr 172.21.15.66:0/3473068413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4f54ce40 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608869f640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6080020000 tx=0x7f6080050870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 -- 172.21.15.66:0/3473068413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60800522e0 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd4f54d0d0 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4f54da80 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 -- 172.21.15.66:0/3473068413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60800143c0 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 -- 172.21.15.66:0/3473068413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6080020bd0 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 -- 172.21.15.66:0/3473068413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6080049040 con 0x55cd4f5453d0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f50039a70 0x7f5f5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f5f657fa640 1 -- 172.21.15.66:0/3473068413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f6080046040 con 0x55cd4f5453d0 2024-09-12T00:19:13.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f557e60 0x55cd4f55a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f50039a70 0x7f5f5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55aa40 con 0x55cd4f557e60 2024-09-12T00:19:13.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608769d640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f557e60 0x55cd4f55a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f50039a70 0x7f5f5003bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6078017f90 tx=0x7f6078028000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.453+0000 7f608769d640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f557e60 0x55cd4f55a2f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 realm 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55ae10 con 0x55cd4f557e60 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55b6e0 con 0x55cd4f557e60 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55ba80 con 0x55cd4f557e60 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f55c530 0x55cd4f55e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55f080 con 0x55cd4f55c530 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f55c530 0x55cd4f55e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f55c530 0x55cd4f55e920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 20 searching for the correct realm 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f608003ca60 0x7f608003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f608003ca60 0x7f608003c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f608003ca60 0x7f608003c3f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f6087e9e640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f60780421a0 0x7f6078048300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.457+0000 7f608769d640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f60780421a0 0x7f6078048300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f60780421a0 0x7f6078048300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.461+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.465+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f55c530 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f60780421a0 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.469+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x55cd4f557e60 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560950 con 0x7f608003ca60 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:13.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55fa70 con 0x55cd4f557e60 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f560310 con 0x55cd4f557e60 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55f6b0 con 0x55cd4f55c530 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 zone default found 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 4 Realm: () 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 zonegroup default 2024-09-12T00:19:13.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f55ff40 con 0x7f60780421a0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5631d0 con 0x55cd4f55c530 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f563590 con 0x55cd4f55c530 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 started sync module instance, tier type = 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.473+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f562610 con 0x7f608003ca60 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94340287701344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5639f0 con 0x7f608003ca60 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f564240 con 0x55cd4f557e60 2024-09-12T00:19:13.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94340287701344] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94340287708560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f564660 con 0x55cd4f557e60 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.477+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f564eb0 con 0x55cd4f55c530 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94340287708560] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94340287710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f564f80 con 0x55cd4f55c530 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f565830 con 0x7f608003ca60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94340287713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f566100 con 0x7f608003ca60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f566b00 con 0x55cd4f557e60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94340287710896] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.481+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94340287713456] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94340287716432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f566610 con 0x55cd4f557e60 2024-09-12T00:19:13.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5673d0 con 0x7f60780421a0 2024-09-12T00:19:13.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94340287716432] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94340287711952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5672f0 con 0x7f60780421a0 2024-09-12T00:19:13.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.485+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f567b40 con 0x7f60780421a0 2024-09-12T00:19:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94340287711952] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94340287721504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5679f0 con 0x7f60780421a0 2024-09-12T00:19:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5679f0 con 0x7f60780421a0 2024-09-12T00:19:13.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94340287721504] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94340287722560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f568580 con 0x7f60780421a0 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=0 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=1 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=2 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=3 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=4 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=5 2024-09-12T00:19:13.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.489+0000 7f608a3989c0 20 add_watcher() i=6 2024-09-12T00:19:13.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94340287722560] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0b4040 con 0x7f60780421a0 2024-09-12T00:19:13.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608a3989c0 20 add_watcher() i=7 2024-09-12T00:19:13.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608a3989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:13.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f56b9b0 con 0x55cd4f557e60 2024-09-12T00:19:13.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f607c0b4040 con 0x55cd4f557e60 2024-09-12T00:19:13.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.493+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94340287726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f568f00 con 0x55cd4f557e60 2024-09-12T00:19:13.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94340287726240] v31'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f5f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 5 note: GC not initialized 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f5f3cfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 Filter name: none 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f5eb67fc640 20 reqs_thread_entry: start 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58f060 con 0x7f608003ca60 2024-09-12T00:19:13.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58f8f0 con 0x55cd4f55c530 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(63 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58e310 con 0x7f608003ca60 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:13.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58e310 con 0x55cd4f55c530 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(65 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 4.30 4:0d6f2ca4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5924d0 con 0x55cd4f55c530 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 4.1 4:831b4391:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f594ee0 con 0x7f608003ca60 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 4.a 4:52dbcbb5:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f597a60 con 0x7f608003ca60 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 4.35 4:afe87baa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f59a2d0 con 0x55cd4f557e60 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 4.32 4:4c178f1d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f59cb40 con 0x55cd4f557e60 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 4.33 4:cd533e59:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f59f4c0 con 0x7f60780421a0 2024-09-12T00:19:13.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:72 4.0 4:01f36204:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5a1d70 con 0x55cd4f55c530 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 4.12 4:4aa7517e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5a47c0 con 0x55cd4f557e60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:74 4.3b 4:dea3e5aa:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5a7680 con 0x55cd4f55c530 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 4.a 4:5196933a:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5aa500 con 0x7f608003ca60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 4.3f 4:fcc2f598:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5ad370 con 0x7f608003ca60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(66 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(69 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(68 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(72 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(75 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.9 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(74 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.497+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(76 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f607c0d7040 con 0x7f60780421a0 2024-09-12T00:19:13.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(73 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f5f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94340287726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f5aa500 con 0x55cd4f557e60 2024-09-12T00:19:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94340287726240] v31'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94340287701344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x7f608003ca60 2024-09-12T00:19:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.501+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94340287701344] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608a3989c0 20 remove_watcher() i=0 2024-09-12T00:19:13.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608a3989c0 2 removed watcher, disabling cache 2024-09-12T00:19:13.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94340287708560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x55cd4f557e60 2024-09-12T00:19:13.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94340287708560] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608a3989c0 20 remove_watcher() i=1 2024-09-12T00:19:13.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.505+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94340287710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x55cd4f55c530 2024-09-12T00:19:13.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608869f640 1 -- 172.21.15.66:0/3473068413 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94340287710896] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6080039020 con 0x55cd4f55c530 2024-09-12T00:19:13.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 20 remove_watcher() i=2 2024-09-12T00:19:13.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94340287713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x7f608003ca60 2024-09-12T00:19:13.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f6087e9e640 1 -- 172.21.15.66:0/3473068413 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94340287713456] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607802e070 con 0x7f608003ca60 2024-09-12T00:19:13.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 20 remove_watcher() i=3 2024-09-12T00:19:13.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94340287716432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x55cd4f557e60 2024-09-12T00:19:13.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94340287716432] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x55cd4f557e60 2024-09-12T00:19:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 20 remove_watcher() i=4 2024-09-12T00:19:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.509+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94340287711952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x7f60780421a0 2024-09-12T00:19:13.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.513+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94340287711952] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x7f60780421a0 2024-09-12T00:19:13.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.513+0000 7f608a3989c0 20 remove_watcher() i=5 2024-09-12T00:19:13.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.513+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94340287721504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x7f60780421a0 2024-09-12T00:19:13.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94340287721504] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x7f60780421a0 2024-09-12T00:19:13.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 20 remove_watcher() i=6 2024-09-12T00:19:13.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94340287722560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55cd4f58c950 con 0x7f60780421a0 2024-09-12T00:19:13.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94340287722560] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607c0d7040 con 0x7f60780421a0 2024-09-12T00:19:13.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 20 remove_watcher() i=7 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f60780421a0 msgr2=0x7f6078048300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f60780421a0 0x7f6078048300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f557e60 msgr2=0x55cd4f55a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f557e60 0x55cd4f55a2f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f608003ca60 msgr2=0x7f608003c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f608003ca60 0x7f608003c3f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f55c530 msgr2=0x55cd4f55e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f55c530 0x55cd4f55e920 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f50039a70 msgr2=0x7f5f5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f50039a70 0x7f5f5003bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6078017f90 tx=0x7f6078028000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 msgr2=0x55cd4f54c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608769d640 1 -- 172.21.15.66:0/3473068413 reap_dead start 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6080020000 tx=0x7f6080050870 comp rx=0 tx=0).stop 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 shutdown_connections 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3473068413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f5453d0 0x55cd4f54c8e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 >> 172.21.15.66:0/3473068413 conn(0x55cd4f541800 msgr2=0x55cd4f53fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 shutdown_connections 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3473068413 wait complete. 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 msgr2=0x7f5f6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 0x7f5f6003bf30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55cd4f51f850 tx=0x7f607801af30 comp rx=0 tx=0).stop 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 msgr2=0x55cd4f538ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55cd4f51ed30 tx=0x7f60800167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 shutdown_connections 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f60039a70 0x7f5f6003bf30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 --2- 172.21.15.66:0/3030000754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f538ad0 0x55cd4f538ef0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 >> 172.21.15.66:0/3030000754 conn(0x55cd4f52e480 msgr2=0x55cd4f52e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 shutdown_connections 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.517+0000 7f608a3989c0 1 -- 172.21.15.66:0/3030000754 wait complete. 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 msgr2=0x55cd4f525120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 0x55cd4f525120 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 msgr2=0x55cd4f529d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 0x55cd4f529d40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 msgr2=0x7f5f7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 0x7f5f7003bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f607c0ae000 tx=0x7f607c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 msgr2=0x55cd4f51dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55cd4f517900 tx=0x7f6078000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 shutdown_connections 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cd4f527950 0x55cd4f529d40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cd4f42f880 0x55cd4f525120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5f70039a70 0x7f5f7003bf30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 --2- 172.21.15.66:0/2788702807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd4f39f7b0 0x55cd4f51dfb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 >> 172.21.15.66:0/2788702807 conn(0x55cd4f425e90 msgr2=0x55cd4f511040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 shutdown_connections 2024-09-12T00:19:13.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.521+0000 7f608a3989c0 1 -- 172.21.15.66:0/2788702807 wait complete. 2024-09-12T00:19:13.536 INFO:teuthology.orchestra.run.smithi066.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0f94cb3c-a22e-48d3-91ff-0e4df7c90757","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","marker":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T00:19:12.731652Z","creation_time":"2024-09-12T00:19:08.903952Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-12T00:19:13.536 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:19:12.731652Z', 'creation_time': '2024-09-12T00:19:08.903952Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-12T00:19:13.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-12T00:19:13.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-12T00:19:13.537 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-12T00:19:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabdb3369c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5585cbfc3350 0x5585cc056d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabdb3369c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585cbf029c0 con 0x5585cbfc2f70 2024-09-12T00:19:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabdb3369c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5585cbf526d0 con 0x5585cbfc3350 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd8e3c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5585cbfc2f70 0x5585cc0535d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43096/0 (socket says 172.21.15.66:43096) 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1741683423 learned_addr learned my addr 172.21.15.66:0/1741683423 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd863b640 1 --2- 172.21.15.66:0/1741683423 >> v2:172.21.15.31:3300/0 conn(0x5585cbfc3350 0x5585cc056d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd7e3a640 1 -- 172.21.15.66:0/1741683423 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967408101 0 0) 0x5585cbf029c0 con 0x5585cbfc2f70 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd7e3a640 1 -- 172.21.15.66:0/1741683423 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabc4001e20 con 0x5585cbfc2f70 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd863b640 1 -- 172.21.15.66:0/1741683423 >> v1:172.21.15.31:6789/0 conn(0x5585cbfc2f70 legacy=0x5585cc0535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.605+0000 7fabd863b640 1 -- 172.21.15.66:0/1741683423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cbef6ca0 con 0x5585cbfc3350 2024-09-12T00:19:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabd863b640 1 --2- 172.21.15.66:0/1741683423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc3350 0x5585cc056d00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fabc000a480 tx=0x7fabc001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d42414ffcb4da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabd7e3a640 1 -- 172.21.15.66:0/1741683423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc00b0070 con 0x5585cbfc3350 2024-09-12T00:19:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabd7e3a640 1 -- 172.21.15.66:0/1741683423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc00ab540 con 0x5585cbfc3350 2024-09-12T00:19:13.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabd7e3a640 1 -- 172.21.15.66:0/1741683423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc00ab820 con 0x5585cbfc3350 2024-09-12T00:19:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1741683423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc3350 msgr2=0x5585cc056d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1741683423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc3350 0x5585cc056d00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fabc000a480 tx=0x7fabc001b280 comp rx=0 tx=0).stop 2024-09-12T00:19:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1741683423 shutdown_connections 2024-09-12T00:19:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1741683423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc3350 0x5585cc056d00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1741683423 >> 172.21.15.66:0/1741683423 conn(0x5585cc048ec0 msgr2=0x5585cc04b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1741683423 shutdown_connections 2024-09-12T00:19:13.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.609+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1741683423 wait complete. 2024-09-12T00:19:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabdb3369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabdb3369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585cbf56680 con 0x5585cbfc2f70 2024-09-12T00:19:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabd8e3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabd8e3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45788/0 (socket says 172.21.15.66:45788) 2024-09-12T00:19:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.625+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1044649232 learned_addr learned my addr 172.21.15.66:0/1044649232 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1044649232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cbed1da0 con 0x5585cbfc2f70 2024-09-12T00:19:13.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/1044649232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fabd00016a0 tx=0x7fabd0001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e02909dfce5c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7faac6e0d640 1 -- 172.21.15.66:0/1044649232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0004530 con 0x5585cbfc2f70 2024-09-12T00:19:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7faac6e0d640 1 -- 172.21.15.66:0/1044649232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd00046d0 con 0x5585cbfc2f70 2024-09-12T00:19:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7faac6e0d640 1 -- 172.21.15.66:0/1044649232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd00049f0 con 0x5585cbfc2f70 2024-09-12T00:19:13.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1044649232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 msgr2=0x5585cc13b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1044649232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fabd00016a0 tx=0x7fabd0001b60 comp rx=0 tx=0).stop 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1044649232 shutdown_connections 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1044649232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc13b880 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1044649232 >> 172.21.15.66:0/1044649232 conn(0x5585cc048ec0 msgr2=0x5585cc137520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1044649232 shutdown_connections 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1044649232 wait complete. 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585cbef8a50 con 0x5585cbfc2f70 2024-09-12T00:19:13.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45792/0 (socket says 172.21.15.66:45792) 2024-09-12T00:19:13.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1510292678 learned_addr learned my addr 172.21.15.66:0/1510292678 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc1433c0 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5585cc13c870 tx=0x7fabd0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7faac560a640 1 -- 172.21.15.66:0/1510292678 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0013760 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.629+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585cc143650 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7faac560a640 1 -- 172.21.15.66:0/1510292678 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd0013900 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7faac560a640 1 -- 172.21.15.66:0/1510292678 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0013c00 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cc144000 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7faac560a640 1 -- 172.21.15.66:0/1510292678 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fabd0010070 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7faac560a640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 0x7faac003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7faac560a640 1 -- 172.21.15.66:0/1510292678 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fabd0018070 con 0x5585cbfc2f70 2024-09-12T00:19:13.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd863b640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 0x7faac003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 0x5585cc149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc14a510 con 0x5585cbfc3350 2024-09-12T00:19:13.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd963d640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 0x5585cc149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd863b640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 0x7faac003bf80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabc00ad000 tx=0x7fabc00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd963d640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 0x5585cc149fd0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd963d640 1 -- 172.21.15.66:0/1510292678 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc80083f0 con 0x5585cbfc3350 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc144360 con 0x5585cbfc3350 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd963d640 1 -- 172.21.15.66:0/1510292678 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fabc80083f0 con 0x5585cbfc3350 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 0x5585cc14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc14f290 con 0x5585cc14c7b0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 0x5585cc14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.633+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 0x5585cc14eba0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1510292678 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fabd001b030 con 0x5585cc14c7b0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc14b650 con 0x5585cbfc3350 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 -- 172.21.15.66:0/1510292678 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fabc80083f0 con 0x5585cbfc3350 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc14bb30 con 0x5585cc14c7b0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd8e3c640 1 -- 172.21.15.66:0/1510292678 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fabd001b030 con 0x5585cc14c7b0 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585cbf63450 con 0x5585cc15d9e0 2024-09-12T00:19:13.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45800/0 (socket says 172.21.15.66:45800) 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 -- 172.21.15.66:0/4274598545 learned_addr learned my addr 172.21.15.66:0/4274598545 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 -- 172.21.15.66:0/4274598545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc15e440 con 0x5585cc15d9e0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabd963d640 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x5585cc143be0 tx=0x7fabc800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7faabe7fc640 1 -- 172.21.15.66:0/4274598545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc801c020 con 0x5585cc15d9e0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585cc15eca0 con 0x5585cc15d9e0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7faabe7fc640 1 -- 172.21.15.66:0/4274598545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8007d20 con 0x5585cc15d9e0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7faabe7fc640 1 -- 172.21.15.66:0/4274598545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc8018440 con 0x5585cc15d9e0 2024-09-12T00:19:13.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.637+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cc15f210 con 0x5585cc15d9e0 2024-09-12T00:19:13.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faabe7fc640 1 -- 172.21.15.66:0/4274598545 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fabc801f020 con 0x5585cc15d9e0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faabe7fc640 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 0x7faab003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faabe7fc640 1 -- 172.21.15.66:0/4274598545 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fabc8051ca0 con 0x5585cc15d9e0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 0x7faab003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 0x7faab003bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5585cc14a950 tx=0x7fabd0004bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585cc13c0b0 con 0x5585cc16b3b0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45812/0 (socket says 172.21.15.66:45812) 2024-09-12T00:19:13.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd963d640 1 -- 172.21.15.66:0/1775376166 learned_addr learned my addr 172.21.15.66:0/1775376166 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd963d640 1 -- 172.21.15.66:0/1775376166 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc16bd80 con 0x5585cc16b3b0 2024-09-12T00:19:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabd963d640 1 --2- 172.21.15.66:0/1775376166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabc80500b0 tx=0x7fabc8016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb0ec5ba8182a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faaaffff640 1 -- 172.21.15.66:0/1775376166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc8021400 con 0x5585cc16b3b0 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faaaffff640 1 -- 172.21.15.66:0/1775376166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8020c90 con 0x5585cc16b3b0 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7faaaffff640 1 -- 172.21.15.66:0/1775376166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80215a0 con 0x5585cc16b3b0 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1775376166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 msgr2=0x5585cc16b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1775376166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabc80500b0 tx=0x7fabc8016970 comp rx=0 tx=0).stop 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1775376166 shutdown_connections 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1775376166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc16b790 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1775376166 >> 172.21.15.66:0/1775376166 conn(0x5585cc166770 msgr2=0x5585cc1649b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1775376166 shutdown_connections 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.641+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1775376166 wait complete. 2024-09-12T00:19:13.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 Processor -- start 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 -- start start 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5585cc16a2a0 con 0x5585cc16b3b0 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd963d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45820/0 (socket says 172.21.15.66:45820) 2024-09-12T00:19:13.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 learned_addr learned my addr 172.21.15.66:0/3042129968 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cc171d70 con 0x5585cc16b3b0 2024-09-12T00:19:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd963d640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabc80169b0 tx=0x7fabc8050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 -- 172.21.15.66:0/3042129968 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc8017ac0 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585cc172000 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 -- 172.21.15.66:0/3042129968 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8017c60 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 -- 172.21.15.66:0/3042129968 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabc80203b0 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cc1729b0 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 -- 172.21.15.66:0/3042129968 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fabc8016040 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faaa4039a70 0x7faaa403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7faaae7fc640 1 -- 172.21.15.66:0/3042129968 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7fabc8032070 con 0x5585cc16b3b0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.645+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faaa4039a70 0x7faaa403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cc17cd90 0x5585cc17f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc17f970 con 0x5585cc17cd90 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cc17cd90 0x5585cc17f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faaa4039a70 0x7faaa403bf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fabd0010a80 tx=0x7fabd0034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cc17cd90 0x5585cc17f220 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 realm 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc17fda0 con 0x5585cc17cd90 2024-09-12T00:19:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc180670 con 0x5585cc17cd90 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc180a10 con 0x5585cc17cd90 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc181770 0x5585cc183b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1840a0 con 0x5585cc181770 2024-09-12T00:19:13.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc181770 0x5585cc183b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc181770 0x5585cc183b60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 20 searching for the correct realm 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fabc8021020 0x7fabc80353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fabc8021020 0x7fabc80353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fabc8021020 0x7fabc80353c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fabd004d140 0x7fabd00283d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.649+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fabd004d140 0x7fabd00283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fabd004d140 0x7fabd00283d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.653+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.657+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.661+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc181770 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabd004d140 2024-09-12T00:19:13.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x5585cc17cd90 2024-09-12T00:19:13.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185900 con 0x7fabc8021020 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1849f0 con 0x5585cc17cd90 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc184600 con 0x5585cc17cd90 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1845d0 con 0x5585cc181770 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 zone default found 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 4 Realm: () 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:13.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 zonegroup default 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc185db0 con 0x7fabd004d140 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.665+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1878a0 con 0x5585cc181770 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc187da0 con 0x5585cc181770 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 started sync module instance, tier type = 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc186c40 con 0x7fabc8021020 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94033143162768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc188200 con 0x7fabc8021020 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc188a50 con 0x5585cc17cd90 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.669+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94033143162768] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94033143169536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc188ad0 con 0x5585cc17cd90 2024-09-12T00:19:13.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189320 con 0x5585cc181770 2024-09-12T00:19:13.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94033143169536] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94033143170864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189160 con 0x5585cc181770 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.673+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189d30 con 0x7fabc8021020 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94033143175296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189ca0 con 0x7fabc8021020 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18aca0 con 0x5585cc17cd90 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94033143170864] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94033143175296] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94033143177504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18ac60 con 0x5585cc17cd90 2024-09-12T00:19:13.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.677+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18b540 con 0x7fabd004d140 2024-09-12T00:19:13.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94033143177504] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94033143179120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18b110 con 0x7fabd004d140 2024-09-12T00:19:13.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18bad0 con 0x7fabd004d140 2024-09-12T00:19:13.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94033143179120] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94033143180864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18bad0 con 0x7fabd004d140 2024-09-12T00:19:13.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.681+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18c490 con 0x7fabd004d140 2024-09-12T00:19:13.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94033143185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18c8b0 con 0x7fabd004d140 2024-09-12T00:19:13.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=0 2024-09-12T00:19:13.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=1 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=2 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=3 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=4 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=5 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94033143180864] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=6 2024-09-12T00:19:13.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94033143185376] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x7fabd004d140 2024-09-12T00:19:13.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 20 add_watcher() i=7 2024-09-12T00:19:13.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:13.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18b620 con 0x5585cc17cd90 2024-09-12T00:19:13.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.685+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94033143182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18ce30 con 0x5585cc17cd90 2024-09-12T00:19:13.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94033143182880] v31'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fabc00b3040 con 0x5585cc17cd90 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7faa8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 5 note: GC not initialized 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7faa8dfe3640 20 reqs_thread_entry: start 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 20 Filter name: none 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fa9ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:13.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1b24b0 con 0x7fabd004d140 2024-09-12T00:19:13.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'48 uv32 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1849f0 con 0x7fabd004d140 2024-09-12T00:19:13.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.689+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1849f0 con 0x5585cc181770 2024-09-12T00:19:13.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1878a0 con 0x7fabd004d140 2024-09-12T00:19:13.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1878a0 con 0x5585cc17cd90 2024-09-12T00:19:13.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1878a0 con 0x7fabc8021020 2024-09-12T00:19:13.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'23 uv22 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.693+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'29 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc17cd90 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc17cd90 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'20 uv20 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc17cd90 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'49 uv41 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.697+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc17cd90 2024-09-12T00:19:13.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabd004d140 2024-09-12T00:19:13.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'50 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabd004d140 2024-09-12T00:19:13.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.701+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc181770 2024-09-12T00:19:13.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x5585cc17cd90 2024-09-12T00:19:13.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'13 uv13 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabc8021020 2024-09-12T00:19:13.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fabd0066040 con 0x7fabd004d140 2024-09-12T00:19:13.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.710 INFO:teuthology.orchestra.run.smithi066.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-12T00:19:13.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7faa8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.705+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94033143182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1b0780 con 0x5585cc17cd90 2024-09-12T00:19:13.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94033143182880] v31'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94033143162768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc1b0780 con 0x7fabc8021020 2024-09-12T00:19:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94033143162768] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabdb3369c0 20 remove_watcher() i=0 2024-09-12T00:19:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabdb3369c0 2 removed watcher, disabling cache 2024-09-12T00:19:13.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.709+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94033143169536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc186790 con 0x5585cc17cd90 2024-09-12T00:19:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94033143169536] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabdb3369c0 20 remove_watcher() i=1 2024-09-12T00:19:13.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94033143170864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc186790 con 0x5585cc181770 2024-09-12T00:19:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabd963d640 1 -- 172.21.15.66:0/3042129968 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94033143170864] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc803c020 con 0x5585cc181770 2024-09-12T00:19:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabdb3369c0 20 remove_watcher() i=2 2024-09-12T00:19:13.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.713+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94033143175296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc188730 con 0x7fabc8021020 2024-09-12T00:19:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabd8e3c640 1 -- 172.21.15.66:0/3042129968 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94033143175296] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabd001b030 con 0x7fabc8021020 2024-09-12T00:19:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabdb3369c0 20 remove_watcher() i=3 2024-09-12T00:19:13.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94033143177504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189880 con 0x5585cc17cd90 2024-09-12T00:19:13.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94033143177504] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x5585cc17cd90 2024-09-12T00:19:13.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabdb3369c0 20 remove_watcher() i=4 2024-09-12T00:19:13.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.717+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94033143179120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc188730 con 0x7fabd004d140 2024-09-12T00:19:13.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94033143179120] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabdb3369c0 20 remove_watcher() i=5 2024-09-12T00:19:13.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94033143180864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc18a120 con 0x7fabd004d140 2024-09-12T00:19:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94033143180864] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabdb3369c0 20 remove_watcher() i=6 2024-09-12T00:19:13.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.721+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94033143185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5585cc189880 con 0x7fabd004d140 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94033143185376] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabc00d7040 con 0x7fabd004d140 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 20 remove_watcher() i=7 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fabd004d140 msgr2=0x7fabd00283d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fabd004d140 0x7fabd00283d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cc17cd90 msgr2=0x5585cc17f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cc17cd90 0x5585cc17f220 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fabc8021020 msgr2=0x7fabc80353c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fabc8021020 0x7fabc80353c0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc181770 msgr2=0x5585cc183b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc181770 0x5585cc183b60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faaa4039a70 msgr2=0x7faaa403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faaa4039a70 0x7faaa403bf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fabd0010a80 tx=0x7fabd0034000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 msgr2=0x5585cc171810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabd863b640 1 -- 172.21.15.66:0/3042129968 reap_dead start 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabc80169b0 tx=0x7fabc8050040 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 shutdown_connections 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/3042129968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc16b3b0 0x5585cc171810 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 >> 172.21.15.66:0/3042129968 conn(0x5585cc166770 msgr2=0x5585cc164980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 shutdown_connections 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/3042129968 wait complete. 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 msgr2=0x7faab003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 0x7faab003bf30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5585cc14a950 tx=0x7fabd0004bb0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 msgr2=0x5585cc15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x5585cc143be0 tx=0x7fabc800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 shutdown_connections 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faab0039a70 0x7faab003bf30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/4274598545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cc15d9e0 0x5585cc15de00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 >> 172.21.15.66:0/4274598545 conn(0x5585cc153390 msgr2=0x5585cc153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 shutdown_connections 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/4274598545 wait complete. 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 msgr2=0x5585cc149fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 0x5585cc149fd0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 msgr2=0x5585cc14eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 0x5585cc14eba0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 msgr2=0x7faac003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 0x7faac003bf80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fabc00ad000 tx=0x7fabc00a5040 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 msgr2=0x5585cc142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5585cc13c870 tx=0x7fabd0004470 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 shutdown_connections 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5585cc14c7b0 0x5585cc14eba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5585cbfc3350 0x5585cc149fd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7faac0039ac0 0x7faac003bf80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 --2- 172.21.15.66:0/1510292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5585cbfc2f70 0x5585cc142e60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 >> 172.21.15.66:0/1510292678 conn(0x5585cc048ec0 msgr2=0x5585cc135fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 shutdown_connections 2024-09-12T00:19:13.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.725+0000 7fabdb3369c0 1 -- 172.21.15.66:0/1510292678 wait complete. 2024-09-12T00:19:13.742 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-12T00:19:13.742 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T00:19:13.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T00:19:13.742 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T00:19:13.821 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:13.821 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:13.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75f0c609c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560fa8ef4770 0x560fa8f855a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75f0c609c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560fa8e349c0 con 0x560fa8ef4b50 2024-09-12T00:19:13.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75f0c609c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560fa8e846d0 con 0x560fa8ef4770 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75ee766640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560fa8ef4770 0x560fa8f855a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75ee766640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560fa8ef4770 0x560fa8f855a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45834/0 (socket says 172.21.15.66:45834) 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75ee766640 1 -- 172.21.15.66:0/1862868780 learned_addr learned my addr 172.21.15.66:0/1862868780 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.817+0000 7f75edf65640 1 --1- 172.21.15.66:0/1862868780 >> v1:172.21.15.31:6789/0 conn(0x560fa8ef4b50 0x560fa8f87af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43110/0 (socket says 172.21.15.66:43110) 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ee766640 1 -- 172.21.15.66:0/1862868780 >> v1:172.21.15.31:6789/0 conn(0x560fa8ef4b50 legacy=0x560fa8f87af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ee766640 1 -- 172.21.15.66:0/1862868780 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa8e28ca0 con 0x560fa8ef4770 2024-09-12T00:19:13.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ee766640 1 --2- 172.21.15.66:0/1862868780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa8f855a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f75e000a5c0 tx=0x7f75e001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6322116516c16420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ed764640 1 -- 172.21.15.66:0/1862868780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00a6070 con 0x560fa8ef4770 2024-09-12T00:19:13.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ed764640 1 -- 172.21.15.66:0/1862868780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e00af070 con 0x560fa8ef4770 2024-09-12T00:19:13.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75ed764640 1 -- 172.21.15.66:0/1862868780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00aa5c0 con 0x560fa8ef4770 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75f0c609c0 1 -- 172.21.15.66:0/1862868780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 msgr2=0x560fa8f855a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/1862868780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa8f855a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f75e000a5c0 tx=0x7f75e001b340 comp rx=0 tx=0).stop 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75f0c609c0 1 -- 172.21.15.66:0/1862868780 shutdown_connections 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/1862868780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa8f855a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.821+0000 7f75f0c609c0 1 -- 172.21.15.66:0/1862868780 >> 172.21.15.66:0/1862868780 conn(0x560fa8f7ae90 msgr2=0x560fa8f7d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.825+0000 7f75f0c609c0 1 -- 172.21.15.66:0/1862868780 shutdown_connections 2024-09-12T00:19:13.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.825+0000 7f75f0c609c0 1 -- 172.21.15.66:0/1862868780 wait complete. 2024-09-12T00:19:13.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560fa8e88680 con 0x560fa8ef4770 2024-09-12T00:19:13.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75ee766640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75ee766640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45842/0 (socket says 172.21.15.66:45842) 2024-09-12T00:19:13.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75ee766640 1 -- 172.21.15.66:0/2497341481 learned_addr learned my addr 172.21.15.66:0/2497341481 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75ee766640 1 -- 172.21.15.66:0/2497341481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa8e03da0 con 0x560fa8ef4770 2024-09-12T00:19:13.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75ee766640 1 --2- 172.21.15.66:0/2497341481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f75e00ac040 tx=0x7f75e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684bae8fe035d8da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f74dc608640 1 -- 172.21.15.66:0/2497341481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00aa970 con 0x560fa8ef4770 2024-09-12T00:19:13.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f74dc608640 1 -- 172.21.15.66:0/2497341481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e00aab10 con 0x560fa8ef4770 2024-09-12T00:19:13.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f74dc608640 1 -- 172.21.15.66:0/2497341481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00aae30 con 0x560fa8ef4770 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2497341481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 msgr2=0x560fa906d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2497341481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f75e00ac040 tx=0x7f75e0003030 comp rx=0 tx=0).stop 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2497341481 shutdown_connections 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2497341481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa906d9e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2497341481 >> 172.21.15.66:0/2497341481 conn(0x560fa8f7ae90 msgr2=0x560fa9069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2497341481 shutdown_connections 2024-09-12T00:19:13.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2497341481 wait complete. 2024-09-12T00:19:13.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.841+0000 7f75f0c609c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560fa8e2aa50 con 0x560fa8ef4770 2024-09-12T00:19:13.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75ee766640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75ee766640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45848/0 (socket says 172.21.15.66:45848) 2024-09-12T00:19:13.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75ee766640 1 -- 172.21.15.66:0/2394896279 learned_addr learned my addr 172.21.15.66:0/2394896279 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75ee766640 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa9075430 con 0x560fa8ef4770 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75ee766640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75e001b170 tx=0x7f75e00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 -- 172.21.15.66:0/2394896279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00c6690 con 0x560fa8ef4770 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 -- 172.21.15.66:0/2394896279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e00cc070 con 0x560fa8ef4770 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fa90756c0 con 0x560fa8ef4770 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 -- 172.21.15.66:0/2394896279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e00c69a0 con 0x560fa8ef4770 2024-09-12T00:19:13.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa9076070 con 0x560fa8ef4770 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 -- 172.21.15.66:0/2394896279 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f75e00c6c10 con 0x560fa8ef4770 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 0x7f74d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f74dae05640 1 -- 172.21.15.66:0/2394896279 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f75e00ebc60 con 0x560fa8ef4770 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75edf65640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 0x7f74d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 0x560fa907c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa907c580 con 0x560fa8ef4b50 2024-09-12T00:19:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75eef67640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 0x560fa907c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.845+0000 7f75edf65640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 0x7f74d403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001e90 tx=0x7f75e40013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 0x560fa907c040 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 -- 172.21.15.66:0/2394896279 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e800a4d0 con 0x560fa8ef4b50 2024-09-12T00:19:13.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90763b0 con 0x560fa8ef4b50 2024-09-12T00:19:13.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 -- 172.21.15.66:0/2394896279 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75e800a4d0 con 0x560fa8ef4b50 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 0x560fa9080be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90812d0 con 0x560fa907e7f0 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75ee766640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 0x560fa9080be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75ee766640 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 0x560fa9080be0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75ee766640 1 -- 172.21.15.66:0/2394896279 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75e00bd3f0 con 0x560fa907e7f0 2024-09-12T00:19:13.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa907d690 con 0x560fa8ef4b50 2024-09-12T00:19:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 -- 172.21.15.66:0/2394896279 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75e800a4d0 con 0x560fa8ef4b50 2024-09-12T00:19:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa907db70 con 0x560fa907e7f0 2024-09-12T00:19:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75ee766640 1 -- 172.21.15.66:0/2394896279 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75e00bd3f0 con 0x560fa907e7f0 2024-09-12T00:19:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75f0c609c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560fa8e95450 con 0x560fa908fa20 2024-09-12T00:19:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45854/0 (socket says 172.21.15.66:45854) 2024-09-12T00:19:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.849+0000 7f75eef67640 1 -- 172.21.15.66:0/2160949552 learned_addr learned my addr 172.21.15.66:0/2160949552 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 -- 172.21.15.66:0/2160949552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa9090480 con 0x560fa908fa20 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x560fa9076260 tx=0x7f75e80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 -- 172.21.15.66:0/2160949552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8013450 con 0x560fa908fa20 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fa9090ce0 con 0x560fa908fa20 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 -- 172.21.15.66:0/2160949552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8013610 con 0x560fa908fa20 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 -- 172.21.15.66:0/2160949552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8013970 con 0x560fa908fa20 2024-09-12T00:19:13.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa9091250 con 0x560fa908fa20 2024-09-12T00:19:13.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 -- 172.21.15.66:0/2160949552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f75e8011040 con 0x560fa908fa20 2024-09-12T00:19:13.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 0x7f74c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f74d3fff640 1 -- 172.21.15.66:0/2160949552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f75e800e040 con 0x560fa908fa20 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75ee766640 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 0x7f74c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75f0c609c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560fa906e170 con 0x560fa909c330 2024-09-12T00:19:13.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75ee766640 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 0x7f74c803bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x560fa907c9c0 tx=0x7f75e00ea060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45862/0 (socket says 172.21.15.66:45862) 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 -- 172.21.15.66:0/2474100621 learned_addr learned my addr 172.21.15.66:0/2474100621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.853+0000 7f75eef67640 1 -- 172.21.15.66:0/2474100621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa909cd00 con 0x560fa909c330 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 --2- 172.21.15.66:0/2474100621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f75e8050920 tx=0x7f75e80293a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f4b0aaed24fade server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74d1ffb640 1 -- 172.21.15.66:0/2474100621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e804d020 con 0x560fa909c330 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74d1ffb640 1 -- 172.21.15.66:0/2474100621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e802a960 con 0x560fa909c330 2024-09-12T00:19:13.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74d1ffb640 1 -- 172.21.15.66:0/2474100621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e802a440 con 0x560fa909c330 2024-09-12T00:19:13.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2474100621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 msgr2=0x560fa909c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2474100621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f75e8050920 tx=0x7f75e80293a0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2474100621 shutdown_connections 2024-09-12T00:19:13.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2474100621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa909c710 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2474100621 >> 172.21.15.66:0/2474100621 conn(0x560fa9098760 msgr2=0x560fa90969a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2474100621 shutdown_connections 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2474100621 wait complete. 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 Processor -- start 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- start start 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560fa909d340 con 0x560fa909c330 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45874/0 (socket says 172.21.15.66:45874) 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 learned_addr learned my addr 172.21.15.66:0/2829489174 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa90a3d40 con 0x560fa909c330 2024-09-12T00:19:13.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75eef67640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f75e801fff0 tx=0x7f75e8050880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74bffff640 1 -- 172.21.15.66:0/2829489174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e801fae0 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fa90a3fd0 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa90a4980 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74bffff640 1 -- 172.21.15.66:0/2829489174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e801fc80 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.857+0000 7f74bffff640 1 -- 172.21.15.66:0/2829489174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e804f2d0 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f74bffff640 1 -- 172.21.15.66:0/2829489174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f75e804f470 con 0x560fa909c330 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f74bffff640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74b8039a70 0x7f74b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f74bffff640 1 -- 172.21.15.66:0/2829489174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f75e8048040 con 0x560fa909c330 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75ee766640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74b8039a70 0x7f74b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa90aef50 0x560fa90b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b1b30 con 0x560fa90aef50 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa90aef50 0x560fa90b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75ee766640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74b8039a70 0x7f74b803bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75e00b3eb0 tx=0x7f75e00ec000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa90aef50 0x560fa90b13e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e400f660 con 0x560fa90aef50 2024-09-12T00:19:13.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 realm 2024-09-12T00:19:13.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90ae360 con 0x560fa90aef50 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e400f660 con 0x560fa90aef50 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b2630 con 0x560fa90aef50 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e400f660 con 0x560fa90aef50 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b2f00 con 0x560fa90aef50 2024-09-12T00:19:13.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75e400f660 con 0x560fa90aef50 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa90b3920 0x560fa90b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b6400 con 0x560fa90b3920 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa90b3920 0x560fa90b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa90b3920 0x560fa90b5d10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 20 searching for the correct realm 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f75e8013070 0x7f75e801a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.861+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75ee766640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f75e8013070 0x7f75e801a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75ee766640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f75e8013070 0x7f75e801a9e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75ee766640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f75e0009040 0x7f75e00b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f75e0009040 0x7f75e00b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:13.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f75e0009040 0x7f75e00b33f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:13.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e400f660 con 0x7f75e0009040 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e400f660 con 0x560fa90aef50 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x7f75e0009040 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.865+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x7f75e0009040 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x7f75e0009040 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x7f75e0009040 2024-09-12T00:19:13.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.869+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x7f75e0009040 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e402b040 con 0x560fa90aef50 2024-09-12T00:19:13.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.873+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90b3920 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e0009040 2024-09-12T00:19:13.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x560fa90aef50 2024-09-12T00:19:13.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b7cd0 con 0x7f75e8013070 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b6d50 con 0x560fa90aef50 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b75f0 con 0x560fa90aef50 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b8100 con 0x560fa90b3920 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 zone default found 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 4 Realm: () 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:13.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 zonegroup default 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.877+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b84a0 con 0x7f75e0009040 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90ba340 con 0x560fa90b3920 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90ba6e0 con 0x560fa90b3920 2024-09-12T00:19:13.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:13.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 started sync module instance, tier type = 2024-09-12T00:19:13.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:13.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90b9780 con 0x7f75e8013070 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94625260606160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90baaf0 con 0x7f75e8013070 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bb340 con 0x560fa90aef50 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.881+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94625260606160] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94625260612336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bb3c0 con 0x560fa90aef50 2024-09-12T00:19:13.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bbc50 con 0x560fa90b3920 2024-09-12T00:19:13.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94625260612336] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94625260613392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bb7e0 con 0x560fa90b3920 2024-09-12T00:19:13.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.885+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bc660 con 0x7f75e8013070 2024-09-12T00:19:13.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94625260618160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bca80 con 0x7f75e8013070 2024-09-12T00:19:13.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bd4f0 con 0x560fa90aef50 2024-09-12T00:19:13.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94625260613392] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94625260618160] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94625260621760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bc5d0 con 0x560fa90aef50 2024-09-12T00:19:13.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.889+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bdd90 con 0x7f75e0009040 2024-09-12T00:19:13.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94625260623696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90be020 con 0x7f75e0009040 2024-09-12T00:19:13.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90be870 con 0x7f75e0009040 2024-09-12T00:19:13.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94625260621760] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94625260623696] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94625260624752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90be440 con 0x7f75e0009040 2024-09-12T00:19:13.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.893+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bec90 con 0x7f75e0009040 2024-09-12T00:19:13.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94625260627488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bf090 con 0x7f75e0009040 2024-09-12T00:19:13.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=0 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=1 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=2 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=3 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=4 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=5 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94625260624752] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=6 2024-09-12T00:19:13.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94625260627488] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 20 add_watcher() i=7 2024-09-12T00:19:13.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:13.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bdf90 con 0x560fa90aef50 2024-09-12T00:19:13.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.897+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94625260625808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bf5d0 con 0x560fa90aef50 2024-09-12T00:19:13.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94625260625808] v31'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f74a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:13.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:13.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 5 note: GC not initialized 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f741f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 Filter name: none 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f741d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e5730 con 0x560fa90aef50 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:13.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e5110 con 0x7f75e8013070 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 disabling bucket name=myfoo 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e61a0 con 0x7f75e8013070 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T00:19:13.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.901+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e7a80 con 0x560fa90b3920 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(65 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:13.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90f0470 con 0x560fa90b3920 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v31'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94625260795344 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90ef0e0 con 0x7f75e0009040 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify (1) cookie 94625260624752 notify 133143986193 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f75e4018040 con 0x7f75e0009040 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f74d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94625260624752 notifier 4592 bl.length()=760 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f74d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:13.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f74d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f74d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f74d1ffb640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f74b4003eb0 con 0x7f75e0009040 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(67 notify.6 [notify cookie 94625260795344 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify_complete (2) cookie 94625260795344 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560fa8e349c0 con 0x7f75e0009040 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:13.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.905+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90efc40 con 0x560fa90aef50 2024-09-12T00:19:13.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75f0c609c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75f0c609c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75f0c609c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94625260795344 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e8260 con 0x560fa90aef50 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94625260621760 notify 133143986196 ret 0) ==== 609+0+0 (crc 0 0 0) 0x560fa8e349c0 con 0x560fa90aef50 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f74d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94625260621760 notifier 4592 bl.length()=567 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f74d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f74d17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(70 notify.4 [notify cookie 94625260795344 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f74d17fa640 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f7424003440 con 0x560fa90aef50 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94625260795344 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f75e4043ac0 con 0x560fa90aef50 2024-09-12T00:19:13.916 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:13.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f74a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:13.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.909+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94625260625808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x560fa90aef50 2024-09-12T00:19:13.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94625260625808] v31'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94625260606160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x7f75e8013070 2024-09-12T00:19:13.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94625260606160] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75f0c609c0 20 remove_watcher() i=0 2024-09-12T00:19:13.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75f0c609c0 2 removed watcher, disabling cache 2024-09-12T00:19:13.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.913+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94625260612336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x560fa90aef50 2024-09-12T00:19:13.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94625260612336] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 20 remove_watcher() i=1 2024-09-12T00:19:13.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94625260613392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x560fa90b3920 2024-09-12T00:19:13.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75eef67640 1 -- 172.21.15.66:0/2829489174 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94625260613392] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e8039020 con 0x560fa90b3920 2024-09-12T00:19:13.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 20 remove_watcher() i=2 2024-09-12T00:19:13.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94625260618160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x7f75e8013070 2024-09-12T00:19:13.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75ee766640 1 -- 172.21.15.66:0/2829489174 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94625260618160] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e00bd3f0 con 0x7f75e8013070 2024-09-12T00:19:13.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 20 remove_watcher() i=3 2024-09-12T00:19:13.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.917+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94625260621760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x560fa90aef50 2024-09-12T00:19:13.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94625260621760] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x560fa90aef50 2024-09-12T00:19:13.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75f0c609c0 20 remove_watcher() i=4 2024-09-12T00:19:13.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94625260623696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90bcfc0 con 0x7f75e0009040 2024-09-12T00:19:13.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94625260623696] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75f0c609c0 20 remove_watcher() i=5 2024-09-12T00:19:13.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.921+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94625260624752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x7f75e0009040 2024-09-12T00:19:13.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94625260624752] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 20 remove_watcher() i=6 2024-09-12T00:19:13.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94625260627488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560fa90e3460 con 0x7f75e0009040 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94625260627488] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75e403b040 con 0x7f75e0009040 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 20 remove_watcher() i=7 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f75e0009040 msgr2=0x7f75e00b33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f75e0009040 0x7f75e00b33f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa90aef50 msgr2=0x560fa90b13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa90aef50 0x560fa90b13e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f75e8013070 msgr2=0x7f75e801a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f75e8013070 0x7f75e801a9e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa90b3920 msgr2=0x560fa90b5d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa90b3920 0x560fa90b5d10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74b8039a70 msgr2=0x7f74b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74b8039a70 0x7f74b803bf30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75e00b3eb0 tx=0x7f75e00ec000 comp rx=0 tx=0).stop 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 msgr2=0x560fa90a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75edf65640 1 -- 172.21.15.66:0/2829489174 reap_dead start 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f75e801fff0 tx=0x7f75e8050880 comp rx=0 tx=0).stop 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 shutdown_connections 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2829489174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa909c330 0x560fa90a37e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 >> 172.21.15.66:0/2829489174 conn(0x560fa9098760 msgr2=0x560fa9096970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 shutdown_connections 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.925+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2829489174 wait complete. 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 msgr2=0x7f74c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 0x7f74c803bf30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x560fa907c9c0 tx=0x7f75e00ea060 comp rx=0 tx=0).stop 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 msgr2=0x560fa908fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x560fa9076260 tx=0x7f75e80163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 shutdown_connections 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74c8039a70 0x7f74c803bf30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2160949552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa908fa20 0x560fa908fe40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 >> 172.21.15.66:0/2160949552 conn(0x560fa90853d0 msgr2=0x560fa90857b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 shutdown_connections 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2160949552 wait complete. 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 msgr2=0x560fa907c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 0x560fa907c040 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 msgr2=0x560fa9080be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 0x560fa9080be0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 msgr2=0x7f74d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 0x7f74d403bf30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001e90 tx=0x7f75e40013f0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 msgr2=0x560fa9074ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75e001b170 tx=0x7f75e00180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 shutdown_connections 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560fa907e7f0 0x560fa9080be0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560fa8ef4b50 0x560fa907c040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f74d4039a70 0x7f74d403bf30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 --2- 172.21.15.66:0/2394896279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560fa8ef4770 0x560fa9074ed0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:13.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 >> 172.21.15.66:0/2394896279 conn(0x560fa8f7ae90 msgr2=0x560fa9068110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:13.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 shutdown_connections 2024-09-12T00:19:13.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:13.929+0000 7f75f0c609c0 1 -- 172.21.15.66:0/2394896279 wait complete. 2024-09-12T00:19:13.947 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:13.949 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T00:19:13.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T00:19:13.949 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T00:19:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:14.025 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f34956929c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555f9cd59770 0x555f9cd59b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f34956929c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f9cc0b9c0 con 0x555f9cd5c8b0 2024-09-12T00:19:14.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f34956929c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555f9cc5b6d0 con 0x555f9cd59770 2024-09-12T00:19:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f3493198640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555f9cd59770 0x555f9cd59b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f3492997640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x555f9cd5c8b0 0x555f9cd5eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:43126/0 (socket says 172.21.15.66:43126) 2024-09-12T00:19:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f3492997640 1 -- 172.21.15.66:0/2407371753 learned_addr learned my addr 172.21.15.66:0/2407371753 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f3493198640 1 -- 172.21.15.66:0/2407371753 >> v1:172.21.15.31:6789/0 conn(0x555f9cd5c8b0 legacy=0x555f9cd5eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.021+0000 7f3493198640 1 -- 172.21.15.66:0/2407371753 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9cbffca0 con 0x555f9cd59770 2024-09-12T00:19:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.025+0000 7f3493198640 1 --2- 172.21.15.66:0/2407371753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9cd59b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f348400a480 tx=0x7f348401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3067827f75b3ac4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.025+0000 7f3492196640 1 -- 172.21.15.66:0/2407371753 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b0070 con 0x555f9cd59770 2024-09-12T00:19:14.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.025+0000 7f3492196640 1 -- 172.21.15.66:0/2407371753 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840ab540 con 0x555f9cd59770 2024-09-12T00:19:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.025+0000 7f3492196640 1 -- 172.21.15.66:0/2407371753 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840ab840 con 0x555f9cd59770 2024-09-12T00:19:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 -- 172.21.15.66:0/2407371753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 msgr2=0x555f9cd59b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 --2- 172.21.15.66:0/2407371753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9cd59b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f348400a480 tx=0x7f348401b280 comp rx=0 tx=0).stop 2024-09-12T00:19:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 -- 172.21.15.66:0/2407371753 shutdown_connections 2024-09-12T00:19:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 --2- 172.21.15.66:0/2407371753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9cd59b50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 -- 172.21.15.66:0/2407371753 >> 172.21.15.66:0/2407371753 conn(0x555f9cccd080 msgr2=0x555f9cccd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 -- 172.21.15.66:0/2407371753 shutdown_connections 2024-09-12T00:19:14.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.029+0000 7f34956929c0 1 -- 172.21.15.66:0/2407371753 wait complete. 2024-09-12T00:19:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f9cc5f680 con 0x555f9cd59770 2024-09-12T00:19:14.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f3493198640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f3493198640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45878/0 (socket says 172.21.15.66:45878) 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f3493198640 1 -- 172.21.15.66:0/1722219575 learned_addr learned my addr 172.21.15.66:0/1722219575 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f3493198640 1 -- 172.21.15.66:0/1722219575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9cbdada0 con 0x555f9cd59770 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f3493198640 1 --2- 172.21.15.66:0/1722219575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f34840ae040 tx=0x7f3484003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9b9d853097391d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f338160a640 1 -- 172.21.15.66:0/1722219575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b0070 con 0x555f9cd59770 2024-09-12T00:19:14.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f338160a640 1 -- 172.21.15.66:0/1722219575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840b1040 con 0x555f9cd59770 2024-09-12T00:19:14.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f338160a640 1 -- 172.21.15.66:0/1722219575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840ab6f0 con 0x555f9cd59770 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- 172.21.15.66:0/1722219575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 msgr2=0x555f9ce449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 --2- 172.21.15.66:0/1722219575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f34840ae040 tx=0x7f3484003030 comp rx=0 tx=0).stop 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- 172.21.15.66:0/1722219575 shutdown_connections 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 --2- 172.21.15.66:0/1722219575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd59770 0x555f9ce449e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- 172.21.15.66:0/1722219575 >> 172.21.15.66:0/1722219575 conn(0x555f9cccd080 msgr2=0x555f9ce40680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- 172.21.15.66:0/1722219575 shutdown_connections 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.045+0000 7f34956929c0 1 -- 172.21.15.66:0/1722219575 wait complete. 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f9cc01a50 con 0x555f9cd5c8b0 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f3493198640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f3493198640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45894/0 (socket says 172.21.15.66:45894) 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f3493198640 1 -- 172.21.15.66:0/3369897778 learned_addr learned my addr 172.21.15.66:0/3369897778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:14.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f3493198640 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9ce4c770 con 0x555f9cd5c8b0 2024-09-12T00:19:14.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f3493198640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34840ae040 tx=0x7f3484018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f337fe07640 1 -- 172.21.15.66:0/3369897778 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b7480 con 0x555f9cd5c8b0 2024-09-12T00:19:14.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9ce4ca00 con 0x555f9cd5c8b0 2024-09-12T00:19:14.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f337fe07640 1 -- 172.21.15.66:0/3369897778 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840b7620 con 0x555f9cd5c8b0 2024-09-12T00:19:14.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f337fe07640 1 -- 172.21.15.66:0/3369897778 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34840b7920 con 0x555f9cd5c8b0 2024-09-12T00:19:14.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9ce4d2c0 con 0x555f9cd5c8b0 2024-09-12T00:19:14.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.049+0000 7f337fe07640 1 -- 172.21.15.66:0/3369897778 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f34840b7ac0 con 0x555f9cd5c8b0 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f337fe07640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 0x7f337803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f337fe07640 1 -- 172.21.15.66:0/3369897778 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f34840bc070 con 0x555f9cd5c8b0 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3492997640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 0x7f337803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 0x555f9ce53670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce53bb0 con 0x555f9ce51280 2024-09-12T00:19:14.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493999640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 0x555f9ce53670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3492997640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 0x7f337803bf30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3488001650 tx=0x7f3488006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493999640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 0x555f9ce53670 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493999640 1 -- 172.21.15.66:0/3369897778 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348c0083f0 con 0x555f9ce51280 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce53f90 con 0x555f9ce51280 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493999640 1 -- 172.21.15.66:0/3369897778 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f348c0083f0 con 0x555f9ce51280 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 0x555f9ce58190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce58860 con 0x555f9ce55da0 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493198640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 0x555f9ce58190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493198640 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 0x555f9ce58190 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493198640 1 -- 172.21.15.66:0/3369897778 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34840d0070 con 0x555f9ce55da0 2024-09-12T00:19:14.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce54c40 con 0x555f9ce51280 2024-09-12T00:19:14.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493999640 1 -- 172.21.15.66:0/3369897778 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f348c0083f0 con 0x555f9ce51280 2024-09-12T00:19:14.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce55120 con 0x555f9ce55da0 2024-09-12T00:19:14.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f3493198640 1 -- 172.21.15.66:0/3369897778 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34840d0070 con 0x555f9ce55da0 2024-09-12T00:19:14.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.053+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f9cc6c450 con 0x555f9ce66f90 2024-09-12T00:19:14.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45900/0 (socket says 172.21.15.66:45900) 2024-09-12T00:19:14.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493999640 1 -- 172.21.15.66:0/2765089794 learned_addr learned my addr 172.21.15.66:0/2765089794 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:14.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493999640 1 -- 172.21.15.66:0/2765089794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9ce679f0 con 0x555f9ce66f90 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493999640 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x555f9ce4d150 tx=0x7f348c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 -- 172.21.15.66:0/2765089794 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c01c020 con 0x555f9ce66f90 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9ce68250 con 0x555f9ce66f90 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 -- 172.21.15.66:0/2765089794 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c007d00 con 0x555f9ce66f90 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 -- 172.21.15.66:0/2765089794 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c018440 con 0x555f9ce66f90 2024-09-12T00:19:14.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9ce687c0 con 0x555f9ce66f90 2024-09-12T00:19:14.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 -- 172.21.15.66:0/2765089794 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f348c01f020 con 0x555f9ce66f90 2024-09-12T00:19:14.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 0x7f336c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f337d602640 1 -- 172.21.15.66:0/2765089794 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f348c051d70 con 0x555f9ce66f90 2024-09-12T00:19:14.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f3493198640 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 0x7f336c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.057+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493198640 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 0x7f336c03bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34840bf750 tx=0x7f3484009fd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f9ce45150 con 0x555f9ce748e0 2024-09-12T00:19:14.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45910/0 (socket says 172.21.15.66:45910) 2024-09-12T00:19:14.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 -- 172.21.15.66:0/2623555616 learned_addr learned my addr 172.21.15.66:0/2623555616 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:14.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 -- 172.21.15.66:0/2623555616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9ce752d0 con 0x555f9ce748e0 2024-09-12T00:19:14.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 --2- 172.21.15.66:0/2623555616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f348c050130 tx=0x7f348c050300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22c11258d85e94a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3376ffd640 1 -- 172.21.15.66:0/2623555616 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c021400 con 0x555f9ce748e0 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3376ffd640 1 -- 172.21.15.66:0/2623555616 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c029350 con 0x555f9ce748e0 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3376ffd640 1 -- 172.21.15.66:0/2623555616 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c0215a0 con 0x555f9ce748e0 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- 172.21.15.66:0/2623555616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 msgr2=0x555f9ce74ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 --2- 172.21.15.66:0/2623555616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f348c050130 tx=0x7f348c050300 comp rx=0 tx=0).stop 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- 172.21.15.66:0/2623555616 shutdown_connections 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 --2- 172.21.15.66:0/2623555616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce74ce0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- 172.21.15.66:0/2623555616 >> 172.21.15.66:0/2623555616 conn(0x555f9ce6fd00 msgr2=0x555f9ce6df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- 172.21.15.66:0/2623555616 shutdown_connections 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- 172.21.15.66:0/2623555616 wait complete. 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 Processor -- start 2024-09-12T00:19:14.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- start start 2024-09-12T00:19:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f34956929c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f9ce73830 con 0x555f9ce748e0 2024-09-12T00:19:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:45920/0 (socket says 172.21.15.66:45920) 2024-09-12T00:19:14.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 learned_addr learned my addr 172.21.15.66:0/2700359558 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.061+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9ce7b300 con 0x555f9ce748e0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3493999640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f348c018fd0 tx=0x7f348c050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 -- 172.21.15.66:0/2700359558 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c038070 con 0x555f9ce748e0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9ce7b590 con 0x555f9ce748e0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 -- 172.21.15.66:0/2700359558 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c028300 con 0x555f9ce748e0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 -- 172.21.15.66:0/2700359558 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348c028600 con 0x555f9ce748e0 2024-09-12T00:19:14.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9ce7bf40 con 0x555f9ce748e0 2024-09-12T00:19:14.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 -- 172.21.15.66:0/2700359558 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f348c03b070 con 0x555f9ce748e0 2024-09-12T00:19:14.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f335c039a70 0x7f335c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f33757fa640 1 -- 172.21.15.66:0/2700359558 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6110+0+0 (secure 0 0 0) 0x7f348c034c30 con 0x555f9ce748e0 2024-09-12T00:19:14.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3493198640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f335c039a70 0x7f335c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce863b0 0x555f9ce88840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce88f90 con 0x555f9ce863b0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3492997640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce863b0 0x555f9ce88840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3493198640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f335c039a70 0x7f335c03bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34840b7f70 tx=0x7f34840de000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3492997640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce863b0 0x555f9ce88840 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 realm 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce85760 con 0x555f9ce863b0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce89a90 con 0x555f9ce863b0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.065+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8a360 con 0x555f9ce863b0 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce8ad80 0x555f9ce8d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8d860 con 0x555f9ce8ad80 2024-09-12T00:19:14.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce8ad80 0x555f9ce8d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce8ad80 0x555f9ce8d170 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 20 searching for the correct realm 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f348c03d060 0x7f348c034400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493198640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f348c03d060 0x7f348c034400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493198640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f348c03d060 0x7f348c034400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493198640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34840f9040 0x7f34840aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:14.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3492997640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34840f9040 0x7f34840aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:14.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.069+0000 7f3492997640 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34840f9040 0x7f34840aa5d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.073+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.077+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce8ad80 2024-09-12T00:19:14.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f34840f9040 2024-09-12T00:19:14.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.081+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x555f9ce863b0 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f130 con 0x7f348c03d060 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8e1e0 con 0x555f9ce863b0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8ea30 con 0x555f9ce863b0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f348800f070 con 0x555f9ce863b0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f560 con 0x555f9ce8ad80 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 zone default found 2024-09-12T00:19:14.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 4 Realm: () 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 zonegroup default 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce8f900 con 0x7f34840f9040 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f348800f070 con 0x7f34840f9040 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91b90 con 0x555f9ce8ad80 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91b90 con 0x555f9ce8ad80 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 started sync module instance, tier type = 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:14.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.085+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91090 con 0x7f348c03d060 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869142774960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91fc0 con 0x7f348c03d060 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce92810 con 0x555f9ce863b0 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869142774960] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869142776016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce928d0 con 0x555f9ce863b0 2024-09-12T00:19:14.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.089+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce933f0 con 0x555f9ce8ad80 2024-09-12T00:19:14.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869142776016] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869142781632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce933b0 con 0x555f9ce8ad80 2024-09-12T00:19:14.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce93e00 con 0x7f348c03d060 2024-09-12T00:19:14.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869142784336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce946a0 con 0x7f348c03d060 2024-09-12T00:19:14.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce950a0 con 0x555f9ce863b0 2024-09-12T00:19:14.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.093+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869142781632] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869142784336] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869142786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce94bb0 con 0x555f9ce863b0 2024-09-12T00:19:14.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce95940 con 0x7f34840f9040 2024-09-12T00:19:14.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869142786544] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869142778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce958b0 con 0x7f34840f9040 2024-09-12T00:19:14.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.097+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce96270 con 0x7f34840f9040 2024-09-12T00:19:14.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.101+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869142778720] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.101+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.101+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869142791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce96270 con 0x7f34840f9040 2024-09-12T00:19:14.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.101+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce96c30 con 0x7f34840f9040 2024-09-12T00:19:14.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.101+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869142791648] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869142796640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce96270 con 0x7f34840f9040 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=0 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=1 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=2 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=3 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=4 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=5 2024-09-12T00:19:14.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=6 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869142796640] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 20 add_watcher() i=7 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce9a050 con 0x555f9ce863b0 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869142794128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce974b0 con 0x555f9ce863b0 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869142794128] v31'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.105+0000 7f3349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 5 note: GC not initialized 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f3348fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:14.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 Filter name: none 2024-09-12T00:19:14.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f32c27fc640 20 reqs_thread_entry: start 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebd6e0 con 0x555f9ce863b0 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebd0c0 con 0x7f348c03d060 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 enabling bucket name=myfoo 2024-09-12T00:19:14.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebe150 con 0x7f348c03d060 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 : miss 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cec09b0 con 0x555f9ce8ad80 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(65 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:14.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:14.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:14.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:14.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:14.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 2024-09-12T00:19:14.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.109+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 8.16 8:6e8d5441:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cec8420 con 0x555f9ce8ad80 2024-09-12T00:19:14.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v31'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1, ofs0, ns] 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93869142968608 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cec29c0 con 0x7f34840f9040 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify (1) cookie 93869142791648 notify 133143986194 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f3488029040 con 0x7f34840f9040 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3376ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 93869142791648 notifier 4599 bl.length()=760 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3376ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 info.flags=0x17 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3376ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1 to cache LRU end 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3376ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3376ffd640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3358003eb0 con 0x7f34840f9040 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(67 notify.6 [notify cookie 93869142968608 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify_complete (2) cookie 93869142968608 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f348801b040 con 0x7f34840f9040 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_sources= new_sources= 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential sources added=[] removed=[] 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): orig_dests= new_dests= 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 20 handle_bi_update(): bucket=:myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1]): potential dests added=[] removed=[] 2024-09-12T00:19:14.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cec5800 con 0x555f9ce863b0 2024-09-12T00:19:14.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:14.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93869142968608 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555f9cec5800 con 0x555f9ce863b0 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 93869142786544 notify 133143986197 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f348801b040 con 0x555f9ce863b0 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f33767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 93869142786544 notifier 4599 bl.length()=567 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f33767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f33767fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.113+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(70 notify.4 [notify cookie 93869142968608 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f33767fc640 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f32c8003440 con 0x555f9ce863b0 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 93869142968608 notify 133143986197 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f9cc0b9c0 con 0x555f9ce863b0 2024-09-12T00:19:14.123 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:14.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f3349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:14.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869142794128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebb410 con 0x555f9ce863b0 2024-09-12T00:19:14.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93869142794128] v31'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.117+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869142774960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebb410 con 0x7f348c03d060 2024-09-12T00:19:14.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93869142774960] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f34956929c0 20 remove_watcher() i=0 2024-09-12T00:19:14.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f34956929c0 2 removed watcher, disabling cache 2024-09-12T00:19:14.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869142776016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebb410 con 0x555f9ce863b0 2024-09-12T00:19:14.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93869142776016] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f34956929c0 20 remove_watcher() i=1 2024-09-12T00:19:14.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.121+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869142781632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9cebb410 con 0x555f9ce8ad80 2024-09-12T00:19:14.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f3493999640 1 -- 172.21.15.66:0/2700359558 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93869142781632] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348c03a030 con 0x555f9ce8ad80 2024-09-12T00:19:14.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 20 remove_watcher() i=2 2024-09-12T00:19:14.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869142784336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91960 con 0x7f348c03d060 2024-09-12T00:19:14.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f3493198640 1 -- 172.21.15.66:0/2700359558 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93869142784336] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34840d6050 con 0x7f348c03d060 2024-09-12T00:19:14.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 20 remove_watcher() i=3 2024-09-12T00:19:14.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869142786544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91960 con 0x555f9ce863b0 2024-09-12T00:19:14.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93869142786544] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x555f9ce863b0 2024-09-12T00:19:14.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 20 remove_watcher() i=4 2024-09-12T00:19:14.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.125+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869142778720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91960 con 0x7f34840f9040 2024-09-12T00:19:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.129+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93869142778720] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.129+0000 7f34956929c0 20 remove_watcher() i=5 2024-09-12T00:19:14.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.129+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869142791648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91960 con 0x7f34840f9040 2024-09-12T00:19:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93869142791648] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 20 remove_watcher() i=6 2024-09-12T00:19:14.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869142796640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555f9ce91960 con 0x7f34840f9040 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93869142796640] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f348803c040 con 0x7f34840f9040 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 20 remove_watcher() i=7 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34840f9040 msgr2=0x7f34840aa5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f34840f9040 0x7f34840aa5d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce863b0 msgr2=0x555f9ce88840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce863b0 0x555f9ce88840 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f348c03d060 msgr2=0x7f348c034400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f348c03d060 0x7f348c034400 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce8ad80 msgr2=0x555f9ce8d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce8ad80 0x555f9ce8d170 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f335c039a70 msgr2=0x7f335c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f335c039a70 0x7f335c03bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34840b7f70 tx=0x7f34840de000 comp rx=0 tx=0).stop 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 msgr2=0x555f9ce7ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f348c018fd0 tx=0x7f348c050090 comp rx=0 tx=0).stop 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f3492997640 1 -- 172.21.15.66:0/2700359558 reap_dead start 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 shutdown_connections 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2700359558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce748e0 0x555f9ce7ada0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 >> 172.21.15.66:0/2700359558 conn(0x555f9ce6fd00 msgr2=0x555f9ce6df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 shutdown_connections 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2700359558 wait complete. 2024-09-12T00:19:14.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 msgr2=0x7f336c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 0x7f336c03bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34840bf750 tx=0x7f3484009fd0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 msgr2=0x555f9ce673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x555f9ce4d150 tx=0x7f348c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 shutdown_connections 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f336c039a70 0x7f336c03bf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/2765089794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9ce66f90 0x555f9ce673b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 >> 172.21.15.66:0/2765089794 conn(0x555f9ce5c940 msgr2=0x555f9ce5cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 shutdown_connections 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/2765089794 wait complete. 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 msgr2=0x555f9ce53670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 0x555f9ce53670 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 msgr2=0x555f9ce58190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.133+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 0x555f9ce58190 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 msgr2=0x7f337803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 0x7f337803bf30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3488001650 tx=0x7f3488006720 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 msgr2=0x555f9ce4c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f34840ae040 tx=0x7f3484018020 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 shutdown_connections 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555f9ce55da0 0x555f9ce58190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555f9ce51280 0x555f9ce53670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3378039a70 0x7f337803bf30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 --2- 172.21.15.66:0/3369897778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f9cd5c8b0 0x555f9ce4c210 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 >> 172.21.15.66:0/3369897778 conn(0x555f9cccd080 msgr2=0x555f9ce3f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 shutdown_connections 2024-09-12T00:19:14.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:14.137+0000 7f34956929c0 1 -- 172.21.15.66:0/3369897778 wait complete. 2024-09-12T00:19:14.152 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:14.168 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T00:19:14.517 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-12T00:19:14.533 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:29.534 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T00:19:29.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T00:19:29.535 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T00:19:29.575 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:29.575 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:29.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f5bed9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557743207370 0x557743207750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f5bed9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577430bc9c0 con 0x55774320a550 2024-09-12T00:19:29.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f5bed9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55774310c6d0 con 0x557743207370 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f36f3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557743207370 0x557743207750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f36f3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557743207370 0x557743207750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33352/0 (socket says 172.21.15.66:33352) 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f36f3640 1 -- 172.21.15.66:0/2046815319 learned_addr learned my addr 172.21.15.66:0/2046815319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f2ef2640 1 --1- 172.21.15.66:0/2046815319 >> v1:172.21.15.31:6789/0 conn(0x55774320a550 0x55774320c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38292/0 (socket says 172.21.15.66:38292) 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f36f3640 1 -- 172.21.15.66:0/2046815319 >> v1:172.21.15.31:6789/0 conn(0x55774320a550 legacy=0x55774320c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.573+0000 7f96f36f3640 1 -- 172.21.15.66:0/2046815319 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577430b0ca0 con 0x557743207370 2024-09-12T00:19:29.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f36f3640 1 --2- 172.21.15.66:0/2046815319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x557743207750 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96e400a5c0 tx=0x7f96e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3bb290f3a535f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f26f1640 1 -- 172.21.15.66:0/2046815319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40a6070 con 0x557743207370 2024-09-12T00:19:29.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f26f1640 1 -- 172.21.15.66:0/2046815319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e40af070 con 0x557743207370 2024-09-12T00:19:29.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f26f1640 1 -- 172.21.15.66:0/2046815319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40aa5c0 con 0x557743207370 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2046815319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 msgr2=0x557743207750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2046815319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x557743207750 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96e400a5c0 tx=0x7f96e401b340 comp rx=0 tx=0).stop 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2046815319 shutdown_connections 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2046815319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x557743207750 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2046815319 >> 172.21.15.66:0/2046815319 conn(0x557743202e90 msgr2=0x5577432052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2046815319 shutdown_connections 2024-09-12T00:19:29.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.577+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2046815319 wait complete. 2024-09-12T00:19:29.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.593+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.593+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.593+0000 7f96f5bed9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.593+0000 7f96f5bed9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557743110680 con 0x557743207370 2024-09-12T00:19:29.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33364/0 (socket says 172.21.15.66:33364) 2024-09-12T00:19:29.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 -- 172.21.15.66:0/542550756 learned_addr learned my addr 172.21.15.66:0/542550756 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 -- 172.21.15.66:0/542550756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774308bda0 con 0x557743207370 2024-09-12T00:19:29.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 --2- 172.21.15.66:0/542550756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f96e4018f70 tx=0x7f96e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819b693e7dc9b80e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f95e160a640 1 -- 172.21.15.66:0/542550756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40bf070 con 0x557743207370 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f95e160a640 1 -- 172.21.15.66:0/542550756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e40aa910 con 0x557743207370 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f95e160a640 1 -- 172.21.15.66:0/542550756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40aabf0 con 0x557743207370 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/542550756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 msgr2=0x5577432f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/542550756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f96e4018f70 tx=0x7f96e4003030 comp rx=0 tx=0).stop 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/542550756 shutdown_connections 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/542550756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f26c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/542550756 >> 172.21.15.66:0/542550756 conn(0x557743202e90 msgr2=0x5577432ee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/542550756 shutdown_connections 2024-09-12T00:19:29.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/542550756 wait complete. 2024-09-12T00:19:29.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f5bed9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5577430b2a50 con 0x557743207370 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33370/0 (socket says 172.21.15.66:33370) 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.597+0000 7f96f36f3640 1 -- 172.21.15.66:0/3280759934 learned_addr learned my addr 172.21.15.66:0/3280759934 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f36f3640 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577432f90b0 con 0x557743207370 2024-09-12T00:19:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f36f3640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f96e4018f70 tx=0x7f96e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 -- 172.21.15.66:0/3280759934 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40bf040 con 0x557743207370 2024-09-12T00:19:29.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577432f9340 con 0x557743207370 2024-09-12T00:19:29.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 -- 172.21.15.66:0/3280759934 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e40c5830 con 0x557743207370 2024-09-12T00:19:29.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 -- 172.21.15.66:0/3280759934 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e40c5b50 con 0x557743207370 2024-09-12T00:19:29.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577432f9cf0 con 0x557743207370 2024-09-12T00:19:29.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 -- 172.21.15.66:0/3280759934 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f96e40c2070 con 0x557743207370 2024-09-12T00:19:29.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 0x7f95d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f95dfe07640 1 -- 172.21.15.66:0/3280759934 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f96e40ee550 con 0x557743207370 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 0x7f95d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 0x5577432ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743300200 con 0x55774320a550 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 0x5577432ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 0x7f95d803bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96e80016b0 tx=0x7f96e80066c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 0x5577432ffcc0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f3ef4640 1 -- 172.21.15.66:0/3280759934 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96ec0083f0 con 0x55774320a550 2024-09-12T00:19:29.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.601+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5577433005e0 con 0x55774320a550 2024-09-12T00:19:29.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 -- 172.21.15.66:0/3280759934 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96ec0083f0 con 0x55774320a550 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 0x5577433047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743304eb0 con 0x5577433023f0 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f36f3640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 0x5577433047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f36f3640 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 0x5577433047e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f36f3640 1 -- 172.21.15.66:0/3280759934 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f96e40cd070 con 0x5577433023f0 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743301260 con 0x55774320a550 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 -- 172.21.15.66:0/3280759934 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96ec0083f0 con 0x55774320a550 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743301740 con 0x5577433023f0 2024-09-12T00:19:29.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f36f3640 1 -- 172.21.15.66:0/3280759934 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f96e40cd070 con 0x5577433023f0 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f5bed9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55774311d450 con 0x5577433135c0 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33380/0 (socket says 172.21.15.66:33380) 2024-09-12T00:19:29.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 -- 172.21.15.66:0/2839055535 learned_addr learned my addr 172.21.15.66:0/2839055535 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.605+0000 7f96f3ef4640 1 -- 172.21.15.66:0/2839055535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557743314020 con 0x5577433135c0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x5577432f9b80 tx=0x7f96ec00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 -- 172.21.15.66:0/2839055535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec01c020 con 0x5577433135c0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 -- 172.21.15.66:0/2839055535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec007d00 con 0x5577433135c0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557743314880 con 0x5577433135c0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 -- 172.21.15.66:0/2839055535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec018440 con 0x5577433135c0 2024-09-12T00:19:29.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557743314df0 con 0x5577433135c0 2024-09-12T00:19:29.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 -- 172.21.15.66:0/2839055535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f96ec01f020 con 0x5577433135c0 2024-09-12T00:19:29.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 0x7f95cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f95dd602640 1 -- 172.21.15.66:0/2839055535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f96ec051de0 con 0x5577433135c0 2024-09-12T00:19:29.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f36f3640 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 0x7f95cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f36f3640 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 0x7f95cc03bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96e40c6fd0 tx=0x7f96e40ee040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f5bed9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5577432f2eb0 con 0x557743320e90 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33390/0 (socket says 172.21.15.66:33390) 2024-09-12T00:19:29.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.609+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1973940350 learned_addr learned my addr 172.21.15.66:0/1973940350 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1973940350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557743321880 con 0x557743320e90 2024-09-12T00:19:29.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/1973940350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96ec050130 tx=0x7f96ec043050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd2a1fcfbc8b305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d6ffd640 1 -- 172.21.15.66:0/1973940350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec021400 con 0x557743320e90 2024-09-12T00:19:29.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d6ffd640 1 -- 172.21.15.66:0/1973940350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec018b50 con 0x557743320e90 2024-09-12T00:19:29.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d6ffd640 1 -- 172.21.15.66:0/1973940350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec0215a0 con 0x557743320e90 2024-09-12T00:19:29.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1973940350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 msgr2=0x557743321290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1973940350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f96ec050130 tx=0x7f96ec043050 comp rx=0 tx=0).stop 2024-09-12T00:19:29.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1973940350 shutdown_connections 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1973940350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743321290 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1973940350 >> 172.21.15.66:0/1973940350 conn(0x55774331c2b0 msgr2=0x55774331a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1973940350 shutdown_connections 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1973940350 wait complete. 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 Processor -- start 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- start start 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743327330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55774331fde0 con 0x557743320e90 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743327330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743327330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33398/0 (socket says 172.21.15.66:33398) 2024-09-12T00:19:29.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 learned_addr learned my addr 172.21.15.66:0/1287359413 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557743327890 con 0x557743320e90 2024-09-12T00:19:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743327330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96ec04efd0 tx=0x7f96ec050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d57fa640 1 -- 172.21.15.66:0/1287359413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec029c70 con 0x557743320e90 2024-09-12T00:19:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557743327b20 con 0x557743320e90 2024-09-12T00:19:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d57fa640 1 -- 172.21.15.66:0/1287359413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec029e10 con 0x557743320e90 2024-09-12T00:19:29.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f95d57fa640 1 -- 172.21.15.66:0/1287359413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec020a30 con 0x557743320e90 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.613+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577433284d0 con 0x557743320e90 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f95d57fa640 1 -- 172.21.15.66:0/1287359413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f96ec016040 con 0x557743320e90 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f95d57fa640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95bc039a70 0x7f95bc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f95d57fa640 1 -- 172.21.15.66:0/1287359413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f96ec031070 con 0x557743320e90 2024-09-12T00:19:29.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f36f3640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95bc039a70 0x7f95bc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5577433328a0 0x557743334d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743335480 con 0x5577433328a0 2024-09-12T00:19:29.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5577433328a0 0x557743334d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f36f3640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95bc039a70 0x7f95bc03bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96e40ecb10 tx=0x7f96e40e2050 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5577433328a0 0x557743334d30 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 realm 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743331c50 con 0x5577433328a0 2024-09-12T00:19:29.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743335f80 con 0x5577433328a0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743336850 con 0x5577433328a0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557743337100 0x5577433394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743339c30 con 0x557743337100 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.617+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557743337100 0x5577433394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557743337100 0x5577433394f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f5bed9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f5bed9c0 20 searching for the correct realm 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x557743337100 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f3ef4640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f96ec021020 0x7f96ec02a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96ec021020 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f36f3640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f96ec021020 0x7f96ec02a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f36f3640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f96ec021020 0x7f96ec02a3e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f36f3640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f96e40fc040 0x7f96e40da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96e40fc040 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f96e40fc040 0x7f96e40da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f96e40fc040 0x7f96e40da9e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x5577433328a0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.621+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x5577433328a0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x5577433328a0 2024-09-12T00:19:29.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96e40fc040 2024-09-12T00:19:29.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96ec021020 2024-09-12T00:19:29.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x557743337100 2024-09-12T00:19:29.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x5577433328a0 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96ec021020 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x5577433328a0 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96ec021020 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x557743337100 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x557743337100 2024-09-12T00:19:29.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.625+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55774333b550 con 0x7f96e40fc040 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x557743337100 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x557743337100 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x5577433328a0 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x5577433328a0 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96e40fc040 2024-09-12T00:19:29.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x557743337100 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96ec021020 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x5577433328a0 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.629+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96e40fc040 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x557743337100 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96e40fc040 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96ec021020 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x557743337100 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96e40fc040 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x5577433328a0 2024-09-12T00:19:29.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f96e802e040 con 0x7f96ec021020 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.633+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333a670 con 0x5577433328a0 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333af10 con 0x5577433328a0 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333a2b0 con 0x557743337100 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 zone default found 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 4 Realm: () 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:29.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 zonegroup default 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333ab40 con 0x7f96e40fc040 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333d9f0 con 0x557743337100 2024-09-12T00:19:29.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774333de10 con 0x557743337100 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 started sync module instance, tier type = 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:29.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333cd90 con 0x7f96ec021020 2024-09-12T00:19:29.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.637+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93970716936416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333e250 con 0x7f96ec021020 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333eaa0 con 0x5577433328a0 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93970716936416] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93970716943856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333eec0 con 0x5577433328a0 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.641+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333f710 con 0x557743337100 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93970716943856] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93970716945184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333f530 con 0x557743337100 2024-09-12T00:19:29.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743340120 con 0x7f96ec021020 2024-09-12T00:19:29.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93970716949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743340970 con 0x7f96ec021020 2024-09-12T00:19:29.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.645+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743341330 con 0x5577433328a0 2024-09-12T00:19:29.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93970716945184] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93970716946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743341330 con 0x5577433328a0 2024-09-12T00:19:29.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743341d50 con 0x7f96e40fc040 2024-09-12T00:19:29.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93970716949616] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93970716946304] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93970716956736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743340e80 con 0x7f96e40fc040 2024-09-12T00:19:29.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.649+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5577433425f0 con 0x7f96e40fc040 2024-09-12T00:19:29.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.653+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.653+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93970716958592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743342850 con 0x7f96e40fc040 2024-09-12T00:19:29.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.653+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5577433430a0 con 0x7f96e40fc040 2024-09-12T00:19:29.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.653+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93970716956736] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93970716960848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743343120 con 0x7f96e40fc040 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93970716958592] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=0 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=1 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=2 2024-09-12T00:19:29.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=3 2024-09-12T00:19:29.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=4 2024-09-12T00:19:29.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=5 2024-09-12T00:19:29.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=6 2024-09-12T00:19:29.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93970716960848] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 20 add_watcher() i=7 2024-09-12T00:19:29.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:29.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557743346150 con 0x5577433328a0 2024-09-12T00:19:29.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.657+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93970716961904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743343540 con 0x5577433328a0 2024-09-12T00:19:29.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93970716961904] v33'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f95a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:29.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f5bed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:29.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f5bed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:29.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e8c0 con 0x5577433328a0 2024-09-12T00:19:29.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.661+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334ed70 con 0x7f96e40fc040 2024-09-12T00:19:29.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.665+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.665+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334ef40 con 0x557743337100 2024-09-12T00:19:29.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.665+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.665+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334efd0 con 0x5577433328a0 2024-09-12T00:19:29.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334efd0 con 0x7f96ec021020 2024-09-12T00:19:29.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'51 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334f560 con 0x557743337100 2024-09-12T00:19:29.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.669+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334f9a0 con 0x5577433328a0 2024-09-12T00:19:29.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.673+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.673+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334f6a0 con 0x7f96e40fc040 2024-09-12T00:19:29.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96ec021020 2024-09-12T00:19:29.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.677+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96ec021020 2024-09-12T00:19:29.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.681+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'52 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.681+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96e40fc040 2024-09-12T00:19:29.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.681+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'22 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.681+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96ec021020 2024-09-12T00:19:29.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.685+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.685+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96e40fc040 2024-09-12T00:19:29.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.685+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.685+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x5577433328a0 2024-09-12T00:19:29.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'160 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96ec021020 2024-09-12T00:19:29.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'53 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.689+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.693+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.693+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x5577433328a0 2024-09-12T00:19:29.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.693+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.693+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x5577433328a0 2024-09-12T00:19:29.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.697+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'161 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.697+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.697+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.697+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x7f96ec021020 2024-09-12T00:19:29.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.701+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.705+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.705+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334df30 con 0x557743337100 2024-09-12T00:19:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.705+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.705+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334dfe0 con 0x7f96e40fc040 2024-09-12T00:19:29.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.709+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.709+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e1b0 con 0x557743337100 2024-09-12T00:19:29.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.709+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.709+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e1b0 con 0x7f96e40fc040 2024-09-12T00:19:29.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.713+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.713+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e1b0 con 0x557743337100 2024-09-12T00:19:29.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.713+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.713+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e1b0 con 0x7f96e40fc040 2024-09-12T00:19:29.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.717+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.717+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774334e1b0 con 0x7f96ec021020 2024-09-12T00:19:29.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f95a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 20 Filter name: none 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f95227fc640 20 reqs_thread_entry: start 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x5577433328a0 2024-09-12T00:19:29.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96e40fc040 2024-09-12T00:19:29.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.721+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x557743337100 2024-09-12T00:19:29.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x5577433328a0 2024-09-12T00:19:29.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.725+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x557743337100 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x5577433328a0 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x5577433328a0 2024-09-12T00:19:29.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.729+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96e40fc040 2024-09-12T00:19:29.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96ec021020 2024-09-12T00:19:29.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.733+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x557743337100 2024-09-12T00:19:29.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x557743337100 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96ec021020 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96ec021020 2024-09-12T00:19:29.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336a500 con 0x7f96e40fc040 2024-09-12T00:19:29.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.737+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b510 con 0x7f96e40fc040 2024-09-12T00:19:29.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(129 gc.11 [call out=1701b] v0'0 uv20 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96ec021020 2024-09-12T00:19:29.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96e40fc040 2024-09-12T00:19:29.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.741+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x5577433328a0 2024-09-12T00:19:29.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96ec021020 2024-09-12T00:19:29.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.745+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x5577433328a0 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x5577433328a0 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x5577433328a0 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.749+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96ec021020 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.753+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96e40fc040 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.757+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv19 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv19 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96e40fc040 2024-09-12T00:19:29.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.761+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x557743337100 2024-09-12T00:19:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x557743337100 2024-09-12T00:19:29.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96e40fc040 2024-09-12T00:19:29.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96e40fc040 2024-09-12T00:19:29.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.765+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336b2d0 con 0x7f96ec021020 2024-09-12T00:19:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55774336c2e0 con 0x7f96ec021020 2024-09-12T00:19:29.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f95a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:29.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93970716961904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5577432e9820 con 0x5577433328a0 2024-09-12T00:19:29.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93970716961904] v33'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.769+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93970716936416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5577432e9820 con 0x7f96ec021020 2024-09-12T00:19:29.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93970716936416] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f5bed9c0 20 remove_watcher() i=0 2024-09-12T00:19:29.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f5bed9c0 2 removed watcher, disabling cache 2024-09-12T00:19:29.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93970716943856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333c8e0 con 0x5577433328a0 2024-09-12T00:19:29.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93970716943856] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f5bed9c0 20 remove_watcher() i=1 2024-09-12T00:19:29.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.773+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93970716945184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333c8e0 con 0x557743337100 2024-09-12T00:19:29.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f3ef4640 1 -- 172.21.15.66:0/1287359413 <== osd.3 v2:172.21.15.66:6816/2782209626 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93970716945184] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96ec03b020 con 0x557743337100 2024-09-12T00:19:29.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f5bed9c0 20 remove_watcher() i=2 2024-09-12T00:19:29.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93970716949616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333eb20 con 0x7f96ec021020 2024-09-12T00:19:29.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f36f3640 1 -- 172.21.15.66:0/1287359413 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93970716949616] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e40ea070 con 0x7f96ec021020 2024-09-12T00:19:29.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f5bed9c0 20 remove_watcher() i=3 2024-09-12T00:19:29.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.777+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93970716946304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333c8e0 con 0x5577433328a0 2024-09-12T00:19:29.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93970716946304] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x5577433328a0 2024-09-12T00:19:29.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f5bed9c0 20 remove_watcher() i=4 2024-09-12T00:19:29.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93970716956736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333c8e0 con 0x7f96e40fc040 2024-09-12T00:19:29.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93970716956736] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f5bed9c0 20 remove_watcher() i=5 2024-09-12T00:19:29.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.781+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93970716958592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557743341840 con 0x7f96e40fc040 2024-09-12T00:19:29.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.785+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93970716958592] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.785+0000 7f96f5bed9c0 20 remove_watcher() i=6 2024-09-12T00:19:29.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.785+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93970716960848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55774333c8e0 con 0x7f96e40fc040 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93970716960848] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96e800f070 con 0x7f96e40fc040 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 20 remove_watcher() i=7 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f96e40fc040 msgr2=0x7f96e40da9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f96e40fc040 0x7f96e40da9e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5577433328a0 msgr2=0x557743334d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5577433328a0 0x557743334d30 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f96ec021020 msgr2=0x7f96ec02a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f96ec021020 0x7f96ec02a3e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557743337100 msgr2=0x5577433394f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557743337100 0x5577433394f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95bc039a70 msgr2=0x7f95bc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95bc039a70 0x7f95bc03bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96e40ecb10 tx=0x7f96e40e2050 comp rx=0 tx=0).stop 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 msgr2=0x557743327330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/1287359413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743320e90 0x557743327330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f96ec04efd0 tx=0x7f96ec050090 comp rx=0 tx=0).stop 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f2ef2640 1 -- 172.21.15.66:0/1287359413 reap_dead start 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 shutdown_connections 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 >> 172.21.15.66:0/1287359413 conn(0x55774331c2b0 msgr2=0x55774331a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 shutdown_connections 2024-09-12T00:19:29.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/1287359413 wait complete. 2024-09-12T00:19:29.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 msgr2=0x7f95cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 0x7f95cc03bf30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96e40c6fd0 tx=0x7f96e40ee040 comp rx=0 tx=0).stop 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 msgr2=0x5577433139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x5577432f9b80 tx=0x7f96ec00bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 shutdown_connections 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95cc039a70 0x7f95cc03bf30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/2839055535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5577433135c0 0x5577433139e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 >> 172.21.15.66:0/2839055535 conn(0x557743308f70 msgr2=0x557743309350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 shutdown_connections 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/2839055535 wait complete. 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 msgr2=0x5577432ffcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 0x5577432ffcc0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 msgr2=0x5577433047e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 0x5577433047e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 msgr2=0x7f95d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 0x7f95d803bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96e80016b0 tx=0x7f96e80066c0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 msgr2=0x5577432f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f96e4018f70 tx=0x7f96e40180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 shutdown_connections 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5577433023f0 0x5577433047e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55774320a550 0x5577432ffcc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f95d8039a70 0x7f95d803bf30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 --2- 172.21.15.66:0/3280759934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557743207370 0x5577432f8b50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 >> 172.21.15.66:0/3280759934 conn(0x557743202e90 msgr2=0x5577432ecdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 shutdown_connections 2024-09-12T00:19:29.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.789+0000 7f96f5bed9c0 1 -- 172.21.15.66:0/3280759934 wait complete. 2024-09-12T00:19:29.806 INFO:teuthology.orchestra.run.smithi066.stdout:[{"tag":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.8649460836549752042\u0000","time":"2024-09-12T00:19:29.533548+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_7","key":"","instance":""}]}] 2024-09-12T00:19:29.807 DEBUG:tasks.util.rgw: json result: [{'tag': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.8649460836549752042\x00', 'time': '2024-09-12T00:19:29.533548+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_7', 'key': '', 'instance': ''}]}] 2024-09-12T00:19:29.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-12T00:19:29.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-12T00:19:29.807 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-12T00:19:29.884 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:29.884 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:29.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f97489c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfa00934f0 0x55cfa00938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f97489c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf9ffd09c0 con 0x55cfa0096630 2024-09-12T00:19:29.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f97489c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55cfa00206d0 con 0x55cfa00934f0 2024-09-12T00:19:29.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f724e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfa00934f0 0x55cfa00938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f724e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfa00934f0 0x55cfa00938d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33400/0 (socket says 172.21.15.66:33400) 2024-09-12T00:19:29.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f724e640 1 -- 172.21.15.66:0/2531277830 learned_addr learned my addr 172.21.15.66:0/2531277830 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f6a4d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55cfa0096630 0x55cfa0096a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38298/0 (socket says 172.21.15.66:38298) 2024-09-12T00:19:29.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f724e640 1 -- 172.21.15.66:0/2531277830 >> v1:172.21.15.31:6789/0 conn(0x55cfa0096630 legacy=0x55cfa0096a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.881+0000 7fe3f724e640 1 -- 172.21.15.66:0/2531277830 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf9ffc4ca0 con 0x55cfa00934f0 2024-09-12T00:19:29.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f724e640 1 --2- 172.21.15.66:0/2531277830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa00938d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a4e0 tx=0x7fe3e801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d424f95441234c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f624c640 1 -- 172.21.15.66:0/2531277830 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80aa540 con 0x55cfa00934f0 2024-09-12T00:19:29.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f624c640 1 -- 172.21.15.66:0/2531277830 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80aa6e0 con 0x55cfa00934f0 2024-09-12T00:19:29.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f624c640 1 -- 172.21.15.66:0/2531277830 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80aaa40 con 0x55cfa00934f0 2024-09-12T00:19:29.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2531277830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 msgr2=0x55cfa00938d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/2531277830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa00938d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800a4e0 tx=0x7fe3e801b090 comp rx=0 tx=0).stop 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2531277830 shutdown_connections 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/2531277830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa00938d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2531277830 >> 172.21.15.66:0/2531277830 conn(0x55cfa0092060 msgr2=0x55cfa0092470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2531277830 shutdown_connections 2024-09-12T00:19:29.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.885+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2531277830 wait complete. 2024-09-12T00:19:29.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.901+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.901+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.901+0000 7fe3f97489c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.901+0000 7fe3f97489c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfa0024680 con 0x55cfa00934f0 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33406/0 (socket says 172.21.15.66:33406) 2024-09-12T00:19:29.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 -- 172.21.15.66:0/1894939272 learned_addr learned my addr 172.21.15.66:0/1894939272 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 -- 172.21.15.66:0/1894939272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf9ff9fda0 con 0x55cfa00934f0 2024-09-12T00:19:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1894939272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80ac040 tx=0x7fe3e80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc5dc2830daccc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe2e560a640 1 -- 172.21.15.66:0/1894939272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80b9030 con 0x55cfa00934f0 2024-09-12T00:19:29.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe2e560a640 1 -- 172.21.15.66:0/1894939272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80aaa40 con 0x55cfa00934f0 2024-09-12T00:19:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe2e560a640 1 -- 172.21.15.66:0/1894939272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80aad20 con 0x55cfa00934f0 2024-09-12T00:19:29.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1894939272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 msgr2=0x55cfa020e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1894939272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80ac040 tx=0x7fe3e80033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1894939272 shutdown_connections 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1894939272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa020e3f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1894939272 >> 172.21.15.66:0/1894939272 conn(0x55cfa0092060 msgr2=0x55cfa020a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1894939272 shutdown_connections 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1894939272 wait complete. 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f97489c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cf9ffc6a50 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33412/0 (socket says 172.21.15.66:33412) 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.905+0000 7fe3f724e640 1 -- 172.21.15.66:0/3888370663 learned_addr learned my addr 172.21.15.66:0/3888370663 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f724e640 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa0215e80 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f724e640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8003430 tx=0x7fe3e8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 -- 172.21.15.66:0/3888370663 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80b9070 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa0216110 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 -- 172.21.15.66:0/3888370663 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e80c2070 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 -- 172.21.15.66:0/3888370663 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e80cb060 con 0x55cfa00934f0 2024-09-12T00:19:29.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa0216ac0 con 0x55cfa00934f0 2024-09-12T00:19:29.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 -- 172.21.15.66:0/3888370663 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3e80b3040 con 0x55cfa00934f0 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 0x7fe2dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe2e3e07640 1 -- 172.21.15.66:0/3888370663 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe3e80ba070 con 0x55cfa00934f0 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 0x7fe2dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 0x55cfa021ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa021cfd0 con 0x55cfa0096630 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 0x55cfa021ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 0x7fe2dc03bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec001e40 tx=0x7fe3ec0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 0x55cfa021ca90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/3888370663 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3f00083f0 con 0x55cfa0096630 2024-09-12T00:19:29.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.909+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0216e00 con 0x55cfa0096630 2024-09-12T00:19:29.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/3888370663 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3f00083f0 con 0x55cfa0096630 2024-09-12T00:19:29.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 0x55cfa0221630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0221d20 con 0x55cfa021f240 2024-09-12T00:19:29.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f724e640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 0x55cfa0221630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f724e640 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 0x55cfa0221630 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f724e640 1 -- 172.21.15.66:0/3888370663 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3e80be400 con 0x55cfa021f240 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa021e0e0 con 0x55cfa0096630 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/3888370663 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3f00083f0 con 0x55cfa0096630 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa021e5c0 con 0x55cfa021f240 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f724e640 1 -- 172.21.15.66:0/3888370663 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe3e80be400 con 0x55cfa021f240 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f97489c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfa0031450 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33428/0 (socket says 172.21.15.66:33428) 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/635118587 learned_addr learned my addr 172.21.15.66:0/635118587 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/635118587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa0230ef0 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.913+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55cfa0216cb0 tx=0x7fe3f000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 -- 172.21.15.66:0/635118587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f001c020 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa0231750 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 -- 172.21.15.66:0/635118587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0007d20 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 -- 172.21.15.66:0/635118587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f0018440 con 0x55cfa0230490 2024-09-12T00:19:29.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa0231cc0 con 0x55cfa0230490 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 -- 172.21.15.66:0/635118587 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3f001f020 con 0x55cfa0230490 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 0x7fe2d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe2e1602640 1 -- 172.21.15.66:0/635118587 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe3f0051d70 con 0x55cfa0230490 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f724e640 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 0x7fe2d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f724e640 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 0x7fe2d003bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55cfa021d410 tx=0x7fe3e80c6e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f97489c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfa020eb60 con 0x55cfa023cdd0 2024-09-12T00:19:29.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33440/0 (socket says 172.21.15.66:33440) 2024-09-12T00:19:29.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/2637344887 learned_addr learned my addr 172.21.15.66:0/2637344887 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/2637344887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa023d780 con 0x55cfa023cdd0 2024-09-12T00:19:29.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.917+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/2637344887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00500c0 tx=0x7fe3f0016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898520dee052c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2daffd640 1 -- 172.21.15.66:0/2637344887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f0021400 con 0x55cfa023cdd0 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2daffd640 1 -- 172.21.15.66:0/2637344887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0018b50 con 0x55cfa023cdd0 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2daffd640 1 -- 172.21.15.66:0/2637344887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f00215a0 con 0x55cfa023cdd0 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2637344887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 msgr2=0x55cfa023d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/2637344887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00500c0 tx=0x7fe3f0016970 comp rx=0 tx=0).stop 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2637344887 shutdown_connections 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/2637344887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa023d1b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2637344887 >> 172.21.15.66:0/2637344887 conn(0x55cfa0239200 msgr2=0x55cfa0237440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2637344887 shutdown_connections 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/2637344887 wait complete. 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 Processor -- start 2024-09-12T00:19:29.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- start start 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa0244260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfa023dde0 con 0x55cfa023cdd0 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa0244260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f7a4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa0244260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33446/0 (socket says 172.21.15.66:33446) 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 learned_addr learned my addr 172.21.15.66:0/1199565136 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:29.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa02447c0 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa0244260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0018fd0 tx=0x7fe3f0050020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2d97fa640 1 -- 172.21.15.66:0/1199565136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f0029c70 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa0244a50 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2d97fa640 1 -- 172.21.15.66:0/1199565136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0029e10 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe2d97fa640 1 -- 172.21.15.66:0/1199565136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3f00296e0 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.921+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa0245400 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe2d97fa640 1 -- 172.21.15.66:0/1199565136 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3f0016040 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe2d97fa640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2c0039a20 0x7fe2c003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe2d97fa640 1 -- 172.21.15.66:0/1199565136 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe3f0033070 con 0x55cfa023cdd0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2c0039a20 0x7fe2c003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa024f7f0 0x55cfa0251cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0252400 con 0x55cfa024f7f0 2024-09-12T00:19:29.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa024f7f0 0x55cfa0251cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2c0039a20 0x7fe2c003bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80b46e0 tx=0x7fe3e80da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa024f7f0 0x55cfa0251cb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3ec00f620 con 0x55cfa024f7f0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 realm 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa024eb90 con 0x55cfa024f7f0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3ec00f620 con 0x55cfa024f7f0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0252f00 con 0x55cfa024f7f0 2024-09-12T00:19:29.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3ec00f620 con 0x55cfa024f7f0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02537d0 con 0x55cfa024f7f0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3ec00f620 con 0x55cfa024f7f0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa02541f0 0x55cfa02565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0256d20 con 0x55cfa02541f0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa02541f0 0x55cfa02565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa02541f0 0x55cfa02565e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:29.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 20 searching for the correct realm 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe3f0021020 0x7fe3f0020a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.925+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe3f0021020 0x7fe3f0020a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe3f0021020 0x7fe3f0020a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f724e640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe3e80f4040 0x7fe3e80b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe3e80f4040 0x7fe3e80b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe3e80f4040 0x7fe3e80b48e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec00f620 con 0x7fe3e80f4040 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec00f620 con 0x55cfa024f7f0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.929+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.933+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.937+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa02541f0 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3e80f4040 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3ec02b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x55cfa024f7f0 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02585f0 con 0x7fe3f0021020 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:29.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0257770 con 0x55cfa024f7f0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0258010 con 0x55cfa024f7f0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0258990 con 0x55cfa02541f0 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 zone default found 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 4 Realm: () 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 zonegroup default 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0258d70 con 0x7fe3e80f4040 2024-09-12T00:19:29.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.941+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025b050 con 0x55cfa02541f0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025b3f0 con 0x55cfa02541f0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 20 started sync module instance, tier type = 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025a490 con 0x7fe3f0021020 2024-09-12T00:19:29.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350233411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025b850 con 0x7fe3f0021020 2024-09-12T00:19:29.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025c0a0 con 0x55cfa024f7f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.945+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350233411552] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350233413808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025c180 con 0x55cfa024f7f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025cca0 con 0x55cfa02541f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350233413808] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350233421680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025cc60 con 0x55cfa02541f0 2024-09-12T00:19:29.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.949+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025d6b0 con 0x7fe3f0021020 2024-09-12T00:19:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350233424384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025df00 con 0x7fe3f0021020 2024-09-12T00:19:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025e900 con 0x55cfa024f7f0 2024-09-12T00:19:29.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350233421680] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350233424384] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350233418736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025da50 con 0x55cfa024f7f0 2024-09-12T00:19:29.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.953+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025f1a0 con 0x7fe3e80f4040 2024-09-12T00:19:29.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350233418736] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350233429008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025da50 con 0x7fe3e80f4040 2024-09-12T00:19:29.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025f670 con 0x7fe3e80f4040 2024-09-12T00:19:29.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350233429008] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350233432384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025f630 con 0x7fe3e80f4040 2024-09-12T00:19:29.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.957+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0260050 con 0x7fe3e80f4040 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350233432384] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350233434944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0260010 con 0x7fe3e80f4040 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=0 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=1 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=2 2024-09-12T00:19:29.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=3 2024-09-12T00:19:29.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=4 2024-09-12T00:19:29.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=5 2024-09-12T00:19:29.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=6 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350233434944] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 20 add_watcher() i=7 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02634a0 con 0x55cfa024f7f0 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.961+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350233430816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02609c0 con 0x55cfa024f7f0 2024-09-12T00:19:29.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350233430816] v33'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe2adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:29.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f97489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:29.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f97489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:29.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026bd30 con 0x55cfa024f7f0 2024-09-12T00:19:29.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.965+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026c3e0 con 0x7fe3e80f4040 2024-09-12T00:19:29.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.969+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.969+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026c820 con 0x55cfa02541f0 2024-09-12T00:19:29.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.969+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.969+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026cc80 con 0x55cfa024f7f0 2024-09-12T00:19:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.969+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'164 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.973+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026cba0 con 0x7fe3f0021020 2024-09-12T00:19:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.973+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'54 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.973+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d190 con 0x55cfa02541f0 2024-09-12T00:19:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.973+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.973+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d190 con 0x55cfa024f7f0 2024-09-12T00:19:29.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.977+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.977+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d190 con 0x7fe3e80f4040 2024-09-12T00:19:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.977+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.977+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d220 con 0x7fe3f0021020 2024-09-12T00:19:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.981+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.981+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d2b0 con 0x55cfa02541f0 2024-09-12T00:19:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.981+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.981+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d340 con 0x7fe3f0021020 2024-09-12T00:19:29.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.985+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'55 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.985+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d3d0 con 0x7fe3e80f4040 2024-09-12T00:19:29.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.985+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'23 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.985+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d3d0 con 0x7fe3f0021020 2024-09-12T00:19:29.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:29.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d4a0 con 0x7fe3e80f4040 2024-09-12T00:19:29.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv16 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:29.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d4a0 con 0x55cfa024f7f0 2024-09-12T00:19:29.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'165 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:29.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.989+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d4a0 con 0x55cfa02541f0 2024-09-12T00:19:29.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.993+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:29.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.993+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d530 con 0x7fe3f0021020 2024-09-12T00:19:29.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.993+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'56 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.993+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d530 con 0x55cfa02541f0 2024-09-12T00:19:30.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.997+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.997+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d550 con 0x55cfa024f7f0 2024-09-12T00:19:30.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.997+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:29.997+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d580 con 0x55cfa024f7f0 2024-09-12T00:19:30.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.001+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'166 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.001+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d580 con 0x55cfa02541f0 2024-09-12T00:19:30.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.001+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.001+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d590 con 0x7fe3f0021020 2024-09-12T00:19:30.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.005+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.005+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d5d0 con 0x55cfa02541f0 2024-09-12T00:19:30.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.005+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.005+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d620 con 0x55cfa02541f0 2024-09-12T00:19:30.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d640 con 0x55cfa02541f0 2024-09-12T00:19:30.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d640 con 0x55cfa02541f0 2024-09-12T00:19:30.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.009+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d680 con 0x7fe3e80f4040 2024-09-12T00:19:30.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.013+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.013+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d680 con 0x55cfa02541f0 2024-09-12T00:19:30.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.013+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'31 uv19 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.013+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d680 con 0x7fe3e80f4040 2024-09-12T00:19:30.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.017+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.017+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d680 con 0x55cfa02541f0 2024-09-12T00:19:30.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.021+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.021+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d6b0 con 0x7fe3e80f4040 2024-09-12T00:19:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.021+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.021+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026d720 con 0x7fe3f0021020 2024-09-12T00:19:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe2acfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe3f97489c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe3f97489c0 20 Filter name: none 2024-09-12T00:19:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe2267fc640 20 reqs_thread_entry: start 2024-09-12T00:19:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-12T00:19:30.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.025+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:94 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026a070 con 0x55cfa02541f0 2024-09-12T00:19:30.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(94 gc.23 [call] v33'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:95 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa026a030 con 0x55cfa02541f0 2024-09-12T00:19:30.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(95 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:96 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(96 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(97 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(98 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(99 gc.23 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.029+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:100 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(100 gc.24 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:101 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(101 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:102 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(102 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:103 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(103 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:104 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(104 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.033+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(105 gc.24 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-12T00:19:30.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(106 gc.25 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:107 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(107 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== osd_op_reply(108 gc.25 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(109 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.037+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:111 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.041+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== osd_op_reply(111 gc.25 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.041+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-12T00:19:30.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.041+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.041+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(112 gc.26 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.041+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:114 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3e80f4040 2024-09-12T00:19:30.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(114 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:115 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(115 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:116 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(116 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.045+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:117 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.049+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(117 gc.26 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.049+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-12T00:19:30.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.049+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:118 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(118 gc.27 [call] v33'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:119 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 47 ==== osd_op_reply(119 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:120 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 48 ==== osd_op_reply(120 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 49 ==== osd_op_reply(121 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 50 ==== osd_op_reply(122 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.053+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.057+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 51 ==== osd_op_reply(123 gc.27 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.057+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-12T00:19:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.057+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:124 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.057+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(124 gc.28 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.057+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:125 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(125 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:126 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3e80f4040 2024-09-12T00:19:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(126 gc.28 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:127 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(127 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:128 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(128 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.061+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:129 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.065+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(129 gc.28 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.065+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-12T00:19:30.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.065+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:130 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 52 ==== osd_op_reply(130 gc.29 [call] v33'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:131 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 53 ==== osd_op_reply(131 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:132 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 54 ==== osd_op_reply(132 gc.29 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:133 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 55 ==== osd_op_reply(133 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:134 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 56 ==== osd_op_reply(134 gc.29 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.069+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:135 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.073+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 57 ==== osd_op_reply(135 gc.29 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.073+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-12T00:19:30.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.073+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:136 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(136 gc.30 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:137 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(137 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3e80f4040 2024-09-12T00:19:30.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(138 gc.30 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.077+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(140 gc.30 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:141 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(141 gc.30 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-12T00:19:30.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.081+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:142 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(142 gc.31 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:143 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(143 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:144 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(144 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:145 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(145 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.085+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:146 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(146 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:147 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(147 gc.31 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-12T00:19:30.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.089+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:148 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(148 gc.0 [call] v33'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(149 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(150 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.093+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(152 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(153 gc.0 [call] v33'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-12T00:19:30.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.097+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:154 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.101+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(154 gc.1 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.101+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:155 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.101+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(155 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.101+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.101+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(156 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(158 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.105+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.109+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(159 gc.1 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x7fe3e80f4040 2024-09-12T00:19:30.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.109+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-12T00:19:30.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.109+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:160 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.109+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 58 ==== osd_op_reply(160 gc.2 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:161 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 59 ==== osd_op_reply(161 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 60 ==== osd_op_reply(162 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 61 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 62 ==== osd_op_reply(164 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.113+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.117+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 63 ==== osd_op_reply(165 gc.2 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.117+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-12T00:19:30.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.117+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:166 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(166 gc.3 [call] v33'167 uv167 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:167 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(167 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa024f7f0 2024-09-12T00:19:30.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.121+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(168 gc.3 [call out=24b] v0'0 uv167 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(170 gc.3 [call out=15b] v0'0 uv167 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.125+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.129+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(171 gc.3 [call] v33'168 uv168 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec03b040 con 0x55cfa024f7f0 2024-09-12T00:19:30.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.129+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-12T00:19:30.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.129+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:172 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.129+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(172 gc.4 [call] v33'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.129+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:173 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(173 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3f0021020 2024-09-12T00:19:30.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(174 gc.4 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(176 gc.4 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.133+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.137+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(177 gc.4 [call] v33'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.137+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-12T00:19:30.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.137+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:178 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 64 ==== osd_op_reply(178 gc.5 [call] v33'47 uv47 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:179 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 65 ==== osd_op_reply(179 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 66 ==== osd_op_reply(180 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 67 ==== osd_op_reply(181 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x55cfa02541f0 2024-09-12T00:19:30.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 68 ==== osd_op_reply(182 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.141+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.145+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 69 ==== osd_op_reply(183 gc.5 [call] v33'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.145+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-12T00:19:30.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.145+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:184 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(184 gc.6 [call] v33'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(185 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(186 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.149+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(187 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(188 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.153+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa024f7f0 2024-09-12T00:19:30.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.157+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(189 gc.6 [call] v33'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.157+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-12T00:19:30.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.157+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:190 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.157+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== osd_op_reply(190 gc.7 [call] v33'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.157+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(191 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(192 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== osd_op_reply(193 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 50 ==== osd_op_reply(194 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.161+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.165+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 51 ==== osd_op_reply(195 gc.7 [call] v33'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.165+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-12T00:19:30.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.165+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:196 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(196 gc.8 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(197 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(198 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(199 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.169+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(200 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(201 gc.8 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-12T00:19:30.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.173+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:202 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 70 ==== osd_op_reply(202 gc.9 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 71 ==== osd_op_reply(203 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 72 ==== osd_op_reply(204 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.177+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 73 ==== osd_op_reply(205 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 74 ==== osd_op_reply(206 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x55cfa02541f0 2024-09-12T00:19:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 75 ==== osd_op_reply(207 gc.9 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-12T00:19:30.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.181+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:208 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(208 gc.10 [call] v33'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(209 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3f0021020 2024-09-12T00:19:30.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== osd_op_reply(210 gc.10 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.185+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== osd_op_reply(211 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(212 gc.10 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3f0021020 2024-09-12T00:19:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 42 ==== osd_op_reply(213 gc.10 [call] v33'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-12T00:19:30.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.189+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:214 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.193+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 52 ==== osd_op_reply(214 gc.11 [call] v33'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.193+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.193+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 53 ==== osd_op_reply(215 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.193+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.193+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268fb0 con 0x7fe3e80f4040 2024-09-12T00:19:30.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 54 ==== osd_op_reply(216 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 55 ==== osd_op_reply(217 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0269fc0 con 0x7fe3e80f4040 2024-09-12T00:19:30.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 56 ==== osd_op_reply(218 gc.11 [call out=1701b] v0'0 uv24 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 20 garbage collection: RGWGC::process iterating over entry tag='631e6d39-d415-492d-aa86-21cdd5f9473d.4229.8649460836549752042', time=2024-09-12T00:19:29.533548+0000, chain.objs.size()=7 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_1 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:219 3.as0 3:512cb397:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0289440 con 0x55cfa02541f0 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_2 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:220 3.1as0 3:5bcf126e:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02899c0 con 0x55cfa024f7f0 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_3 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:221 3.ds0 3:b2129779:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa028f880 con 0x55cfa02541f0 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_4 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:222 3.38s0 3:1eda8618:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02920f0 con 0x7fe3e80f4040 2024-09-12T00:19:30.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_5 2024-09-12T00:19:30.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:223 3.30s0 3:0e089d44:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0294960 con 0x55cfa02541f0 2024-09-12T00:19:30.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_6 2024-09-12T00:19:30.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:224 3.es0 3:73d2b3cd:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02971d0 con 0x7fe3f0021020 2024-09-12T00:19:30.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_7 2024-09-12T00:19:30.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.197+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:225 3.24s0 3:26dea0e8:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0299a40 con 0x7fe3e80f4040 2024-09-12T00:19:30.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 76 ==== osd_op_reply(219 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_1 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 57 ==== osd_op_reply(222 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_4 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== osd_op_reply(220 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_2 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 43 ==== osd_op_reply(224 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_6 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 77 ==== osd_op_reply(221 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_3 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.205+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 58 ==== osd_op_reply(225 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_7 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.209+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 78 ==== osd_op_reply(223 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1__shadow_.sRZY5fsYIdfHyiTlr6ANxiRhBPwr9Fa_5 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.209+0000 7fe3f97489c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:19:30.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.209+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:226 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.217+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 59 ==== osd_op_reply(226 gc.11 [call] v33'25 uv25 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.217+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:227 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.217+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 60 ==== osd_op_reply(227 gc.11 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.217+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-12T00:19:30.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.217+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:228 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 44 ==== osd_op_reply(228 gc.12 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:229 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 45 ==== osd_op_reply(229 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:230 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 46 ==== osd_op_reply(230 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.221+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:231 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 47 ==== osd_op_reply(231 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:232 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 48 ==== osd_op_reply(232 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.225+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:233 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 49 ==== osd_op_reply(233 gc.12 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-12T00:19:30.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:234 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 61 ==== osd_op_reply(234 gc.13 [call] v33'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:235 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 62 ==== osd_op_reply(235 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.229+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:236 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3e80f4040 2024-09-12T00:19:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 63 ==== osd_op_reply(236 gc.13 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:237 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 64 ==== osd_op_reply(237 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:238 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 65 ==== osd_op_reply(238 gc.13 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.233+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:239 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3e80f4040 2024-09-12T00:19:30.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.237+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 66 ==== osd_op_reply(239 gc.13 [call] v33'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.237+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-12T00:19:30.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.237+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:240 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa024f7f0 2024-09-12T00:19:30.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(240 gc.14 [call] v33'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:241 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa024f7f0 2024-09-12T00:19:30.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== osd_op_reply(241 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:242 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 49 ==== osd_op_reply(242 gc.14 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:243 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa024f7f0 2024-09-12T00:19:30.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 50 ==== osd_op_reply(243 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:244 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa024f7f0 2024-09-12T00:19:30.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 51 ==== osd_op_reply(244 gc.14 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.241+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:245 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa024f7f0 2024-09-12T00:19:30.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.245+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 52 ==== osd_op_reply(245 gc.14 [call] v33'170 uv170 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.245+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-12T00:19:30.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.245+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:246 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa02541f0 2024-09-12T00:19:30.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 79 ==== osd_op_reply(246 gc.15 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:247 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa02541f0 2024-09-12T00:19:30.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 80 ==== osd_op_reply(247 gc.15 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:248 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 81 ==== osd_op_reply(248 gc.15 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:249 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa02541f0 2024-09-12T00:19:30.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 82 ==== osd_op_reply(249 gc.15 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.249+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:250 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa02541f0 2024-09-12T00:19:30.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 83 ==== osd_op_reply(250 gc.15 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:251 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x55cfa02541f0 2024-09-12T00:19:30.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 84 ==== osd_op_reply(251 gc.15 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-12T00:19:30.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.253+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:252 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 50 ==== osd_op_reply(252 gc.16 [call] v33'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:253 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 51 ==== osd_op_reply(253 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:254 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x7fe3f0021020 2024-09-12T00:19:30.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 52 ==== osd_op_reply(254 gc.16 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.257+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:255 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x7fe3f0021020 2024-09-12T00:19:30.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 53 ==== osd_op_reply(255 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:256 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 54 ==== osd_op_reply(256 gc.16 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:257 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 55 ==== osd_op_reply(257 gc.16 [call] v33'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-12T00:19:30.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.261+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:258 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.265+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 85 ==== osd_op_reply(258 gc.17 [call] v33'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.265+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:259 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.265+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 86 ==== osd_op_reply(259 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.265+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.265+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:260 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x55cfa02541f0 2024-09-12T00:19:30.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 87 ==== osd_op_reply(260 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:261 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 88 ==== osd_op_reply(261 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:262 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 89 ==== osd_op_reply(262 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.269+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:263 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.273+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 90 ==== osd_op_reply(263 gc.17 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.273+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-12T00:19:30.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.273+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:264 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.273+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 53 ==== osd_op_reply(264 gc.18 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.273+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:265 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 54 ==== osd_op_reply(265 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:266 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x55cfa024f7f0 2024-09-12T00:19:30.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 55 ==== osd_op_reply(266 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:267 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 56 ==== osd_op_reply(267 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:268 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 57 ==== osd_op_reply(268 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.277+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:269 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.281+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 58 ==== osd_op_reply(269 gc.18 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.281+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-12T00:19:30.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.281+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:270 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.281+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 59 ==== osd_op_reply(270 gc.19 [call] v33'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.281+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:271 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 60 ==== osd_op_reply(271 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:272 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x55cfa024f7f0 2024-09-12T00:19:30.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 61 ==== osd_op_reply(272 gc.19 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:273 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 62 ==== osd_op_reply(273 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:274 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 63 ==== osd_op_reply(274 gc.19 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.285+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:275 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa024f7f0 2024-09-12T00:19:30.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.289+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 64 ==== osd_op_reply(275 gc.19 [call] v33'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.289+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-12T00:19:30.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.289+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:276 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 91 ==== osd_op_reply(276 gc.20 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:277 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 92 ==== osd_op_reply(277 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:278 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x55cfa02541f0 2024-09-12T00:19:30.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 93 ==== osd_op_reply(278 gc.20 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:279 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 94 ==== osd_op_reply(279 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:280 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 95 ==== osd_op_reply(280 gc.20 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.293+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:281 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.297+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 96 ==== osd_op_reply(281 gc.20 [call] v33'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.297+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-12T00:19:30.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.297+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:282 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 56 ==== osd_op_reply(282 gc.21 [call] v33'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:283 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 57 ==== osd_op_reply(283 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:284 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 58 ==== osd_op_reply(284 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:285 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 59 ==== osd_op_reply(285 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.301+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:286 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x7fe3f0021020 2024-09-12T00:19:30.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 60 ==== osd_op_reply(286 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:287 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0293470 con 0x7fe3f0021020 2024-09-12T00:19:30.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 61 ==== osd_op_reply(287 gc.21 [call] v33'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f97489c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-12T00:19:30.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.305+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:288 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 97 ==== osd_op_reply(288 gc.22 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:289 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 98 ==== osd_op_reply(289 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:290 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0268f80 con 0x55cfa02541f0 2024-09-12T00:19:30.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 99 ==== osd_op_reply(290 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:291 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 100 ==== osd_op_reply(291 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:19:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.309+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:292 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.313+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 101 ==== osd_op_reply(292 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.313+0000 7fe3f97489c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:19:30.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.313+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:293 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0292460 con 0x55cfa02541f0 2024-09-12T00:19:30.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.313+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 102 ==== osd_op_reply(293 gc.22 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.317+0000 7fe2adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:30.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.317+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350233430816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa02684f0 con 0x55cfa024f7f0 2024-09-12T00:19:30.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.317+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94350233430816] v33'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.317+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350233411552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025eb20 con 0x7fe3f0021020 2024-09-12T00:19:30.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.321+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94350233411552] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.321+0000 7fe3f97489c0 20 remove_watcher() i=0 2024-09-12T00:19:30.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.321+0000 7fe3f97489c0 2 removed watcher, disabling cache 2024-09-12T00:19:30.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.321+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350233413808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa0259fe0 con 0x55cfa024f7f0 2024-09-12T00:19:30.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94350233413808] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f97489c0 20 remove_watcher() i=1 2024-09-12T00:19:30.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350233421680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025a8b0 con 0x55cfa02541f0 2024-09-12T00:19:30.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f7a4f640 1 -- 172.21.15.66:0/1199565136 <== osd.3 v2:172.21.15.66:6816/2782209626 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94350233421680] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3f003d020 con 0x55cfa02541f0 2024-09-12T00:19:30.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f97489c0 20 remove_watcher() i=2 2024-09-12T00:19:30.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.325+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350233424384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025a8b0 con 0x7fe3f0021020 2024-09-12T00:19:30.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f724e640 1 -- 172.21.15.66:0/1199565136 <== osd.2 v2:172.21.15.66:6800/1272812173 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94350233424384] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e80da070 con 0x7fe3f0021020 2024-09-12T00:19:30.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f97489c0 20 remove_watcher() i=3 2024-09-12T00:19:30.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350233418736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025a8b0 con 0x55cfa024f7f0 2024-09-12T00:19:30.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.1 v2:172.21.15.66:6808/1373122057 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94350233418736] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x55cfa024f7f0 2024-09-12T00:19:30.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f97489c0 20 remove_watcher() i=4 2024-09-12T00:19:30.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.329+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350233429008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025bbf0 con 0x7fe3e80f4040 2024-09-12T00:19:30.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.333+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94350233429008] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.333+0000 7fe3f97489c0 20 remove_watcher() i=5 2024-09-12T00:19:30.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.333+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350233432384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025a8b0 con 0x7fe3e80f4040 2024-09-12T00:19:30.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94350233432384] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 20 remove_watcher() i=6 2024-09-12T00:19:30.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350233434944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfa025bbf0 con 0x7fe3e80f4040 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 <== osd.0 v2:172.21.15.31:6800/3108862692 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94350233434944] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3ec047040 con 0x7fe3e80f4040 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 20 remove_watcher() i=7 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe3e80f4040 msgr2=0x7fe3e80b48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe3e80f4040 0x7fe3e80b48e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa024f7f0 msgr2=0x55cfa0251cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa024f7f0 0x55cfa0251cb0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe3f0021020 msgr2=0x7fe3f0020a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe3f0021020 0x7fe3f0020a50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa02541f0 msgr2=0x55cfa02565e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa02541f0 0x55cfa02565e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2c0039a20 msgr2=0x7fe2c003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2c0039a20 0x7fe2c003bee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80b46e0 tx=0x7fe3e80da000 comp rx=0 tx=0).stop 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 msgr2=0x55cfa0244260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/1199565136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa023cdd0 0x55cfa0244260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0018fd0 tx=0x7fe3f0050020 comp rx=0 tx=0).stop 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.337+0000 7fe3f6a4d640 1 -- 172.21.15.66:0/1199565136 reap_dead start 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 shutdown_connections 2024-09-12T00:19:30.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 >> 172.21.15.66:0/1199565136 conn(0x55cfa0239200 msgr2=0x55cfa0237410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 shutdown_connections 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/1199565136 wait complete. 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 msgr2=0x7fe2d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 0x7fe2d003bf30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55cfa021d410 tx=0x7fe3e80c6e90 comp rx=0 tx=0).stop 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 msgr2=0x55cfa02308b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55cfa0216cb0 tx=0x7fe3f000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 shutdown_connections 2024-09-12T00:19:30.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2d0039a70 0x7fe2d003bf30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/635118587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa0230490 0x55cfa02308b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 >> 172.21.15.66:0/635118587 conn(0x55cfa0225e40 msgr2=0x55cfa0226220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 shutdown_connections 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/635118587 wait complete. 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 msgr2=0x55cfa021ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 0x55cfa021ca90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 msgr2=0x55cfa0221630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 0x55cfa0221630 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 msgr2=0x7fe2dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 0x7fe2dc03bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec001e40 tx=0x7fe3ec0013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 msgr2=0x55cfa0215920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8003430 tx=0x7fe3e8017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 shutdown_connections 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfa021f240 0x55cfa0221630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfa0096630 0x55cfa021ca90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe2dc039a70 0x7fe2dc03bf30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 --2- 172.21.15.66:0/3888370663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfa00934f0 0x55cfa0215920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 >> 172.21.15.66:0/3888370663 conn(0x55cfa0092060 msgr2=0x55cfa0208b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 shutdown_connections 2024-09-12T00:19:30.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.341+0000 7fe3f97489c0 1 -- 172.21.15.66:0/3888370663 wait complete. 2024-09-12T00:19:30.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T00:19:30.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T00:19:30.368 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T00:19:30.445 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:30.446 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:30.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a96369c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558f7ed19770 0x558f7ed19b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a96369c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f7ebcb9c0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a96369c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x558f7ec1b6d0 con 0x558f7ed19770 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a713c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558f7ed19770 0x558f7ed19b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a713c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558f7ed19770 0x558f7ed19b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33450/0 (socket says 172.21.15.66:33450) 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a713c640 1 -- 172.21.15.66:0/3371278552 learned_addr learned my addr 172.21.15.66:0/3371278552 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.441+0000 7f21a693b640 1 --1- 172.21.15.66:0/3371278552 >> v1:172.21.15.31:6789/0 conn(0x558f7ed1c8b0 0x558f7ed1eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38310/0 (socket says 172.21.15.66:38310) 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a713c640 1 -- 172.21.15.66:0/3371278552 >> v1:172.21.15.31:6789/0 conn(0x558f7ed1c8b0 legacy=0x558f7ed1eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a713c640 1 -- 172.21.15.66:0/3371278552 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7ebbfca0 con 0x558f7ed19770 2024-09-12T00:19:30.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a713c640 1 --2- 172.21.15.66:0/3371278552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ed19b50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f21a000a5c0 tx=0x7f21a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b0782712821bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a613a640 1 -- 172.21.15.66:0/3371278552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00a6070 con 0x558f7ed19770 2024-09-12T00:19:30.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a613a640 1 -- 172.21.15.66:0/3371278552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00af070 con 0x558f7ed19770 2024-09-12T00:19:30.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a613a640 1 -- 172.21.15.66:0/3371278552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00aa5c0 con 0x558f7ed19770 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 -- 172.21.15.66:0/3371278552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 msgr2=0x558f7ed19b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3371278552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ed19b50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f21a000a5c0 tx=0x7f21a001b340 comp rx=0 tx=0).stop 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 -- 172.21.15.66:0/3371278552 shutdown_connections 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3371278552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ed19b50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 -- 172.21.15.66:0/3371278552 >> 172.21.15.66:0/3371278552 conn(0x558f7ec8d080 msgr2=0x558f7ec8d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 -- 172.21.15.66:0/3371278552 shutdown_connections 2024-09-12T00:19:30.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.445+0000 7f21a96369c0 1 -- 172.21.15.66:0/3371278552 wait complete. 2024-09-12T00:19:30.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f7ec1f680 con 0x558f7ed19770 2024-09-12T00:19:30.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a713c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a713c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33466/0 (socket says 172.21.15.66:33466) 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a713c640 1 -- 172.21.15.66:0/3062099553 learned_addr learned my addr 172.21.15.66:0/3062099553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a713c640 1 -- 172.21.15.66:0/3062099553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7eb9ada0 con 0x558f7ed19770 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a713c640 1 --2- 172.21.15.66:0/3062099553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21a0018f70 tx=0x7f21a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bdb6c7b5614d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f209560a640 1 -- 172.21.15.66:0/3062099553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00aa8b0 con 0x558f7ed19770 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f209560a640 1 -- 172.21.15.66:0/3062099553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00aaa50 con 0x558f7ed19770 2024-09-12T00:19:30.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f209560a640 1 -- 172.21.15.66:0/3062099553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00aad30 con 0x558f7ed19770 2024-09-12T00:19:30.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- 172.21.15.66:0/3062099553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 msgr2=0x558f7ee049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3062099553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21a0018f70 tx=0x7f21a0003030 comp rx=0 tx=0).stop 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- 172.21.15.66:0/3062099553 shutdown_connections 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3062099553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee049e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- 172.21.15.66:0/3062099553 >> 172.21.15.66:0/3062099553 conn(0x558f7ec8d080 msgr2=0x558f7ee00680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- 172.21.15.66:0/3062099553 shutdown_connections 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- 172.21.15.66:0/3062099553 wait complete. 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.465+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f7ebc1a50 con 0x558f7ed19770 2024-09-12T00:19:30.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a713c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a713c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33474/0 (socket says 172.21.15.66:33474) 2024-09-12T00:19:30.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a713c640 1 -- 172.21.15.66:0/8058204 learned_addr learned my addr 172.21.15.66:0/8058204 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a713c640 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7ee0c450 con 0x558f7ed19770 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a713c640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f21a0018f70 tx=0x7f21a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 -- 172.21.15.66:0/8058204 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00c6690 con 0x558f7ed19770 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7ee0c6e0 con 0x558f7ed19770 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7ee0d090 con 0x558f7ed19770 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 -- 172.21.15.66:0/8058204 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00c6830 con 0x558f7ed19770 2024-09-12T00:19:30.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 -- 172.21.15.66:0/8058204 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21a00c6b10 con 0x558f7ed19770 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 -- 172.21.15.66:0/8058204 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f21a00ce030 con 0x558f7ed19770 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 0x7f208c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f2093e07640 1 -- 172.21.15.66:0/8058204 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f21a00cc020 con 0x558f7ed19770 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a693b640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 0x7f208c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 0x558f7ee13060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee135a0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.469+0000 7f21a793d640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 0x558f7ee13060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a693b640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 0x7f208c03bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2190001e40 tx=0x7f21900013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 0x558f7ee13060 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 -- 172.21.15.66:0/8058204 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219800a4d0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee0d3d0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 -- 172.21.15.66:0/8058204 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f219800a4d0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 0x558f7ee17c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee182f0 con 0x558f7ee15810 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a713c640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 0x558f7ee17c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a713c640 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 0x558f7ee17c00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a713c640 1 -- 172.21.15.66:0/8058204 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21a00b71b0 con 0x558f7ee15810 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee146e0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 -- 172.21.15.66:0/8058204 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f219800a4d0 con 0x558f7ed1c8b0 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee14b40 con 0x558f7ee15810 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a713c640 1 -- 172.21.15.66:0/8058204 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21a00b71b0 con 0x558f7ee15810 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a96369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f7ec2c450 con 0x558f7ee269a0 2024-09-12T00:19:30.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33484/0 (socket says 172.21.15.66:33484) 2024-09-12T00:19:30.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.473+0000 7f21a793d640 1 -- 172.21.15.66:0/1904775625 learned_addr learned my addr 172.21.15.66:0/1904775625 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a793d640 1 -- 172.21.15.66:0/1904775625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7ee27400 con 0x558f7ee269a0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a793d640 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x558f7ee0ce00 tx=0x7f21980163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 -- 172.21.15.66:0/1904775625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198013450 con 0x558f7ee269a0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 -- 172.21.15.66:0/1904775625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2198013610 con 0x558f7ee269a0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7ee27c60 con 0x558f7ee269a0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 -- 172.21.15.66:0/1904775625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198013970 con 0x558f7ee269a0 2024-09-12T00:19:30.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7ee281d0 con 0x558f7ee269a0 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 -- 172.21.15.66:0/1904775625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2198011040 con 0x558f7ee269a0 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 0x7f208003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f2091602640 1 -- 172.21.15.66:0/1904775625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f219800e040 con 0x558f7ee269a0 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a713c640 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 0x7f208003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a713c640 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 0x7f208003bf30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x558f7ee139e0 tx=0x7f21a00bdf50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a96369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f7ee05150 con 0x558f7ee34310 2024-09-12T00:19:30.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33494/0 (socket says 172.21.15.66:33494) 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.477+0000 7f21a793d640 1 -- 172.21.15.66:0/652274233 learned_addr learned my addr 172.21.15.66:0/652274233 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 -- 172.21.15.66:0/652274233 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7ee34d00 con 0x558f7ee34310 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 --2- 172.21.15.66:0/652274233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2198020fd0 tx=0x7f219801fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae06c80bc65cdec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f208affd640 1 -- 172.21.15.66:0/652274233 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21980123b0 con 0x558f7ee34310 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f208affd640 1 -- 172.21.15.66:0/652274233 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219802a440 con 0x558f7ee34310 2024-09-12T00:19:30.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f208affd640 1 -- 172.21.15.66:0/652274233 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219804f2e0 con 0x558f7ee34310 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/652274233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 msgr2=0x558f7ee34710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 --2- 172.21.15.66:0/652274233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2198020fd0 tx=0x7f219801fdc0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/652274233 shutdown_connections 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 --2- 172.21.15.66:0/652274233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee34710 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/652274233 >> 172.21.15.66:0/652274233 conn(0x558f7ee2f730 msgr2=0x558f7ee2d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/652274233 shutdown_connections 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/652274233 wait complete. 2024-09-12T00:19:30.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 Processor -- start 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- start start 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f7ee33260 con 0x558f7ee34310 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33508/0 (socket says 172.21.15.66:33508) 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 learned_addr learned my addr 172.21.15.66:0/3594511026 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7ee3ad00 con 0x558f7ee34310 2024-09-12T00:19:30.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a793d640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2198029790 tx=0x7f21980508e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f20897fa640 1 -- 172.21.15.66:0/3594511026 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198048040 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7ee3af90 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f20897fa640 1 -- 172.21.15.66:0/3594511026 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219803ed30 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.481+0000 7f20897fa640 1 -- 172.21.15.66:0/3594511026 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198050be0 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7ee3b940 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f20897fa640 1 -- 172.21.15.66:0/3594511026 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f219801f390 con 0x558f7ee34310 2024-09-12T00:19:30.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f20897fa640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2070039a70 0x7f207003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f20897fa640 1 -- 172.21.15.66:0/3594511026 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2198035d20 con 0x558f7ee34310 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a713c640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2070039a70 0x7f207003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ee45ef0 0x558f7ee48380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee48ad0 con 0x558f7ee45ef0 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ee45ef0 0x558f7ee48380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a713c640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2070039a70 0x7f207003bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00c6fd0 tx=0x7f21a00e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ee45ef0 0x558f7ee48380 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f620 con 0x558f7ee45ef0 2024-09-12T00:19:30.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 realm 2024-09-12T00:19:30.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee452a0 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f620 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee495d0 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219000f620 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee49ea0 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f219000f620 con 0x558f7ee45ef0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee4a7a0 0x558f7ee4cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.485+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4d2d0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee4a7a0 0x558f7ee4cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee4a7a0 0x558f7ee4cb90 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a96369c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a96369c0 20 searching for the correct realm 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2198013c20 0x7f21980327b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x7f2198013c20 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a713c640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2198013c20 0x7f21980327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a713c640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2198013c20 0x7f21980327b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a713c640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21a0009040 0x7f21a00bc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x7f21a0009040 2024-09-12T00:19:30.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a693b640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21a0009040 0x7f21a00bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a693b640 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21a0009040 0x7f21a00bc820 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219000f620 con 0x7f21a0009040 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.489+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219000f620 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x7f21a0009040 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x7f2198013c20 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x558f7ee45ef0 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4eba0 con 0x7f2198013c20 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee45ef0 2024-09-12T00:19:30.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f2198013c20 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.493+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f21a0009040 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f21a0009040 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f2198013c20 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f21a0009040 2024-09-12T00:19:30.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.497+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f21a0009040 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f2198013c20 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee4a7a0 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f21a0009040 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219002b040 con 0x7f21a0009040 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x558f7ee45ef0 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f21a0104040 con 0x7f2198013c20 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:30.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4dc90 con 0x558f7ee45ef0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4d8d0 con 0x558f7ee45ef0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.501+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4e5b0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 zone default found 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 4 Realm: () 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 zonegroup default 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee4e110 con 0x7f21a0009040 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee51280 con 0x558f7ee4a7a0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee51730 con 0x558f7ee4a7a0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 started sync module instance, tier type = 2024-09-12T00:19:30.514 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:30.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee50080 con 0x7f2198013c20 2024-09-12T00:19:30.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94074797622384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee52040 con 0x7f2198013c20 2024-09-12T00:19:30.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.505+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee52890 con 0x558f7ee45ef0 2024-09-12T00:19:30.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94074797622384] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94074797628304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee52930 con 0x558f7ee45ef0 2024-09-12T00:19:30.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee53430 con 0x558f7ee4a7a0 2024-09-12T00:19:30.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94074797628304] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94074797633312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee533f0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.509+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee53e70 con 0x7f2198013c20 2024-09-12T00:19:30.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94074797636032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee54290 con 0x7f2198013c20 2024-09-12T00:19:30.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee54cc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94074797633312] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94074797636032] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94074797639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee53de0 con 0x558f7ee45ef0 2024-09-12T00:19:30.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.513+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee55590 con 0x7f21a0009040 2024-09-12T00:19:30.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94074797639632] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94074797630432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee53de0 con 0x7f21a0009040 2024-09-12T00:19:30.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee55a10 con 0x7f21a0009040 2024-09-12T00:19:30.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94074797643040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee55e50 con 0x7f21a0009040 2024-09-12T00:19:30.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.517+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee56960 con 0x7f21a0009040 2024-09-12T00:19:30.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94074797630432] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94074797643040] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94074797644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee54eb0 con 0x7f21a0009040 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=0 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=1 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=2 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=3 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=4 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=5 2024-09-12T00:19:30.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=6 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94074797644096] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 20 add_watcher() i=7 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.521+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee59950 con 0x558f7ee45ef0 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94074797646864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee56dd0 con 0x558f7ee45ef0 2024-09-12T00:19:30.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94074797646864] v33'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f205dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:30.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a96369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:30.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a96369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:30.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.525+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62180 con 0x558f7ee45ef0 2024-09-12T00:19:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'54 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62630 con 0x7f21a0009040 2024-09-12T00:19:30.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62800 con 0x558f7ee4a7a0 2024-09-12T00:19:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.529+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62800 con 0x558f7ee45ef0 2024-09-12T00:19:30.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'175 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62a60 con 0x7f2198013c20 2024-09-12T00:19:30.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'63 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee62f60 con 0x558f7ee4a7a0 2024-09-12T00:19:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.533+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60810 con 0x558f7ee45ef0 2024-09-12T00:19:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.537+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.537+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60330 con 0x7f21a0009040 2024-09-12T00:19:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.537+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.537+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60980 con 0x7f2198013c20 2024-09-12T00:19:30.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.541+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.541+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60870 con 0x558f7ee4a7a0 2024-09-12T00:19:30.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.541+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.541+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60870 con 0x7f2198013c20 2024-09-12T00:19:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'64 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60870 con 0x7f21a0009040 2024-09-12T00:19:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60870 con 0x7f2198013c20 2024-09-12T00:19:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.545+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60870 con 0x7f21a0009040 2024-09-12T00:19:30.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.549+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.549+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee45ef0 2024-09-12T00:19:30.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.549+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'176 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.549+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.553+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.553+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x7f2198013c20 2024-09-12T00:19:30.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.553+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'65 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.553+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee45ef0 2024-09-12T00:19:30.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee45ef0 2024-09-12T00:19:30.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'177 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.557+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.561+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.561+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x7f2198013c20 2024-09-12T00:19:30.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.561+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.561+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee60a40 con 0x558f7ee4a7a0 2024-09-12T00:19:30.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.565+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee63d70 con 0x558f7ee4a7a0 2024-09-12T00:19:30.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.569+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.569+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee63cf0 con 0x7f21a0009040 2024-09-12T00:19:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.569+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.569+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee63cd0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.573+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.573+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee63cd0 con 0x7f21a0009040 2024-09-12T00:19:30.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.573+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.573+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee608d0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.577+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.577+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee608d0 con 0x7f21a0009040 2024-09-12T00:19:30.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.577+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.577+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee63ae0 con 0x7f2198013c20 2024-09-12T00:19:30.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f205cfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:30.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a96369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:30.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a96369c0 20 Filter name: none 2024-09-12T00:19:30.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f1fd67fc640 20 reqs_thread_entry: start 2024-09-12T00:19:30.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7f050 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7f050 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.581+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f610 con 0x7f21a0009040 2024-09-12T00:19:30.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f160 con 0x558f7ee4a7a0 2024-09-12T00:19:30.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f160 con 0x558f7ee4a7a0 2024-09-12T00:19:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f160 con 0x558f7ee4a7a0 2024-09-12T00:19:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.585+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f160 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv168 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv168 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee4a7a0 2024-09-12T00:19:30.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee4a7a0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee4a7a0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee45ef0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.589+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f110 con 0x558f7ee45ef0 2024-09-12T00:19:30.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv42 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.593+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.597+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.601+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee45ef0 2024-09-12T00:19:30.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv170 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv170 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.605+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv62 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.609+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee45ef0 2024-09-12T00:19:30.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee45ef0 2024-09-12T00:19:30.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.613+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 47 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 48 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 49 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 50 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 51 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 52 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 53 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 54 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 55 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.617+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 56 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 57 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 58 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 59 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.621+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 60 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 61 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 62 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 63 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.625+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f21a0009040 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.629+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee7efc0 con 0x7f2198013c20 2024-09-12T00:19:30.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.633+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.633+0000 7f205dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:30.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.633+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94074797646864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee5f5c0 con 0x558f7ee45ef0 2024-09-12T00:19:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.633+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94074797646864] v33'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.633+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94074797622384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee56410 con 0x7f2198013c20 2024-09-12T00:19:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94074797622384] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a96369c0 20 remove_watcher() i=0 2024-09-12T00:19:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a96369c0 2 removed watcher, disabling cache 2024-09-12T00:19:30.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94074797628304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee50470 con 0x558f7ee45ef0 2024-09-12T00:19:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94074797628304] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a96369c0 20 remove_watcher() i=1 2024-09-12T00:19:30.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.637+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94074797633312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee50470 con 0x558f7ee4a7a0 2024-09-12T00:19:30.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a793d640 1 -- 172.21.15.66:0/3594511026 <== osd.3 v2:172.21.15.66:6816/2782209626 64 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94074797633312] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219803a020 con 0x558f7ee4a7a0 2024-09-12T00:19:30.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a96369c0 20 remove_watcher() i=2 2024-09-12T00:19:30.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94074797636032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee52f20 con 0x7f2198013c20 2024-09-12T00:19:30.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a713c640 1 -- 172.21.15.66:0/3594511026 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94074797636032] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21a00f5070 con 0x7f2198013c20 2024-09-12T00:19:30.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a96369c0 20 remove_watcher() i=3 2024-09-12T00:19:30.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.641+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94074797639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee50470 con 0x558f7ee45ef0 2024-09-12T00:19:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.645+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94074797639632] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x558f7ee45ef0 2024-09-12T00:19:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.645+0000 7f21a96369c0 20 remove_watcher() i=4 2024-09-12T00:19:30.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.645+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94074797630432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee539c0 con 0x7f21a0009040 2024-09-12T00:19:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94074797630432] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a96369c0 20 remove_watcher() i=5 2024-09-12T00:19:30.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94074797643040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee52f20 con 0x7f21a0009040 2024-09-12T00:19:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94074797643040] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a96369c0 20 remove_watcher() i=6 2024-09-12T00:19:30.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.649+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94074797644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558f7ee50470 con 0x7f21a0009040 2024-09-12T00:19:30.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94074797644096] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219003b040 con 0x7f21a0009040 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 20 remove_watcher() i=7 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21a0009040 msgr2=0x7f21a00bc820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f21a0009040 0x7f21a00bc820 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ee45ef0 msgr2=0x558f7ee48380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ee45ef0 0x558f7ee48380 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2198013c20 msgr2=0x7f21980327b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2198013c20 0x7f21980327b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee4a7a0 msgr2=0x558f7ee4cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee4a7a0 0x558f7ee4cb90 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2070039a70 msgr2=0x7f207003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2070039a70 0x7f207003bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00c6fd0 tx=0x7f21a00e6000 comp rx=0 tx=0).stop 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a693b640 1 -- 172.21.15.66:0/3594511026 reap_dead start 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 msgr2=0x558f7ee3a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2198029790 tx=0x7f21980508e0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 shutdown_connections 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/3594511026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee34310 0x558f7ee3a7a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 >> 172.21.15.66:0/3594511026 conn(0x558f7ee2f730 msgr2=0x558f7ee2d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 shutdown_connections 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/3594511026 wait complete. 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 msgr2=0x7f208003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 0x7f208003bf30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x558f7ee139e0 tx=0x7f21a00bdf50 comp rx=0 tx=0).stop 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 msgr2=0x558f7ee26dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x558f7ee0ce00 tx=0x7f21980163e0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 shutdown_connections 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2080039a70 0x7f208003bf30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 --2- 172.21.15.66:0/1904775625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ee269a0 0x558f7ee26dc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.653+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 >> 172.21.15.66:0/1904775625 conn(0x558f7ee1c350 msgr2=0x558f7ee1c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 shutdown_connections 2024-09-12T00:19:30.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/1904775625 wait complete. 2024-09-12T00:19:30.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 msgr2=0x558f7ee13060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 0x558f7ee13060 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 msgr2=0x558f7ee17c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 0x558f7ee17c00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 msgr2=0x7f208c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 0x7f208c03bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2190001e40 tx=0x7f21900013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 msgr2=0x558f7ee0bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f21a0018f70 tx=0x7f21a00180e0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 shutdown_connections 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558f7ee15810 0x558f7ee17c00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x558f7ed1c8b0 0x558f7ee13060 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f208c039ac0 0x7f208c03bf80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 --2- 172.21.15.66:0/8058204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f7ed19770 0x558f7ee0bef0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 >> 172.21.15.66:0/8058204 conn(0x558f7ec8d080 msgr2=0x558f7edff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 shutdown_connections 2024-09-12T00:19:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.657+0000 7f21a96369c0 1 -- 172.21.15.66:0/8058204 wait complete. 2024-09-12T00:19:30.673 INFO:teuthology.orchestra.run.smithi066.stdout:[] 2024-09-12T00:19:30.674 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:19:30.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:30.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:30.674 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T00:19:30.753 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:30.754 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:30.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb33b40d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5580c1a018c0 0x5580c1a03cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb33b40d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580c18af9c0 con 0x5580c19fd770 2024-09-12T00:19:30.755 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb33b40d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5580c18ff6d0 con 0x5580c1a018c0 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb338712640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5580c1a018c0 0x5580c1a03cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb338712640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5580c1a018c0 0x5580c1a03cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33514/0 (socket says 172.21.15.66:33514) 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb338712640 1 -- 172.21.15.66:0/1303218042 learned_addr learned my addr 172.21.15.66:0/1303218042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.749+0000 7fb338f13640 1 --1- 172.21.15.66:0/1303218042 >> v1:172.21.15.31:6789/0 conn(0x5580c19fd770 0x5580c19fdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38314/0 (socket says 172.21.15.66:38314) 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb338712640 1 -- 172.21.15.66:0/1303218042 >> v1:172.21.15.31:6789/0 conn(0x5580c19fd770 legacy=0x5580c19fdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb338712640 1 -- 172.21.15.66:0/1303218042 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c18a3ca0 con 0x5580c1a018c0 2024-09-12T00:19:30.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb338712640 1 --2- 172.21.15.66:0/1303218042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1a018c0 0x5580c1a03cb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00a5c0 tx=0x7fb32c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a7d6b3c565a817 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb337f11640 1 -- 172.21.15.66:0/1303218042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c0a9590 con 0x5580c1a018c0 2024-09-12T00:19:30.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb337f11640 1 -- 172.21.15.66:0/1303218042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c0ae070 con 0x5580c1a018c0 2024-09-12T00:19:30.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb337f11640 1 -- 172.21.15.66:0/1303218042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c0a9880 con 0x5580c1a018c0 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1303218042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1a018c0 msgr2=0x5580c1a03cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1303218042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1a018c0 0x5580c1a03cb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00a5c0 tx=0x7fb32c01b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1303218042 shutdown_connections 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1303218042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1a018c0 0x5580c1a03cb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1303218042 >> 172.21.15.66:0/1303218042 conn(0x5580c1971080 msgr2=0x5580c1971490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1303218042 shutdown_connections 2024-09-12T00:19:30.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.753+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1303218042 wait complete. 2024-09-12T00:19:30.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.769+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.769+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.769+0000 7fb33b40d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.769+0000 7fb33b40d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5580c1903680 con 0x5580c19fd770 2024-09-12T00:19:30.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33516/0 (socket says 172.21.15.66:33516) 2024-09-12T00:19:30.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 -- 172.21.15.66:0/1123767449 learned_addr learned my addr 172.21.15.66:0/1123767449 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 -- 172.21.15.66:0/1123767449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c187eda0 con 0x5580c19fd770 2024-09-12T00:19:30.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 --2- 172.21.15.66:0/1123767449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb328001ec0 tx=0x7fb32800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18cffdaf9b1c99e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb226e0d640 1 -- 172.21.15.66:0/1123767449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32800e5d0 con 0x5580c19fd770 2024-09-12T00:19:30.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb226e0d640 1 -- 172.21.15.66:0/1123767449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32800e770 con 0x5580c19fd770 2024-09-12T00:19:30.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb226e0d640 1 -- 172.21.15.66:0/1123767449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32800ea70 con 0x5580c19fd770 2024-09-12T00:19:30.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1123767449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 msgr2=0x5580c1ae89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1123767449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb328001ec0 tx=0x7fb32800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1123767449 shutdown_connections 2024-09-12T00:19:30.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1123767449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1ae89b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1123767449 >> 172.21.15.66:0/1123767449 conn(0x5580c1971080 msgr2=0x5580c1ae4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1123767449 shutdown_connections 2024-09-12T00:19:30.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1123767449 wait complete. 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb33b40d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5580c18a5a50 con 0x5580c19fd770 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33532/0 (socket says 172.21.15.66:33532) 2024-09-12T00:19:30.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.773+0000 7fb338f13640 1 -- 172.21.15.66:0/1279704754 learned_addr learned my addr 172.21.15.66:0/1279704754 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb338f13640 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c1af05b0 con 0x5580c19fd770 2024-09-12T00:19:30.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb338f13640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x5580c1ae99a0 tx=0x7fb328000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 -- 172.21.15.66:0/1279704754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32800f8e0 con 0x5580c19fd770 2024-09-12T00:19:30.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 -- 172.21.15.66:0/1279704754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32800fa80 con 0x5580c19fd770 2024-09-12T00:19:30.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c1af0840 con 0x5580c19fd770 2024-09-12T00:19:30.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 -- 172.21.15.66:0/1279704754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32800fda0 con 0x5580c19fd770 2024-09-12T00:19:30.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c1af11f0 con 0x5580c19fd770 2024-09-12T00:19:30.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 -- 172.21.15.66:0/1279704754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb328017070 con 0x5580c19fd770 2024-09-12T00:19:30.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 0x7fb22003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb22560a640 1 -- 172.21.15.66:0/1279704754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb328015020 con 0x5580c19fd770 2024-09-12T00:19:30.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb338712640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 0x7fb22003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 0x5580c1af71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1af7700 con 0x5580c1a018c0 2024-09-12T00:19:30.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb339714640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 0x5580c1af71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb338712640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 0x7fb22003bf80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.777+0000 7fb339714640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 0x5580c1af71c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 -- 172.21.15.66:0/1279704754 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb33000a4d0 con 0x5580c1a018c0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1af1550 con 0x5580c1a018c0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 -- 172.21.15.66:0/1279704754 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb33000a4d0 con 0x5580c1a018c0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 0x5580c1afbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1afc520 con 0x5580c1af99f0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb338f13640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 0x5580c1afbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb338f13640 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 0x5580c1afbde0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb338f13640 1 -- 172.21.15.66:0/1279704754 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb32802e070 con 0x5580c1af99f0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1af8890 con 0x5580c1a018c0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 -- 172.21.15.66:0/1279704754 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb33000a4d0 con 0x5580c1a018c0 2024-09-12T00:19:30.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1af8c90 con 0x5580c1af99f0 2024-09-12T00:19:30.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb338f13640 1 -- 172.21.15.66:0/1279704754 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb32802e070 con 0x5580c1af99f0 2024-09-12T00:19:30.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb33b40d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5580c1910450 con 0x5580c1b0ab90 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33540/0 (socket says 172.21.15.66:33540) 2024-09-12T00:19:30.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.781+0000 7fb339714640 1 -- 172.21.15.66:0/1496569498 learned_addr learned my addr 172.21.15.66:0/1496569498 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb339714640 1 -- 172.21.15.66:0/1496569498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c1b0b5f0 con 0x5580c1b0ab90 2024-09-12T00:19:30.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb339714640 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5580c1af0dd0 tx=0x7fb3300167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 -- 172.21.15.66:0/1496569498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb330013640 con 0x5580c1b0ab90 2024-09-12T00:19:30.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 -- 172.21.15.66:0/1496569498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300137e0 con 0x5580c1b0ab90 2024-09-12T00:19:30.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c1b0be50 con 0x5580c1b0ab90 2024-09-12T00:19:30.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 -- 172.21.15.66:0/1496569498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb330013ae0 con 0x5580c1b0ab90 2024-09-12T00:19:30.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c1b0c3c0 con 0x5580c1b0ab90 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 -- 172.21.15.66:0/1496569498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb330011040 con 0x5580c1b0ab90 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 0x7fb21003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb21e7fc640 1 -- 172.21.15.66:0/1496569498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb33000e040 con 0x5580c1b0ab90 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb338f13640 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 0x7fb21003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb338f13640 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 0x7fb21003bf30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5580c1af18f0 tx=0x7fb32800ff40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb33b40d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5580c1ae9200 con 0x5580c1b18560 2024-09-12T00:19:30.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33546/0 (socket says 172.21.15.66:33546) 2024-09-12T00:19:30.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.785+0000 7fb339714640 1 -- 172.21.15.66:0/4222053611 learned_addr learned my addr 172.21.15.66:0/4222053611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 -- 172.21.15.66:0/4222053611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c1b18f50 con 0x5580c1b18560 2024-09-12T00:19:30.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 --2- 172.21.15.66:0/4222053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb330029540 tx=0x7fb33002acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f179af5891eac2e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb20ffff640 1 -- 172.21.15.66:0/4222053611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33001f340 con 0x5580c1b18560 2024-09-12T00:19:30.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb20ffff640 1 -- 172.21.15.66:0/4222053611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330013c80 con 0x5580c1b18560 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb20ffff640 1 -- 172.21.15.66:0/4222053611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33001f4e0 con 0x5580c1b18560 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/4222053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 msgr2=0x5580c1b18960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/4222053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb330029540 tx=0x7fb33002acf0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/4222053611 shutdown_connections 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/4222053611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b18960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/4222053611 >> 172.21.15.66:0/4222053611 conn(0x5580c1b13980 msgr2=0x5580c1b11bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/4222053611 shutdown_connections 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/4222053611 wait complete. 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 Processor -- start 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- start start 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb33b40d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5580c1b174b0 con 0x5580c1b18560 2024-09-12T00:19:30.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33554/0 (socket says 172.21.15.66:33554) 2024-09-12T00:19:30.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 learned_addr learned my addr 172.21.15.66:0/90059448 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:30.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c1b1ef20 con 0x5580c1b18560 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb339714640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb330005a20 tx=0x7fb3300508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.789+0000 7fb20e7fc640 1 -- 172.21.15.66:0/90059448 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3300520d0 con 0x5580c1b18560 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c1b1f1b0 con 0x5580c1b18560 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c1b1fb60 con 0x5580c1b18560 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb20e7fc640 1 -- 172.21.15.66:0/90059448 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330052270 con 0x5580c1b18560 2024-09-12T00:19:30.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb20e7fc640 1 -- 172.21.15.66:0/90059448 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33001f6c0 con 0x5580c1b18560 2024-09-12T00:19:30.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb20e7fc640 1 -- 172.21.15.66:0/90059448 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb33001f880 con 0x5580c1b18560 2024-09-12T00:19:30.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb20e7fc640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb204039ac0 0x7fb20403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb20e7fc640 1 -- 172.21.15.66:0/90059448 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb330048040 con 0x5580c1b18560 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338f13640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb204039ac0 0x7fb20403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1b29fc0 0x5580c1b2c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b2cba0 con 0x5580c1b29fc0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1b29fc0 0x5580c1b2c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338f13640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb204039ac0 0x7fb20403bf80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb328017cd0 tx=0x7fb328033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1b29fc0 0x5580c1b2c450 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 realm 2024-09-12T00:19:30.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b2cfd0 con 0x5580c1b29fc0 2024-09-12T00:19:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b2d8a0 con 0x5580c1b29fc0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b2dc40 con 0x5580c1b29fc0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1b2e9a0 0x5580c1b30d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.793+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b313a0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1b2e9a0 0x5580c1b30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1b2e9a0 0x5580c1b30d90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb33b40d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb33b40d9c0 20 searching for the correct realm 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x5580c1b2e9a0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb330014a10 0x7fb3300502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x7fb330014a10 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338f13640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb330014a10 0x7fb3300502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338f13640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb330014a10 0x7fb3300502a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338f13640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb328042100 0x7fb32801d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x7fb328042100 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338712640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb328042100 0x7fb32801d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:30.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338712640 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb328042100 0x7fb32801d790 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:30.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.797+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x5580c1b29fc0 2024-09-12T00:19:30.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x5580c1b29fc0 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x5580c1b29fc0 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x7fb328042100 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32c00 con 0x7fb330014a10 2024-09-12T00:19:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb330014a10 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb330014a10 2024-09-12T00:19:30.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.801+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb328042100 2024-09-12T00:19:30.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb328042100 2024-09-12T00:19:30.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb330014a10 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.805+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb328042100 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb328042100 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb330014a10 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b2e9a0 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb328042100 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x5580c1b29fc0 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb32805a040 con 0x7fb330014a10 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:30.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b31cf0 con 0x5580c1b29fc0 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b32540 con 0x5580c1b29fc0 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.809+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b33030 con 0x5580c1b2e9a0 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 zone default found 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 4 Realm: () 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:30.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 zonegroup default 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b333d0 con 0x7fb328042100 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b351b0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b35690 con 0x5580c1b2e9a0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b34650 con 0x7fb330014a10 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94011493927488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b35fa0 con 0x7fb330014a10 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.813+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b367f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94011493927488] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94011493931760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b367f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b371f0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94011493936384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b37120 con 0x5580c1b2e9a0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b380f0 con 0x7fb330014a10 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.817+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94011493931760] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94011493933888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b384e0 con 0x7fb330014a10 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b38ea0 con 0x5580c1b29fc0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94011493936384] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94011493933888] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94011493940224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b389f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.821+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b392a0 con 0x7fb328042100 2024-09-12T00:19:30.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94011493940224] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94011493938656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b38ea0 con 0x7fb328042100 2024-09-12T00:19:30.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b39cb0 con 0x7fb328042100 2024-09-12T00:19:30.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94011493947392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b3a0d0 con 0x7fb328042100 2024-09-12T00:19:30.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.825+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b3abc0 con 0x7fb328042100 2024-09-12T00:19:30.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94011493938656] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94011493951120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b3ab80 con 0x7fb328042100 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94011493947392] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=0 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=1 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=2 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=3 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=4 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=5 2024-09-12T00:19:30.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=6 2024-09-12T00:19:30.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94011493951120] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x7fb328042100 2024-09-12T00:19:30.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 20 add_watcher() i=7 2024-09-12T00:19:30.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:30.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.829+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b3dbb0 con 0x5580c1b29fc0 2024-09-12T00:19:30.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94011493943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b3b030 con 0x5580c1b29fc0 2024-09-12T00:19:30.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94011493943792] v33'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb1eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:30.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb33b40d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:30.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb33b40d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:30.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b463a0 con 0x5580c1b29fc0 2024-09-12T00:19:30.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.833+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'55 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32c0a99f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.837+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b463a0 con 0x7fb328042100 2024-09-12T00:19:30.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.837+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.837+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b46f20 con 0x5580c1b2e9a0 2024-09-12T00:19:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.837+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.837+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b449b0 con 0x5580c1b29fc0 2024-09-12T00:19:30.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'180 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b44e10 con 0x7fb330014a10 2024-09-12T00:19:30.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'66 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47a80 con 0x5580c1b2e9a0 2024-09-12T00:19:30.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.841+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47a80 con 0x5580c1b29fc0 2024-09-12T00:19:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.845+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.845+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47a80 con 0x7fb328042100 2024-09-12T00:19:30.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.845+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.845+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47a80 con 0x7fb330014a10 2024-09-12T00:19:30.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.849+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.849+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48030 con 0x5580c1b2e9a0 2024-09-12T00:19:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.849+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.849+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb330014a10 2024-09-12T00:19:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.853+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'67 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.853+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb328042100 2024-09-12T00:19:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.853+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.853+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb330014a10 2024-09-12T00:19:30.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.857+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.857+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb328042100 2024-09-12T00:19:30.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.857+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.857+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b29fc0 2024-09-12T00:19:30.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'181 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb330014a10 2024-09-12T00:19:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'68 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.861+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.865+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.865+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b29fc0 2024-09-12T00:19:30.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.865+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.865+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b29fc0 2024-09-12T00:19:30.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.869+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'182 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.869+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.869+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.869+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fa0 con 0x7fb330014a10 2024-09-12T00:19:30.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.873+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.873+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b47fe0 con 0x5580c1b2e9a0 2024-09-12T00:19:30.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.873+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.873+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48050 con 0x5580c1b2e9a0 2024-09-12T00:19:30.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.877+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.877+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48090 con 0x5580c1b2e9a0 2024-09-12T00:19:30.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.877+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.877+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48090 con 0x5580c1b2e9a0 2024-09-12T00:19:30.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.881+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.881+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b480d0 con 0x7fb328042100 2024-09-12T00:19:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.881+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.881+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48110 con 0x5580c1b2e9a0 2024-09-12T00:19:30.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.885+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.885+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48110 con 0x7fb328042100 2024-09-12T00:19:30.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.885+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.885+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48110 con 0x5580c1b2e9a0 2024-09-12T00:19:30.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.889+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.889+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48110 con 0x7fb328042100 2024-09-12T00:19:30.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.889+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'60 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.889+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b48150 con 0x7fb330014a10 2024-09-12T00:19:30.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb1edfe3640 20 reqs_thread_entry: start 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb33b40d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb33b40d9c0 20 Filter name: none 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb15f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb33b40d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb33b40d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:30.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.893+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b43db0 con 0x5580c1b29fc0 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:30.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b65d40 con 0x7fb330014a10 2024-09-12T00:19:30.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.901 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T00:19:30.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb1eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:30.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94011493943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b407f0 con 0x5580c1b29fc0 2024-09-12T00:19:30.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94011493943792] v33'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.897+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94011493927488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b389f0 con 0x7fb330014a10 2024-09-12T00:19:30.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.901+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94011493927488] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.901+0000 7fb33b40d9c0 20 remove_watcher() i=0 2024-09-12T00:19:30.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.901+0000 7fb33b40d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:30.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.901+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94011493931760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b34a40 con 0x5580c1b29fc0 2024-09-12T00:19:30.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94011493931760] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb33b40d9c0 20 remove_watcher() i=1 2024-09-12T00:19:30.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94011493936384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b34a40 con 0x5580c1b2e9a0 2024-09-12T00:19:30.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb339714640 1 -- 172.21.15.66:0/90059448 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94011493936384] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb330039020 con 0x5580c1b2e9a0 2024-09-12T00:19:30.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb33b40d9c0 20 remove_watcher() i=2 2024-09-12T00:19:30.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94011493933888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b34a40 con 0x7fb330014a10 2024-09-12T00:19:30.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.905+0000 7fb338f13640 1 -- 172.21.15.66:0/90059448 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94011493933888] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32802e070 con 0x7fb330014a10 2024-09-12T00:19:30.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.909+0000 7fb33b40d9c0 20 remove_watcher() i=3 2024-09-12T00:19:30.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.909+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94011493940224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b36340 con 0x5580c1b29fc0 2024-09-12T00:19:30.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.909+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94011493940224] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x5580c1b29fc0 2024-09-12T00:19:30.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.909+0000 7fb33b40d9c0 20 remove_watcher() i=4 2024-09-12T00:19:30.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.909+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94011493938656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b34a40 con 0x7fb328042100 2024-09-12T00:19:30.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94011493938656] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb33b40d9c0 20 remove_watcher() i=5 2024-09-12T00:19:30.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94011493947392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b37c00 con 0x7fb328042100 2024-09-12T00:19:30.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94011493947392] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb33b40d9c0 20 remove_watcher() i=6 2024-09-12T00:19:30.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.913+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94011493951120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5580c1b36340 con 0x7fb328042100 2024-09-12T00:19:30.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94011493951120] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb32c0d5040 con 0x7fb328042100 2024-09-12T00:19:30.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 20 remove_watcher() i=7 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb328042100 msgr2=0x7fb32801d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb328042100 0x7fb32801d790 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1b29fc0 msgr2=0x5580c1b2c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1b29fc0 0x5580c1b2c450 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb330014a10 msgr2=0x7fb3300502a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb330014a10 0x7fb3300502a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1b2e9a0 msgr2=0x5580c1b30d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1b2e9a0 0x5580c1b30d90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb204039ac0 msgr2=0x7fb20403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb204039ac0 0x7fb20403bf80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb328017cd0 tx=0x7fb328033000 comp rx=0 tx=0).stop 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb338712640 1 -- 172.21.15.66:0/90059448 reap_dead start 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 msgr2=0x5580c1b1e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb330005a20 tx=0x7fb3300508b0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 shutdown_connections 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/90059448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b18560 0x5580c1b1e9c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 >> 172.21.15.66:0/90059448 conn(0x5580c1b13980 msgr2=0x5580c1b11b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 shutdown_connections 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/90059448 wait complete. 2024-09-12T00:19:30.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 msgr2=0x7fb21003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 0x7fb21003bf30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5580c1af18f0 tx=0x7fb32800ff40 comp rx=0 tx=0).stop 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 msgr2=0x5580c1b0afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x5580c1af0dd0 tx=0x7fb3300167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 shutdown_connections 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb210039a70 0x7fb21003bf30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1496569498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c1b0ab90 0x5580c1b0afb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 >> 172.21.15.66:0/1496569498 conn(0x5580c1b00540 msgr2=0x5580c1b00920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 shutdown_connections 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1496569498 wait complete. 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 msgr2=0x5580c1af71c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 0x5580c1af71c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 msgr2=0x5580c1afbde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 0x5580c1afbde0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 msgr2=0x7fb22003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 0x7fb22003bf80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 msgr2=0x5580c1af0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x5580c1ae99a0 tx=0x7fb328000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 shutdown_connections 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5580c1af99f0 0x5580c1afbde0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5580c1a018c0 0x5580c1af71c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb220039ac0 0x7fb22003bf80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 --2- 172.21.15.66:0/1279704754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5580c19fd770 0x5580c1af0050 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 >> 172.21.15.66:0/1279704754 conn(0x5580c1971080 msgr2=0x5580c1ae30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 shutdown_connections 2024-09-12T00:19:30.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:30.917+0000 7fb33b40d9c0 1 -- 172.21.15.66:0/1279704754 wait complete. 2024-09-12T00:19:30.936 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T00:19:30.950 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-12T00:19:30.956 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.003 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.023 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.073 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T00:19:31.085 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T00:19:31.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T00:19:31.085 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T00:19:31.126 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:31.126 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:31.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.121+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.121+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.121+0000 7fbc3f68d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55996e7087b0 0x55996e797160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.121+0000 7fbc3f68d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55996e6489c0 con 0x55996e7976a0 2024-09-12T00:19:31.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.121+0000 7fbc3f68d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55996e6986d0 con 0x55996e7087b0 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3d193640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55996e7087b0 0x55996e797160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3c992640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55996e7976a0 0x55996e799a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38326/0 (socket says 172.21.15.66:38326) 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3d193640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55996e7087b0 0x55996e797160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33556/0 (socket says 172.21.15.66:33556) 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3c992640 1 -- 172.21.15.66:0/1587985524 learned_addr learned my addr 172.21.15.66:0/1587985524 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3d193640 1 -- 172.21.15.66:0/1587985524 >> v1:172.21.15.31:6789/0 conn(0x55996e7976a0 legacy=0x55996e799a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3d193640 1 -- 172.21.15.66:0/1587985524 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e63cca0 con 0x55996e7087b0 2024-09-12T00:19:31.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc3d193640 1 --2- 172.21.15.66:0/1587985524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e797160 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a420 tx=0x7fbc3801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1315d3e1aff0494 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc2ffff640 1 -- 172.21.15.66:0/1587985524 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380b0070 con 0x55996e7087b0 2024-09-12T00:19:31.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc2ffff640 1 -- 172.21.15.66:0/1587985524 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380a3dc0 con 0x55996e7087b0 2024-09-12T00:19:31.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.125+0000 7fbc2ffff640 1 -- 172.21.15.66:0/1587985524 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380ab570 con 0x55996e7087b0 2024-09-12T00:19:31.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1587985524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 msgr2=0x55996e797160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1587985524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e797160 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800a420 tx=0x7fbc3801afd0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1587985524 shutdown_connections 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1587985524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e797160 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1587985524 >> 172.21.15.66:0/1587985524 conn(0x55996e78ee90 msgr2=0x55996e7912b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1587985524 shutdown_connections 2024-09-12T00:19:31.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.129+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1587985524 wait complete. 2024-09-12T00:19:31.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3f68d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3f68d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55996e69c680 con 0x55996e7087b0 2024-09-12T00:19:31.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3d193640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3d193640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33558/0 (socket says 172.21.15.66:33558) 2024-09-12T00:19:31.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3d193640 1 -- 172.21.15.66:0/2606683118 learned_addr learned my addr 172.21.15.66:0/2606683118 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3d193640 1 -- 172.21.15.66:0/2606683118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e617da0 con 0x55996e7087b0 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbc3d193640 1 --2- 172.21.15.66:0/2606683118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbc38017be0 tx=0x7fbc380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5db0f3e0a22dfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbb2b606640 1 -- 172.21.15.66:0/2606683118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380b0040 con 0x55996e7087b0 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbb2b606640 1 -- 172.21.15.66:0/2606683118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380ab5f0 con 0x55996e7087b0 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.145+0000 7fbb2b606640 1 -- 172.21.15.66:0/2606683118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380ab910 con 0x55996e7087b0 2024-09-12T00:19:31.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/2606683118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 msgr2=0x55996e87f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/2606683118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbc38017be0 tx=0x7fbc380033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/2606683118 shutdown_connections 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/2606683118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e87f8f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/2606683118 >> 172.21.15.66:0/2606683118 conn(0x55996e78ee90 msgr2=0x55996e87b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/2606683118 shutdown_connections 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/2606683118 wait complete. 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55996e63ea50 con 0x55996e7087b0 2024-09-12T00:19:31.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3d193640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3d193640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33560/0 (socket says 172.21.15.66:33560) 2024-09-12T00:19:31.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3d193640 1 -- 172.21.15.66:0/1281666260 learned_addr learned my addr 172.21.15.66:0/1281666260 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3d193640 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e794da0 con 0x55996e7087b0 2024-09-12T00:19:31.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3d193640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbc38017be0 tx=0x7fbc38017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbb29e03640 1 -- 172.21.15.66:0/1281666260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380b0040 con 0x55996e7087b0 2024-09-12T00:19:31.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55996e793180 con 0x55996e7087b0 2024-09-12T00:19:31.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbb29e03640 1 -- 172.21.15.66:0/1281666260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc380b4750 con 0x55996e7087b0 2024-09-12T00:19:31.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbb29e03640 1 -- 172.21.15.66:0/1281666260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc380b4a50 con 0x55996e7087b0 2024-09-12T00:19:31.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.149+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996e7936b0 con 0x55996e7087b0 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbb29e03640 1 -- 172.21.15.66:0/1281666260 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc380cd060 con 0x55996e7087b0 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbb29e03640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 0x7fbb2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbb29e03640 1 -- 172.21.15.66:0/1281666260 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbc380ea7d0 con 0x55996e7087b0 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3c992640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 0x7fbb2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 0x55996e890200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e890740 con 0x55996e7976a0 2024-09-12T00:19:31.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d994640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 0x55996e890200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3c992640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 0x7fbb2403bf30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc34004180 tx=0x7fbc34001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d994640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 0x55996e890200 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d994640 1 -- 172.21.15.66:0/1281666260 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc300083f0 con 0x55996e7976a0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e890b20 con 0x55996e7976a0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d994640 1 -- 172.21.15.66:0/1281666260 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc300083f0 con 0x55996e7976a0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 0x55996e894d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e895410 con 0x55996e892930 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d193640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 0x55996e894d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d193640 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 0x55996e894d20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d193640 1 -- 172.21.15.66:0/1281666260 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc380ba070 con 0x55996e892930 2024-09-12T00:19:31.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8917a0 con 0x55996e7976a0 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d994640 1 -- 172.21.15.66:0/1281666260 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc300083f0 con 0x55996e7976a0 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e891c80 con 0x55996e892930 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.153+0000 7fbc3d193640 1 -- 172.21.15.66:0/1281666260 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc380ba070 con 0x55996e892930 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55996e6a9450 con 0x55996e8a3b40 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33568/0 (socket says 172.21.15.66:33568) 2024-09-12T00:19:31.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d994640 1 -- 172.21.15.66:0/3560809570 learned_addr learned my addr 172.21.15.66:0/3560809570 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d994640 1 -- 172.21.15.66:0/3560809570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e8a45a0 con 0x55996e8a3b40 2024-09-12T00:19:31.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d994640 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55996e7938a0 tx=0x7fbc3000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 -- 172.21.15.66:0/3560809570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3001c020 con 0x55996e8a3b40 2024-09-12T00:19:31.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 -- 172.21.15.66:0/3560809570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc30007d00 con 0x55996e8a3b40 2024-09-12T00:19:31.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55996e8a4e00 con 0x55996e8a3b40 2024-09-12T00:19:31.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 -- 172.21.15.66:0/3560809570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30018440 con 0x55996e8a3b40 2024-09-12T00:19:31.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996e8a5370 con 0x55996e8a3b40 2024-09-12T00:19:31.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 -- 172.21.15.66:0/3560809570 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc3001f020 con 0x55996e8a3b40 2024-09-12T00:19:31.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 0x7fbb1403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbb22ffd640 1 -- 172.21.15.66:0/3560809570 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbc30051e10 con 0x55996e8a3b40 2024-09-12T00:19:31.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.157+0000 7fbc3d193640 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 0x7fbb1403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d193640 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 0x7fbb1403bf80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55996e793a30 tx=0x7fbc380e7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55996e880060 con 0x55996e8b1430 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33584/0 (socket says 172.21.15.66:33584) 2024-09-12T00:19:31.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 -- 172.21.15.66:0/221940674 learned_addr learned my addr 172.21.15.66:0/221940674 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 -- 172.21.15.66:0/221940674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e8b1e20 con 0x55996e8b1430 2024-09-12T00:19:31.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 --2- 172.21.15.66:0/221940674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbc30021fd0 tx=0x7fbc30050360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a0d28ef83f73e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbb20ff9640 1 -- 172.21.15.66:0/221940674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30021530 con 0x55996e8b1430 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbb20ff9640 1 -- 172.21.15.66:0/221940674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300166f0 con 0x55996e8b1430 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbb20ff9640 1 -- 172.21.15.66:0/221940674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30029c50 con 0x55996e8b1430 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/221940674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 msgr2=0x55996e8b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/221940674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbc30021fd0 tx=0x7fbc30050360 comp rx=0 tx=0).stop 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/221940674 shutdown_connections 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/221940674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b1830 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/221940674 >> 172.21.15.66:0/221940674 conn(0x55996e8ac850 msgr2=0x55996e8aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/221940674 shutdown_connections 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/221940674 wait complete. 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 Processor -- start 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- start start 2024-09-12T00:19:31.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3f68d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55996e8b0380 con 0x55996e8b1430 2024-09-12T00:19:31.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33600/0 (socket says 172.21.15.66:33600) 2024-09-12T00:19:31.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.161+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 learned_addr learned my addr 172.21.15.66:0/198725285 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996e8b7e40 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3d994640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbc300164a0 tx=0x7fbc30050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 -- 172.21.15.66:0/198725285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30039070 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 -- 172.21.15.66:0/198725285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300206f0 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55996e8b80d0 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 -- 172.21.15.66:0/198725285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300178b0 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996e8b8a80 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 -- 172.21.15.66:0/198725285 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbc30057060 con 0x55996e8b1430 2024-09-12T00:19:31.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb08039b10 0x7fbb0803bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbb12ffd640 1 -- 172.21.15.66:0/198725285 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbc30055070 con 0x55996e8b1430 2024-09-12T00:19:31.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e8c2ed0 0x55996e8c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8c5a90 con 0x55996e8c2ed0 2024-09-12T00:19:31.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3c992640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e8c2ed0 0x55996e8c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.165+0000 7fbc3c992640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e8c2ed0 0x55996e8c5340 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc3400e640 con 0x55996e8c2ed0 2024-09-12T00:19:31.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 realm 2024-09-12T00:19:31.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8c22a0 con 0x55996e8c2ed0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc3400e640 con 0x55996e8c2ed0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8c6590 con 0x55996e8c2ed0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc3400e640 con 0x55996e8c2ed0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8c6e60 con 0x55996e8c2ed0 2024-09-12T00:19:31.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc3400e640 con 0x55996e8c2ed0 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e8c7880 0x55996e8c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ca340 con 0x55996e8c7880 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e8c7880 0x55996e8c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e8c7880 0x55996e8c9c70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 20 searching for the correct realm 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbc30021020 0x7fbc30017a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d193640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbc30021020 0x7fbc30017a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d193640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbc30021020 0x7fbc30017a70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d193640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbc380cf070 0x7fbc380ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.169+0000 7fbc3c992640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbc380cf070 0x7fbc380ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbc380cf070 0x7fbc380ea0b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3400e640 con 0x7fbc380cf070 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3400e640 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.173+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.177+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x55996e8c2ed0 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c7880 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc380cf070 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc34029040 con 0x7fbc380cf070 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x55996e8c2ed0 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cbc10 con 0x7fbc30021020 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:31.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.181+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cacc0 con 0x55996e8c2ed0 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cb560 con 0x55996e8c2ed0 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cc040 con 0x55996e8c7880 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 zone default found 2024-09-12T00:19:31.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 4 Realm: () 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 zonegroup default 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cc3e0 con 0x7fbc380cf070 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ce1f0 con 0x55996e8c7880 2024-09-12T00:19:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ce650 con 0x55996e8c7880 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:31.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cd660 con 0x7fbc30021020 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117473079728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ce650 con 0x7fbc30021020 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.185+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ceea0 con 0x55996e8c2ed0 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.189+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117473079728] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.189+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.189+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117473085936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cf2c0 con 0x55996e8c2ed0 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.189+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cfc80 con 0x55996e8c7880 2024-09-12T00:19:31.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117473085936] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117473087264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8cfc80 con 0x55996e8c7880 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d0640 con 0x7fbc30021020 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117473091984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d0a60 con 0x7fbc30021020 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d14b0 con 0x55996e8c2ed0 2024-09-12T00:19:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117473087264] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117473091984] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.193+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117473095584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d05b0 con 0x55996e8c2ed0 2024-09-12T00:19:31.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d1d50 con 0x7fbc380cf070 2024-09-12T00:19:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117473095584] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117473089488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d05b0 con 0x7fbc380cf070 2024-09-12T00:19:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.197+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d2240 con 0x7fbc380cf070 2024-09-12T00:19:31.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3d193640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb08039b10 0x7fbb0803bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117473089488] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3d193640 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb08039b10 0x7fbb0803bfd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55996e8c6cd0 tx=0x7fbc380f8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117473099056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d2200 con 0x7fbc380cf070 2024-09-12T00:19:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d2bc0 con 0x7fbc380cf070 2024-09-12T00:19:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117473099056] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117473097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d2bc0 con 0x7fbc380cf070 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=0 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=1 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=2 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=3 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=4 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=5 2024-09-12T00:19:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.201+0000 7fbc3f68d9c0 20 add_watcher() i=6 2024-09-12T00:19:31.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117473097488] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 add_watcher() i=7 2024-09-12T00:19:31.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:31.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d5ff0 con 0x55996e8c2ed0 2024-09-12T00:19:31.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117473102048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8d3540 con 0x55996e8c2ed0 2024-09-12T00:19:31.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117473102048] v33'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbaf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:31.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:31.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 5 note: GC not initialized 2024-09-12T00:19:31.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbaf27e4640 20 reqs_thread_entry: start 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 Filter name: none 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fba63fff640 20 reqs_thread_entry: start 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.205+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8f9c70 con 0x7fbc30021020 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 : miss 2024-09-12T00:19:31.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.17 8:eb1f9594:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8fb800 con 0x55996e8c2ed0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 info.flags=0x17 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 to cache LRU end 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 20 get_obj_state: octx=0x7fbc380e8bb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55996e8fdef8 s->prefetch_data=0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 3.1as0 3:5b68eaaa:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x55996e8c2ed0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 10 manifest: total_size = 5 2024-09-12T00:19:31.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 20 get_obj_state: setting s->obj_tag to _7mnv_eYM2xOLzBfG0uQw_R0wO6OVICq 2024-09-12T00:19:31.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbaf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117473102048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x55996e8c2ed0 2024-09-12T00:19:31.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94117473102048] v33'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.209+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117473079728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x7fbc30021020 2024-09-12T00:19:31.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94117473079728] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3f68d9c0 20 remove_watcher() i=0 2024-09-12T00:19:31.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3f68d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:31.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117473085936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x55996e8c2ed0 2024-09-12T00:19:31.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94117473085936] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3f68d9c0 20 remove_watcher() i=1 2024-09-12T00:19:31.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.213+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117473087264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x55996e8c7880 2024-09-12T00:19:31.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3d994640 1 -- 172.21.15.66:0/198725285 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94117473087264] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3003b030 con 0x55996e8c7880 2024-09-12T00:19:31.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3f68d9c0 20 remove_watcher() i=2 2024-09-12T00:19:31.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117473091984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x7fbc30021020 2024-09-12T00:19:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3d193640 1 -- 172.21.15.66:0/198725285 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94117473091984] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc380ba070 con 0x7fbc30021020 2024-09-12T00:19:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3f68d9c0 20 remove_watcher() i=3 2024-09-12T00:19:31.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.217+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117473095584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x55996e8c2ed0 2024-09-12T00:19:31.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94117473095584] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x55996e8c2ed0 2024-09-12T00:19:31.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3f68d9c0 20 remove_watcher() i=4 2024-09-12T00:19:31.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117473089488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x7fbc380cf070 2024-09-12T00:19:31.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94117473089488] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3f68d9c0 20 remove_watcher() i=5 2024-09-12T00:19:31.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.221+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117473099056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x7fbc380cf070 2024-09-12T00:19:31.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94117473099056] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 20 remove_watcher() i=6 2024-09-12T00:19:31.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117473097488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55996e8ff1e0 con 0x7fbc380cf070 2024-09-12T00:19:31.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94117473097488] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc34039040 con 0x7fbc380cf070 2024-09-12T00:19:31.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 20 remove_watcher() i=7 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbc380cf070 msgr2=0x7fbc380ea0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fbc380cf070 0x7fbc380ea0b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e8c2ed0 msgr2=0x55996e8c5340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e8c2ed0 0x55996e8c5340 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbc30021020 msgr2=0x7fbc30017a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fbc30021020 0x7fbc30017a70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e8c7880 msgr2=0x55996e8c9c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e8c7880 0x55996e8c9c70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb08039b10 msgr2=0x7fbb0803bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb08039b10 0x7fbb0803bfd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55996e8c6cd0 tx=0x7fbc380f8040 comp rx=0 tx=0).stop 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 msgr2=0x55996e8b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3c992640 1 -- 172.21.15.66:0/198725285 reap_dead start 2024-09-12T00:19:31.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbc300164a0 tx=0x7fbc30050040 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 shutdown_connections 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/198725285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8b1430 0x55996e8b78e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 >> 172.21.15.66:0/198725285 conn(0x55996e8ac850 msgr2=0x55996e8aaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 shutdown_connections 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.225+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/198725285 wait complete. 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 msgr2=0x7fbb1403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 0x7fbb1403bf80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55996e793a30 tx=0x7fbc380e7040 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 msgr2=0x55996e8a3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x55996e7938a0 tx=0x7fbc3000bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 shutdown_connections 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb14039ac0 0x7fbb1403bf80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/3560809570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e8a3b40 0x55996e8a3f60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 >> 172.21.15.66:0/3560809570 conn(0x55996e8994f0 msgr2=0x55996e8998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 shutdown_connections 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/3560809570 wait complete. 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 msgr2=0x55996e890200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 0x55996e890200 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 msgr2=0x55996e894d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 0x55996e894d20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 msgr2=0x7fbb2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 0x7fbb2403bf30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc34004180 tx=0x7fbc34001340 comp rx=0 tx=0).stop 2024-09-12T00:19:31.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 msgr2=0x55996e794840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbc38017be0 tx=0x7fbc38017d70 comp rx=0 tx=0).stop 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 shutdown_connections 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55996e892930 0x55996e894d20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55996e7976a0 0x55996e890200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbb24039a70 0x7fbb2403bf30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 --2- 172.21.15.66:0/1281666260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55996e7087b0 0x55996e794840 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 >> 172.21.15.66:0/1281666260 conn(0x55996e78ee90 msgr2=0x55996e87a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 shutdown_connections 2024-09-12T00:19:31.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.229+0000 7fbc3f68d9c0 1 -- 172.21.15.66:0/1281666260 wait complete. 2024-09-12T00:19:31.244 INFO:teuthology.orchestra.run.smithi066.stdout:fooFoofooFooFULL_CONTROL 2024-09-12T00:19:31.244 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-12T00:19:31.247 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-12T00:19:31.253 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T00:19:31.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T00:19:31.254 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T00:19:31.332 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:31.332 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:31.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0412a539c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555e4357c6c0 0x555e4357eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0412a539c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e4342c9c0 con 0x555e43578520 2024-09-12T00:19:31.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0412a539c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555e4347c6d0 con 0x555e4357c6c0 2024-09-12T00:19:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f040fd58640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555e4357c6c0 0x555e4357eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f040fd58640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555e4357c6c0 0x555e4357eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33612/0 (socket says 172.21.15.66:33612) 2024-09-12T00:19:31.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f040fd58640 1 -- 172.21.15.66:0/1888436676 learned_addr learned my addr 172.21.15.66:0/1888436676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f0410559640 1 --1- 172.21.15.66:0/1888436676 >> v1:172.21.15.31:6789/0 conn(0x555e43578520 0x555e43578900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38336/0 (socket says 172.21.15.66:38336) 2024-09-12T00:19:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f040fd58640 1 -- 172.21.15.66:0/1888436676 >> v1:172.21.15.31:6789/0 conn(0x555e43578520 legacy=0x555e43578900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.329+0000 7f040fd58640 1 -- 172.21.15.66:0/1888436676 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e43420ca0 con 0x555e4357c6c0 2024-09-12T00:19:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f040fd58640 1 --2- 172.21.15.66:0/1888436676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e4357c6c0 0x555e4357eab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f03f800a5c0 tx=0x7f03f801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2747c848163d6867 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f040f557640 1 -- 172.21.15.66:0/1888436676 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f80a9590 con 0x555e4357c6c0 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f040f557640 1 -- 172.21.15.66:0/1888436676 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f80ae070 con 0x555e4357c6c0 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f040f557640 1 -- 172.21.15.66:0/1888436676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f80a9880 con 0x555e4357c6c0 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 -- 172.21.15.66:0/1888436676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e4357c6c0 msgr2=0x555e4357eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1888436676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e4357c6c0 0x555e4357eab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f03f800a5c0 tx=0x7f03f801b3d0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 -- 172.21.15.66:0/1888436676 shutdown_connections 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1888436676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e4357c6c0 0x555e4357eab0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 -- 172.21.15.66:0/1888436676 >> 172.21.15.66:0/1888436676 conn(0x555e43574040 msgr2=0x555e43576460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 -- 172.21.15.66:0/1888436676 shutdown_connections 2024-09-12T00:19:31.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.333+0000 7f0412a539c0 1 -- 172.21.15.66:0/1888436676 wait complete. 2024-09-12T00:19:31.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0412a539c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0412a539c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e43480680 con 0x555e43578520 2024-09-12T00:19:31.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0410559640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0410559640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33616/0 (socket says 172.21.15.66:33616) 2024-09-12T00:19:31.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0410559640 1 -- 172.21.15.66:0/3751829191 learned_addr learned my addr 172.21.15.66:0/3751829191 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.349+0000 7f0410559640 1 -- 172.21.15.66:0/3751829191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e433fbda0 con 0x555e43578520 2024-09-12T00:19:31.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 --2- 172.21.15.66:0/3751829191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f040000b270 tx=0x7f040000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5716d92fddbfb7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fe60c640 1 -- 172.21.15.66:0/3751829191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040000e5d0 con 0x555e43578520 2024-09-12T00:19:31.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fe60c640 1 -- 172.21.15.66:0/3751829191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040000e770 con 0x555e43578520 2024-09-12T00:19:31.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fe60c640 1 -- 172.21.15.66:0/3751829191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040000ea70 con 0x555e43578520 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/3751829191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 msgr2=0x555e436638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 --2- 172.21.15.66:0/3751829191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f040000b270 tx=0x7f040000b670 comp rx=0 tx=0).stop 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/3751829191 shutdown_connections 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 --2- 172.21.15.66:0/3751829191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e436638b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/3751829191 >> 172.21.15.66:0/3751829191 conn(0x555e43574040 msgr2=0x555e4365f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/3751829191 shutdown_connections 2024-09-12T00:19:31.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/3751829191 wait complete. 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e43422a50 con 0x555e43578520 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33618/0 (socket says 172.21.15.66:33618) 2024-09-12T00:19:31.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 -- 172.21.15.66:0/2903840330 learned_addr learned my addr 172.21.15.66:0/2903840330 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e434ef6c0 con 0x555e43578520 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0410559640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x555e436648a0 tx=0x7f0400000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fce09640 1 -- 172.21.15.66:0/2903840330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040000be70 con 0x555e43578520 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e434edaa0 con 0x555e43578520 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fce09640 1 -- 172.21.15.66:0/2903840330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040000f9f0 con 0x555e43578520 2024-09-12T00:19:31.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f02fce09640 1 -- 172.21.15.66:0/2903840330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040000fd10 con 0x555e43578520 2024-09-12T00:19:31.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.353+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e434ee030 con 0x555e43578520 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f02fce09640 1 -- 172.21.15.66:0/2903840330 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0400017070 con 0x555e43578520 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f02fce09640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 0x7f02f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f02fce09640 1 -- 172.21.15.66:0/2903840330 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0400015020 con 0x555e43578520 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f040fd58640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 0x7f02f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 0x555e43674290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436747d0 con 0x555e4357c6c0 2024-09-12T00:19:31.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410d5a640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 0x555e43674290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f040fd58640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 0x7f02f803bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f03f80ad000 tx=0x7f03f80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410d5a640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 0x555e43674290 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410d5a640 1 -- 172.21.15.66:0/2903840330 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040800a4d0 con 0x555e4357c6c0 2024-09-12T00:19:31.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e43674b90 con 0x555e4357c6c0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410d5a640 1 -- 172.21.15.66:0/2903840330 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f040800a4d0 con 0x555e4357c6c0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 0x555e43678d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e43679480 con 0x555e436769a0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410559640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 0x555e43678d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410559640 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 0x555e43678d90 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0410559640 1 -- 172.21.15.66:0/2903840330 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f040002e070 con 0x555e436769a0 2024-09-12T00:19:31.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.357+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e43675840 con 0x555e4357c6c0 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 -- 172.21.15.66:0/2903840330 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f040800a4d0 con 0x555e4357c6c0 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e43675ce0 con 0x555e436769a0 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410559640 1 -- 172.21.15.66:0/2903840330 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f040002e070 con 0x555e436769a0 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e4348d450 con 0x555e43687bb0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33620/0 (socket says 172.21.15.66:33620) 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 -- 172.21.15.66:0/1329184321 learned_addr learned my addr 172.21.15.66:0/1329184321 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 -- 172.21.15.66:0/1329184321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e43688610 con 0x555e43687bb0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x555e434eed30 tx=0x7f04080167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f02f5ffb640 1 -- 172.21.15.66:0/1329184321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408013640 con 0x555e43687bb0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f02f5ffb640 1 -- 172.21.15.66:0/1329184321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04080137e0 con 0x555e43687bb0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e43688e70 con 0x555e43687bb0 2024-09-12T00:19:31.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f02f5ffb640 1 -- 172.21.15.66:0/1329184321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408013ae0 con 0x555e43687bb0 2024-09-12T00:19:31.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.361+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e436893e0 con 0x555e43687bb0 2024-09-12T00:19:31.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02f5ffb640 1 -- 172.21.15.66:0/1329184321 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0408011040 con 0x555e43687bb0 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02f5ffb640 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 0x7f02e803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02f5ffb640 1 -- 172.21.15.66:0/1329184321 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f040800e040 con 0x555e43687bb0 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410559640 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 0x7f02e803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410559640 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 0x7f02e803bf80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x555e43675810 tx=0x7f040000ff40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0412a539c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0412a539c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e436640e0 con 0x555e43695520 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33636/0 (socket says 172.21.15.66:33636) 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410d5a640 1 -- 172.21.15.66:0/1695032836 learned_addr learned my addr 172.21.15.66:0/1695032836 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410d5a640 1 -- 172.21.15.66:0/1695032836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e43695f10 con 0x555e43695520 2024-09-12T00:19:31.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1695032836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0408005a20 tx=0x7f04080293a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3584b68061fcfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02ef7fe640 1 -- 172.21.15.66:0/1695032836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040801f340 con 0x555e43695520 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02ef7fe640 1 -- 172.21.15.66:0/1695032836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408013c80 con 0x555e43695520 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.365+0000 7f02ef7fe640 1 -- 172.21.15.66:0/1695032836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040801f4e0 con 0x555e43695520 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1695032836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 msgr2=0x555e43695920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1695032836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0408005a20 tx=0x7f04080293a0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1695032836 shutdown_connections 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1695032836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e43695920 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1695032836 >> 172.21.15.66:0/1695032836 conn(0x555e43690940 msgr2=0x555e4368eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1695032836 shutdown_connections 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1695032836 wait complete. 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 Processor -- start 2024-09-12T00:19:31.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- start start 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e43694470 con 0x555e43695520 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0410d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33646/0 (socket says 172.21.15.66:33646) 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 learned_addr learned my addr 172.21.15.66:0/1906329097 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4369c000 con 0x555e43695520 2024-09-12T00:19:31.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0408005a20 tx=0x7f0408050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f02edffb640 1 -- 172.21.15.66:0/1906329097 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0408052110 con 0x555e43695520 2024-09-12T00:19:31.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e4369c290 con 0x555e43695520 2024-09-12T00:19:31.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f02edffb640 1 -- 172.21.15.66:0/1906329097 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04080522b0 con 0x555e43695520 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f02edffb640 1 -- 172.21.15.66:0/1906329097 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f040801f6c0 con 0x555e43695520 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.369+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e4369c290 con 0x555e43695520 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f02edffb640 1 -- 172.21.15.66:0/1906329097 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f040801f860 con 0x555e43695520 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f02edffb640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e0039a70 0x7f02e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f02edffb640 1 -- 172.21.15.66:0/1906329097 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f040804a000 con 0x555e43695520 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0410559640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e0039a70 0x7f02e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e436a6d50 0x555e436a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436a9960 con 0x555e436a6d50 2024-09-12T00:19:31.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e436a6d50 0x555e436a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0410559640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e0039a70 0x7f02e003bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0400017a80 tx=0x7f0400033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e436a6d50 0x555e436a9210 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 realm 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436a9d90 con 0x555e436a6d50 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436aa660 con 0x555e436a6d50 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436aaa00 con 0x555e436a6d50 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436ab760 0x555e436adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436ae160 con 0x555e436ab760 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436ab760 0x555e436adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436ab760 0x555e436adb50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f040800a4d0 con 0x555e436ab760 2024-09-12T00:19:31.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:31.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 20 searching for the correct realm 2024-09-12T00:19:31.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.373+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f040800a4d0 con 0x555e436ab760 2024-09-12T00:19:31.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410d5a640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f040802bb90 0x7f0408019000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410559640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f040802bb90 0x7f0408019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410559640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f040802bb90 0x7f0408019000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410559640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0400042100 0x7f040001d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0400042100 0x7f040001d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0400042100 0x7f040001d7e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.377+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.381+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.385+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436ab760 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f0400042100 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x555e436a6d50 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e436afa30 con 0x7f040802bb90 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436aebe0 con 0x555e436a6d50 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436af430 con 0x555e436a6d50 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436afdd0 con 0x555e436ab760 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 zone default found 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 4 Realm: () 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 zonegroup default 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436b0200 con 0x7f0400042100 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.389+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436b2060 con 0x555e436ab760 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436b2520 con 0x555e436ab760 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 20 started sync module instance, tier type = 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:31.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b14d0 con 0x7f040802bb90 2024-09-12T00:19:31.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93863346376736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b2980 con 0x7f040802bb90 2024-09-12T00:19:31.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b31d0 con 0x555e436a6d50 2024-09-12T00:19:31.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.393+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93863346376736] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93863346378992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b3270 con 0x555e436a6d50 2024-09-12T00:19:31.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b3d90 con 0x555e436ab760 2024-09-12T00:19:31.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93863346378992] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93863346387040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b3d50 con 0x555e436ab760 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.397+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b47a0 con 0x7f040802bb90 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93863346389744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b5040 con 0x7f040802bb90 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b5a40 con 0x555e436a6d50 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93863346387040] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93863346389744] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93863346384160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b4b90 con 0x555e436a6d50 2024-09-12T00:19:31.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.401+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b6310 con 0x7f0400042100 2024-09-12T00:19:31.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93863346384160] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93863346394448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b4b90 con 0x7f0400042100 2024-09-12T00:19:31.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b6800 con 0x7f0400042100 2024-09-12T00:19:31.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93863346394448] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93863346397936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b67c0 con 0x7f0400042100 2024-09-12T00:19:31.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.405+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b71e0 con 0x7f0400042100 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93863346397936] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93863346400464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b71a0 con 0x7f0400042100 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=0 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=1 2024-09-12T00:19:31.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=2 2024-09-12T00:19:31.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=3 2024-09-12T00:19:31.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=4 2024-09-12T00:19:31.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=5 2024-09-12T00:19:31.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=6 2024-09-12T00:19:31.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93863346400464] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x7f0400042100 2024-09-12T00:19:31.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 20 add_watcher() i=7 2024-09-12T00:19:31.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:31.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436ba600 con 0x555e436a6d50 2024-09-12T00:19:31.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.409+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93863346396240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436b7af0 con 0x555e436a6d50 2024-09-12T00:19:31.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93863346396240] v33'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03f80a99e0 con 0x555e436a6d50 2024-09-12T00:19:31.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f02c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 5 note: GC not initialized 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f02c5fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 Filter name: none 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f02beffd640 20 reqs_thread_entry: start 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436de170 con 0x7f040802bb90 2024-09-12T00:19:31.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 : miss 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.17 8:eb1f9594:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436dfc30 con 0x555e436a6d50 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f03f80d52b0 con 0x555e436a6d50 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 info.flags=0x17 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 to cache LRU end 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:31.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 get_obj_state: octx=0x7f0408013eb0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555e436e2328 s->prefetch_data=0 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 3.1as0 3:5b68eaaa:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x555e436a6d50 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f03f80d52b0 con 0x555e436a6d50 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 10 manifest: total_size = 5 2024-09-12T00:19:31.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.413+0000 7f0412a539c0 20 get_obj_state: setting s->obj_tag to _IelVoHD7q8pttme6ZLkJmjzYWryAQvN 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f02c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93863346396240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x555e436a6d50 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93863346396240] v33'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x555e436a6d50 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93863346376736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x7f040802bb90 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93863346376736] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0412a539c0 20 remove_watcher() i=0 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0412a539c0 2 removed watcher, disabling cache 2024-09-12T00:19:31.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.417+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93863346378992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x555e436a6d50 2024-09-12T00:19:31.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93863346378992] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x555e436a6d50 2024-09-12T00:19:31.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f0412a539c0 20 remove_watcher() i=1 2024-09-12T00:19:31.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93863346387040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x555e436ab760 2024-09-12T00:19:31.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f0410d5a640 1 -- 172.21.15.66:0/1906329097 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93863346387040] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040805f040 con 0x555e436ab760 2024-09-12T00:19:31.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f0412a539c0 20 remove_watcher() i=2 2024-09-12T00:19:31.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.421+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93863346389744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x7f040802bb90 2024-09-12T00:19:31.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f0410559640 1 -- 172.21.15.66:0/1906329097 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93863346389744] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040002e070 con 0x7f040802bb90 2024-09-12T00:19:31.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f0412a539c0 20 remove_watcher() i=3 2024-09-12T00:19:31.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93863346384160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x555e436a6d50 2024-09-12T00:19:31.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93863346384160] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x555e436a6d50 2024-09-12T00:19:31.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f0412a539c0 20 remove_watcher() i=4 2024-09-12T00:19:31.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.425+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93863346394448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x7f0400042100 2024-09-12T00:19:31.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93863346394448] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x7f0400042100 2024-09-12T00:19:31.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f0412a539c0 20 remove_watcher() i=5 2024-09-12T00:19:31.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93863346397936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x7f0400042100 2024-09-12T00:19:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93863346397936] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x7f0400042100 2024-09-12T00:19:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f0412a539c0 20 remove_watcher() i=6 2024-09-12T00:19:31.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.429+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93863346400464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e436e3670 con 0x7f0400042100 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93863346400464] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f80d52b0 con 0x7f0400042100 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 20 remove_watcher() i=7 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0400042100 msgr2=0x7f040001d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0400042100 0x7f040001d7e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e436a6d50 msgr2=0x555e436a9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e436a6d50 0x555e436a9210 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f040802bb90 msgr2=0x7f0408019000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f040802bb90 0x7f0408019000 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436ab760 msgr2=0x555e436adb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436ab760 0x555e436adb50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e0039a70 msgr2=0x7f02e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e0039a70 0x7f02e003bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0400017a80 tx=0x7f0400033000 comp rx=0 tx=0).stop 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f040fd58640 1 -- 172.21.15.66:0/1906329097 reap_dead start 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 msgr2=0x555e4369baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0408005a20 tx=0x7f0408050840 comp rx=0 tx=0).stop 2024-09-12T00:19:31.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 shutdown_connections 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1906329097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43695520 0x555e4369baa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 >> 172.21.15.66:0/1906329097 conn(0x555e43690940 msgr2=0x555e4368eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 shutdown_connections 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1906329097 wait complete. 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 msgr2=0x7f02e803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 0x7f02e803bf80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x555e43675810 tx=0x7f040000ff40 comp rx=0 tx=0).stop 2024-09-12T00:19:31.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 msgr2=0x555e43687fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x555e434eed30 tx=0x7f04080167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 shutdown_connections 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02e8039ac0 0x7f02e803bf80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/1329184321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43687bb0 0x555e43687fd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 >> 172.21.15.66:0/1329184321 conn(0x555e4367d560 msgr2=0x555e4367d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 shutdown_connections 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/1329184321 wait complete. 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 msgr2=0x555e43674290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 0x555e43674290 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 msgr2=0x555e43678d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 0x555e43678d90 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 msgr2=0x7f02f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 0x7f02f803bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f03f80ad000 tx=0x7f03f80a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 msgr2=0x555e434ef160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x555e436648a0 tx=0x7f0400000ee0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 shutdown_connections 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e436769a0 0x555e43678d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e4357c6c0 0x555e43674290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f02f8039a70 0x7f02f803bf30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 --2- 172.21.15.66:0/2903840330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e43578520 0x555e434ef160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 >> 172.21.15.66:0/2903840330 conn(0x555e43574040 msgr2=0x555e4365dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 shutdown_connections 2024-09-12T00:19:31.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.433+0000 7f0412a539c0 1 -- 172.21.15.66:0/2903840330 wait complete. 2024-09-12T00:19:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T00:19:31.449 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T00:19:31.452 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-12T00:19:31.472 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:31.543 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T00:19:31.543 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T00:19:31.544 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T00:19:31.544 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T00:19:31.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T00:19:31.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T00:19:31.545 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-12T00:19:31.585 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:31.585 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:31.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9473bc89c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x565311cbe770 0x565311d4f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9473bc89c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565311bfe9c0 con 0x565311cbeb50 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9473bc89c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x565311c4e6d0 con 0x565311cbe770 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f94716ce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x565311cbe770 0x565311d4f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9470ecd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x565311cbeb50 0x565311d51af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38340/0 (socket says 172.21.15.66:38340) 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f94716ce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x565311cbe770 0x565311d4f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33648/0 (socket says 172.21.15.66:33648) 2024-09-12T00:19:31.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f9470ecd640 1 -- 172.21.15.66:0/2749850866 learned_addr learned my addr 172.21.15.66:0/2749850866 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f94716ce640 1 -- 172.21.15.66:0/2749850866 >> v1:172.21.15.31:6789/0 conn(0x565311cbeb50 legacy=0x565311d51af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.581+0000 7f94716ce640 1 -- 172.21.15.66:0/2749850866 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311bf2ca0 con 0x565311cbe770 2024-09-12T00:19:31.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f94716ce640 1 --2- 172.21.15.66:0/2749850866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311d4f5a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f946400a480 tx=0x7f946401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9012b7393c734b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9463fff640 1 -- 172.21.15.66:0/2749850866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640b0070 con 0x565311cbe770 2024-09-12T00:19:31.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9463fff640 1 -- 172.21.15.66:0/2749850866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94640ab540 con 0x565311cbe770 2024-09-12T00:19:31.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9463fff640 1 -- 172.21.15.66:0/2749850866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640ab840 con 0x565311cbe770 2024-09-12T00:19:31.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2749850866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 msgr2=0x565311d4f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2749850866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311d4f5a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f946400a480 tx=0x7f946401b280 comp rx=0 tx=0).stop 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2749850866 shutdown_connections 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2749850866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311d4f5a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2749850866 >> 172.21.15.66:0/2749850866 conn(0x565311d44e90 msgr2=0x565311d472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2749850866 shutdown_connections 2024-09-12T00:19:31.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.585+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2749850866 wait complete. 2024-09-12T00:19:31.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.601+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.601+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565311c52680 con 0x565311cbe770 2024-09-12T00:19:31.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33664/0 (socket says 172.21.15.66:33664) 2024-09-12T00:19:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 -- 172.21.15.66:0/1079187826 learned_addr learned my addr 172.21.15.66:0/1079187826 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 -- 172.21.15.66:0/1079187826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311bcdda0 con 0x565311cbe770 2024-09-12T00:19:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 --2- 172.21.15.66:0/1079187826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f94640ae040 tx=0x7f9464003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465d5c7d9d52438d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f935f606640 1 -- 172.21.15.66:0/1079187826 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640b0040 con 0x565311cbe770 2024-09-12T00:19:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f935f606640 1 -- 172.21.15.66:0/1079187826 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946400a300 con 0x565311cbe770 2024-09-12T00:19:31.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f935f606640 1 -- 172.21.15.66:0/1079187826 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640ab820 con 0x565311cbe770 2024-09-12T00:19:31.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1079187826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 msgr2=0x565311e37a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1079187826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f94640ae040 tx=0x7f9464003030 comp rx=0 tx=0).stop 2024-09-12T00:19:31.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1079187826 shutdown_connections 2024-09-12T00:19:31.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1079187826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e37a20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1079187826 >> 172.21.15.66:0/1079187826 conn(0x565311d44e90 msgr2=0x565311e336c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1079187826 shutdown_connections 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1079187826 wait complete. 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f9473bc89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565311bf4a50 con 0x565311cbe770 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33672/0 (socket says 172.21.15.66:33672) 2024-09-12T00:19:31.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.605+0000 7f94716ce640 1 -- 172.21.15.66:0/1536215760 learned_addr learned my addr 172.21.15.66:0/1536215760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f94716ce640 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311e3f4c0 con 0x565311cbe770 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f94716ce640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f94640ab510 tx=0x7f9464018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 -- 172.21.15.66:0/1536215760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640b0040 con 0x565311cbe770 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565311e3f750 con 0x565311cbe770 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 -- 172.21.15.66:0/1536215760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94640c0680 con 0x565311cbe770 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565311e40100 con 0x565311cbe770 2024-09-12T00:19:31.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 -- 172.21.15.66:0/1536215760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94640c0960 con 0x565311cbe770 2024-09-12T00:19:31.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 -- 172.21.15.66:0/1536215760 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f94640c0b00 con 0x565311cbe770 2024-09-12T00:19:31.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 0x7f935803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f935de03640 1 -- 172.21.15.66:0/1536215760 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f94640bb070 con 0x565311cbe770 2024-09-12T00:19:31.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9470ecd640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 0x7f935803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 0x565311e460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e46610 con 0x565311cbeb50 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9471ecf640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 0x565311e460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9470ecd640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 0x7f935803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9468001d80 tx=0x7f94680012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9471ecf640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 0x565311e460d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.609+0000 7f9471ecf640 1 -- 172.21.15.66:0/1536215760 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311cbeb50 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e46a10 con 0x565311cbeb50 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 -- 172.21.15.66:0/1536215760 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311cbeb50 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 0x565311e4ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e4b2e0 con 0x565311e48820 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f94716ce640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 0x565311e4ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f94716ce640 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 0x565311e4ac10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f94716ce640 1 -- 172.21.15.66:0/1536215760 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94640b3040 con 0x565311e48820 2024-09-12T00:19:31.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e476c0 con 0x565311cbeb50 2024-09-12T00:19:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 -- 172.21.15.66:0/1536215760 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311cbeb50 2024-09-12T00:19:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e47ba0 con 0x565311e48820 2024-09-12T00:19:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f94716ce640 1 -- 172.21.15.66:0/1536215760 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94640b3040 con 0x565311e48820 2024-09-12T00:19:31.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9473bc89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565311c5f450 con 0x565311e59a30 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33682/0 (socket says 172.21.15.66:33682) 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 -- 172.21.15.66:0/1636932091 learned_addr learned my addr 172.21.15.66:0/1636932091 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.613+0000 7f9471ecf640 1 -- 172.21.15.66:0/1636932091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311e5a490 con 0x565311e59a30 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9471ecf640 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x565311e41090 tx=0x7f946c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 -- 172.21.15.66:0/1636932091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c013640 con 0x565311e59a30 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 -- 172.21.15.66:0/1636932091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c0137e0 con 0x565311e59a30 2024-09-12T00:19:31.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 -- 172.21.15.66:0/1636932091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c013ac0 con 0x565311e59a30 2024-09-12T00:19:31.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565311e5acf0 con 0x565311e59a30 2024-09-12T00:19:31.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565311e5b260 con 0x565311e59a30 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 -- 172.21.15.66:0/1636932091 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f946c011040 con 0x565311e59a30 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 0x7f934803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9356ffd640 1 -- 172.21.15.66:0/1636932091 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f946c00e040 con 0x565311e59a30 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f94716ce640 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 0x7f934803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f94716ce640 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 0x7f934803bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f946401b2c0 tx=0x7f94640c7f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9473bc89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565311e381b0 con 0x565311e672e0 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33688/0 (socket says 172.21.15.66:33688) 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9471ecf640 1 -- 172.21.15.66:0/1117193601 learned_addr learned my addr 172.21.15.66:0/1117193601 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.617+0000 7f9471ecf640 1 -- 172.21.15.66:0/1117193601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311e67cd0 con 0x565311e672e0 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 --2- 172.21.15.66:0/1117193601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f946c0508d0 tx=0x7f946c01fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb5aa62e2b49ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9354ff9640 1 -- 172.21.15.66:0/1117193601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c02a910 con 0x565311e672e0 2024-09-12T00:19:31.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9354ff9640 1 -- 172.21.15.66:0/1117193601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c02a3f0 con 0x565311e672e0 2024-09-12T00:19:31.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9354ff9640 1 -- 172.21.15.66:0/1117193601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c02aab0 con 0x565311e672e0 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1117193601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 msgr2=0x565311e676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1117193601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f946c0508d0 tx=0x7f946c01fd70 comp rx=0 tx=0).stop 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1117193601 shutdown_connections 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1117193601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e676e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1117193601 >> 172.21.15.66:0/1117193601 conn(0x565311e62700 msgr2=0x565311e60940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1117193601 shutdown_connections 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1117193601 wait complete. 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 Processor -- start 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- start start 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e6d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565311e66230 con 0x565311e672e0 2024-09-12T00:19:31.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e6d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e6d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33698/0 (socket says 172.21.15.66:33698) 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 learned_addr learned my addr 172.21.15.66:0/2752604123 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311e6dde0 con 0x565311e672e0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9471ecf640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e6d880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f946c020790 tx=0x7f946c050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9346ffd640 1 -- 172.21.15.66:0/2752604123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c02e070 con 0x565311e672e0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565311e6dde0 con 0x565311e672e0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9346ffd640 1 -- 172.21.15.66:0/2752604123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c045030 con 0x565311e672e0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9346ffd640 1 -- 172.21.15.66:0/2752604123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f946c052200 con 0x565311e672e0 2024-09-12T00:19:31.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.621+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565311e6e3b0 con 0x565311e672e0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9346ffd640 1 -- 172.21.15.66:0/2752604123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f946c03ea80 con 0x565311e672e0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9346ffd640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f933c039a70 0x7f933c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9346ffd640 1 -- 172.21.15.66:0/2752604123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f946c022030 con 0x565311e672e0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f94716ce640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f933c039a70 0x7f933c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311e789f0 0x565311e7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e7b600 con 0x565311e789f0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311e789f0 0x565311e7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f94716ce640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f933c039a70 0x7f933c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f94640bfeb0 tx=0x7f94640dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311e789f0 0x565311e7aeb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f946800e5a0 con 0x565311e789f0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 realm 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e77d40 con 0x565311e789f0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f946800e5a0 con 0x565311e789f0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e7c100 con 0x565311e789f0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f946800e5a0 con 0x565311e789f0 2024-09-12T00:19:31.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e7c9d0 con 0x565311e789f0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f946800e5a0 con 0x565311e789f0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e7d3f0 0x565311e7f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e7fed0 con 0x565311e7d3f0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9471ecf640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e7d3f0 0x565311e7f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.625+0000 7f9471ecf640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e7d3f0 0x565311e7f7e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9473bc89c0 20 searching for the correct realm 2024-09-12T00:19:31.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9471ecf640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f946c033460 0x7f946c0526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f94716ce640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f946c033460 0x7f946c0526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f94716ce640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f946c033460 0x7f946c0526d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f94716ce640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f94640f8040 0x7f94640aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f94640f8040 0x7f94640aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f94640f8040 0x7f94640aa3b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946800e5a0 con 0x7f94640f8040 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946800e5a0 con 0x565311e789f0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.629+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.633+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x565311e789f0 2024-09-12T00:19:31.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.637+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e7d3f0 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f94640f8040 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9468029040 con 0x7f94640f8040 2024-09-12T00:19:31.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x565311e789f0 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x565311e817a0 con 0x7f946c033460 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:31.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e80850 con 0x565311e789f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e810f0 con 0x565311e789f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.641+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e81bd0 con 0x565311e7d3f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:31.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 zone default found 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 4 Realm: () 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 zonegroup default 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e81f70 con 0x7f94640f8040 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e83d80 con 0x565311e7d3f0 2024-09-12T00:19:31.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e84310 con 0x565311e7d3f0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 started sync module instance, tier type = 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e80d00 con 0x7f946c033460 2024-09-12T00:19:31.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94914782704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e84770 con 0x7f946c033460 2024-09-12T00:19:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.645+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e85130 con 0x565311e789f0 2024-09-12T00:19:31.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94914782704016] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94914782710912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e85550 con 0x565311e789f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e85e20 con 0x565311e7d3f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94914782710912] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.649+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94914782711968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e85970 con 0x565311e7d3f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e86870 con 0x7f946c033460 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94914782716800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e867a0 con 0x7f946c033460 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e87770 con 0x565311e789f0 2024-09-12T00:19:31.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94914782711968] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94914782716800] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94914782719072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e87280 con 0x565311e789f0 2024-09-12T00:19:31.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.653+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e88010 con 0x7f94640f8040 2024-09-12T00:19:31.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.657+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94914782719072] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.657+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.657+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94914782713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e87d20 con 0x7f94640f8040 2024-09-12T00:19:31.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.657+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e88570 con 0x7f94640f8040 2024-09-12T00:19:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94914782713024] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94914782722640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e88400 con 0x7f94640f8040 2024-09-12T00:19:31.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e88f20 con 0x7f94640f8040 2024-09-12T00:19:31.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94914782722640] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94914782726640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e88ee0 con 0x7f94640f8040 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=0 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=1 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=2 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=3 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=4 2024-09-12T00:19:31.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=5 2024-09-12T00:19:31.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.661+0000 7f9473bc89c0 20 add_watcher() i=6 2024-09-12T00:19:31.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94914782726640] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 20 add_watcher() i=7 2024-09-12T00:19:31.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:31.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e8c340 con 0x565311e789f0 2024-09-12T00:19:31.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94914782723696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e89800 con 0x565311e789f0 2024-09-12T00:19:31.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94914782723696] v33'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f93277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:31.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:31.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.665+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e94cb0 con 0x565311e789f0 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.669+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.669+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e952c0 con 0x7f94640f8040 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.669+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.669+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e95830 con 0x565311e7d3f0 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e95830 con 0x565311e789f0 2024-09-12T00:19:31.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'189 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e95e00 con 0x7f946c033460 2024-09-12T00:19:31.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'69 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.673+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96370 con 0x565311e7d3f0 2024-09-12T00:19:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.677+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.677+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96370 con 0x565311e789f0 2024-09-12T00:19:31.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.677+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.677+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96400 con 0x7f94640f8040 2024-09-12T00:19:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.681+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.681+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96500 con 0x7f946c033460 2024-09-12T00:19:31.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.681+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.681+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e7d3f0 2024-09-12T00:19:31.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.685+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.685+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f946c033460 2024-09-12T00:19:31.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.685+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'70 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.685+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f94640f8040 2024-09-12T00:19:31.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.689+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'29 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.689+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f946c033460 2024-09-12T00:19:31.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.689+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.689+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f94640f8040 2024-09-12T00:19:31.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.693+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'61 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.693+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e789f0 2024-09-12T00:19:31.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.693+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'190 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.693+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e7d3f0 2024-09-12T00:19:31.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.693+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.697+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f946c033460 2024-09-12T00:19:31.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.697+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'71 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.697+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e7d3f0 2024-09-12T00:19:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.697+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.697+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e789f0 2024-09-12T00:19:31.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.701+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.701+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e789f0 2024-09-12T00:19:31.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.701+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'191 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.701+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x565311e7d3f0 2024-09-12T00:19:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.705+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.705+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96920 con 0x7f946c033460 2024-09-12T00:19:31.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.705+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.705+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96940 con 0x565311e7d3f0 2024-09-12T00:19:31.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96980 con 0x565311e7d3f0 2024-09-12T00:19:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e969c0 con 0x565311e7d3f0 2024-09-12T00:19:31.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.709+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e969c0 con 0x565311e7d3f0 2024-09-12T00:19:31.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.713+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'54 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.713+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a00 con 0x7f94640f8040 2024-09-12T00:19:31.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.713+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.713+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a40 con 0x565311e7d3f0 2024-09-12T00:19:31.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.717+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.717+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a40 con 0x7f94640f8040 2024-09-12T00:19:31.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.717+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.717+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a40 con 0x565311e7d3f0 2024-09-12T00:19:31.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.721+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.721+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a40 con 0x7f94640f8040 2024-09-12T00:19:31.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.721+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.721+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e96a80 con 0x7f946c033460 2024-09-12T00:19:31.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f93267e4640 20 reqs_thread_entry: start 2024-09-12T00:19:31.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:31.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 Filter name: none 2024-09-12T00:19:31.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9297fff640 20 reqs_thread_entry: start 2024-09-12T00:19:31.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311e92ed0 con 0x7f946c033460 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 : miss 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 8.17 8:eb1f9594:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311eb3780 con 0x565311e789f0 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(95 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:19:31.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 info.flags=0x17 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 to cache LRU end 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.725+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 4.33 4:cf0801d8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f30cd0 con 0x7f94640f8040 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(96 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:97 4.1b 4:dada76ab:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f30d10 con 0x7f946c033460 2024-09-12T00:19:31.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(97 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f30d50 con 0x7f94640f8040 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(98 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9473bc89c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:99 4.34 4:2f359211:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f30d50 con 0x7f946c033460 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(99 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.729+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 4.23 4:c5a39451:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f30d50 con 0x7f94640f8040 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(100 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 4.e 4:72a5c678:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f313d0 con 0x7f946c033460 2024-09-12T00:19:31.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(101 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f313d0 con 0x7f94640f8040 2024-09-12T00:19:31.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(102 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:103 4.b 4:d331e081:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f313d0 con 0x7f946c033460 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(103 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f313b0 con 0x7f946c033460 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(104 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [call out=429b] v0'0 uv6 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 4.36 4:6c46444d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f31390 con 0x565311e789f0 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(105 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f31390 con 0x565311e7d3f0 2024-09-12T00:19:31.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(106 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [call out=701b] v0'0 uv15 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.733+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:107 3.17s0 3:e876353b:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2e830 con 0x565311e789f0 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(107 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 10 manifest: total_size = 6 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.1682769930371461238 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 20 prepare_atomic_modification: state is not atomic. state=0x565311eb4008 2024-09-12T00:19:31.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 2024-09-12T00:19:31.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:108 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb8f70 con 0x7f94640f8040 2024-09-12T00:19:31.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(108 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.737+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:109 3.17s0 3:e876353b:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb8f70 con 0x565311e789f0 2024-09-12T00:19:31.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(109 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb9a00 con 0x7f94640f8040 2024-09-12T00:19:31.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:111 3.2s0 3:419b65d7:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311eb9a00 con 0x565311e7d3f0 2024-09-12T00:19:31.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(111 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 10 manifest: total_size = 3 2024-09-12T00:19:31.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.4992231237749081920 2024-09-12T00:19:31.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 20 prepare_atomic_modification: state is not atomic. state=0x565311eb4008 2024-09-12T00:19:31.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 2024-09-12T00:19:31.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.741+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:112 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebe620 con 0x7f94640f8040 2024-09-12T00:19:31.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(110 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9354ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-12T00:19:31.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(112 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:113 3.2s0 3:419b65d7:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb69a0 con 0x565311e7d3f0 2024-09-12T00:19:31.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(113 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:114 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb69a0 con 0x7f94640f8040 2024-09-12T00:19:31.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.745+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:115 3.3es0 3:7e2d96ff:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311eb69a0 con 0x7f94640f8040 2024-09-12T00:19:31.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(115 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 10 manifest: total_size = 4 2024-09-12T00:19:31.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9683908121859950574 2024-09-12T00:19:31.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 20 prepare_atomic_modification: state is not atomic. state=0x565311eb4008 2024-09-12T00:19:31.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 2024-09-12T00:19:31.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:116 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb69a0 con 0x7f946c033460 2024-09-12T00:19:31.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(114 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9347fff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-12T00:19:31.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(116 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.749+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:117 3.3es0 3:7e2d96ff:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb8260 con 0x7f94640f8040 2024-09-12T00:19:31.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(117 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:118 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb69a0 con 0x7f946c033460 2024-09-12T00:19:31.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:119 3.as0 3:50c024e0:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e7d3f0 2024-09-12T00:19:31.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(119 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 10 manifest: total_size = 5 2024-09-12T00:19:31.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.3396169234500854054 2024-09-12T00:19:31.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 20 prepare_atomic_modification: state is not atomic. state=0x565311eb4008 2024-09-12T00:19:31.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 2024-09-12T00:19:31.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.753+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:120 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e7d3f0 2024-09-12T00:19:31.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(118 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9354ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T00:19:31.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(120 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [stat,call,call] v33'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.761 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 3.as0 3:50c024e0:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebb670 con 0x565311e7d3f0 2024-09-12T00:19:31.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(121 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e7d3f0 2024-09-12T00:19:31.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.757+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:123 3.1as0 3:5b68eaaa:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e789f0 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(123 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 10 manifest: total_size = 5 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 20 get_obj_state: setting s->obj_tag to _IelVoHD7q8pttme6ZLkJmjzYWryAQvN 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 20 get_obj_state: octx=0x7f94640c7bd0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x565311eb4008 s->prefetch_data=0 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 20 prepare_atomic_modification: state is not atomic. state=0x565311eb4008 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 2024-09-12T00:19:31.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:124 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e7d3f0 2024-09-12T00:19:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(122 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [stat,call,call] v33'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9347fff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-12T00:19:31.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(124 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [stat,call,call] v33'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.761+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:125 3.1as0 3:5b68eaaa:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebbb20 con 0x565311e789f0 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(125 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:126 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc8b0 con 0x565311e7d3f0 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:127 4.33 4:cf0801d8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc8b0 con 0x7f94640f8040 2024-09-12T00:19:31.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:128 4.1b 4:dada76ab:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ec04b0 con 0x7f946c033460 2024-09-12T00:19:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:129 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc8b0 con 0x7f94640f8040 2024-09-12T00:19:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:130 4.34 4:2f359211:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ec5b40 con 0x7f946c033460 2024-09-12T00:19:31.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:131 4.23 4:c5a39451:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ec8480 con 0x7f94640f8040 2024-09-12T00:19:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:132 4.e 4:72a5c678:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ecade0 con 0x7f946c033460 2024-09-12T00:19:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:133 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ecade0 con 0x7f94640f8040 2024-09-12T00:19:31.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:134 4.b 4:d331e081:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ecfe80 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(127 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(128 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:135 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2ec00 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:136 4.36 4:6c46444d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ecae20 con 0x565311e789f0 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:137 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ed3540 con 0x565311e7d3f0 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(132 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(130 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(129 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(134 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(131 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(133 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(136 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(135 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.765+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(126 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [stat,call,call] v33'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9354ff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(137 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [call out=128b] v0'0 uv19 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:138 4.33 4:cf0801d8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ecae20 con 0x7f94640f8040 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:139 4.1b 4:dada76ab:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2eb60 con 0x7f946c033460 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:140 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebe000 con 0x7f94640f8040 2024-09-12T00:19:31.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:141 4.34 4:2f359211:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ed3500 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:142 4.23 4:c5a39451:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2eb60 con 0x7f94640f8040 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:143 4.e 4:72a5c678:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebe000 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:144 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ed3500 con 0x7f94640f8040 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:145 4.b 4:d331e081:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2eb60 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:146 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebe000 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:147 4.36 4:6c46444d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ed3500 con 0x565311e789f0 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:148 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311f2eb60 con 0x565311e7d3f0 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(139 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(145 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(147 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(146 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(148 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [call out=128b] v0'0 uv19 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(142 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(144 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(141 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(138 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(140 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(143 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebe000 con 0x7f946c033460 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(149 foo.buckets [call] v33'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.769+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f946c033460 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(150 myfoo [call,call,delete] v33'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9473bc89c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9473bc89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94914782915680 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f94640f8040 2024-09-12T00:19:31.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== watch-notify(notify (1) cookie 94914782722640 notify 141733920793 ret 0) ==== 191+0+0 (crc 0 0 0) 0x565311e929f0 con 0x7f94640f8040 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9354ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94914782722640 notifier 4648 bl.length()=149 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(151 notify.6 [notify cookie 94914782915680 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9354ff9640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9334003d70 con 0x7f94640f8040 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== watch-notify(notify_complete (2) cookie 94914782915680 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565311e953f0 con 0x7f94640f8040 2024-09-12T00:19:31.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.773+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:153 8.17 8:eb1f9594:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x565311e789f0 2024-09-12T00:19:31.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(153 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 from cache 2024-09-12T00:19:31.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5, ofs0, ns] 2024-09-12T00:19:31.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94914782902000 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f94640f8040 2024-09-12T00:19:31.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== watch-notify(notify (1) cookie 94914782722640 notify 141733920794 ret 0) ==== 248+0+0 (crc 0 0 0) 0x565311e953f0 con 0x7f94640f8040 2024-09-12T00:19:31.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9347fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94914782722640 notifier 4648 bl.length()=206 2024-09-12T00:19:31.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(154 notify.6 [notify cookie 94914782902000 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9347fff640 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f92a40032d0 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== watch-notify(notify_complete (2) cookie 94914782902000 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565311e95660 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:156 4.33 4:cf0801d8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:157 4.1b 4:dada76ab:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb7110 con 0x7f946c033460 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:158 4.24 4:251a3e55:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb2150 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:159 4.34 4:2f359211:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb2a60 con 0x7f946c033460 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:160 4.23 4:c5a39451:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ed03a0 con 0x7f94640f8040 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:161 4.e 4:72a5c678:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb2150 con 0x7f946c033460 2024-09-12T00:19:31.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:162 4.1c 4:38ce218b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb7110 con 0x7f94640f8040 2024-09-12T00:19:31.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:163 4.b 4:d331e081:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ed03a0 con 0x7f946c033460 2024-09-12T00:19:31.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:164 4.1b 4:db92e7d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb2150 con 0x7f946c033460 2024-09-12T00:19:31.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:165 4.36 4:6c46444d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb2a60 con 0x565311e789f0 2024-09-12T00:19:31.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.777+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:166 4.25 4:a6552706:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311eb7110 con 0x565311e7d3f0 2024-09-12T00:19:31.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== osd_op_reply(161 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.5 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(165 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.9 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== osd_op_reply(159 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.3 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(157 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.1 [delete] v33'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(156 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.0 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 42 ==== osd_op_reply(163 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.7 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== osd_op_reply(162 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.6 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 50 ==== osd_op_reply(158 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.2 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 51 ==== osd_op_reply(160 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.4 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 43 ==== osd_op_reply(164 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.8 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(166 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5.10 [delete] v33'20 uv20 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9473bc89c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 : miss 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9473bc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.781+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:167 6.18 6:1fefe25d:::pubsub..bucket.myfoo%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x565311ed03a0 con 0x7f94640f8040 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 52 ==== osd_op_reply(167 pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9473bc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9473bc89c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 info.flags=0x0 2024-09-12T00:19:31.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9473bc89c0 10 adding default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 to cache LRU end 2024-09-12T00:19:31.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:168 6.18 6:1fefe25d:::pubsub..bucket.myfoo%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f94640f8040 2024-09-12T00:19:31.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 53 ==== osd_op_reply(168 pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5 [delete] v33'31 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.785+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311ebc400 con 0x7f946c033460 2024-09-12T00:19:31.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.789+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 44 ==== osd_op_reply(169 foo.buckets [call] v33'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.789+0000 7f93277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.789+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94914782723696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x565311e789f0 2024-09-12T00:19:31.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.789+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94914782723696] v33'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.789+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94914782704016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x7f946c033460 2024-09-12T00:19:31.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 45 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94914782704016] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9473bc89c0 20 remove_watcher() i=0 2024-09-12T00:19:31.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9473bc89c0 2 removed watcher, disabling cache 2024-09-12T00:19:31.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94914782710912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x565311e789f0 2024-09-12T00:19:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94914782710912] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9473bc89c0 20 remove_watcher() i=1 2024-09-12T00:19:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.793+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94914782711968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x565311e7d3f0 2024-09-12T00:19:31.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f9471ecf640 1 -- 172.21.15.66:0/2752604123 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94914782711968] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f946c00a4d0 con 0x565311e7d3f0 2024-09-12T00:19:31.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f9473bc89c0 20 remove_watcher() i=2 2024-09-12T00:19:31.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94914782716800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x7f946c033460 2024-09-12T00:19:31.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f94716ce640 1 -- 172.21.15.66:0/2752604123 <== osd.2 v2:172.21.15.66:6800/1272812173 46 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94914782716800] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94640d4050 con 0x7f946c033460 2024-09-12T00:19:31.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f9473bc89c0 20 remove_watcher() i=3 2024-09-12T00:19:31.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.797+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94914782719072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x565311e789f0 2024-09-12T00:19:31.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94914782719072] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x565311e789f0 2024-09-12T00:19:31.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9473bc89c0 20 remove_watcher() i=4 2024-09-12T00:19:31.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94914782713024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x7f94640f8040 2024-09-12T00:19:31.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 54 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94914782713024] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9473bc89c0 20 remove_watcher() i=5 2024-09-12T00:19:31.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.801+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94914782722640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x7f94640f8040 2024-09-12T00:19:31.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.805+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 55 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94914782722640] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.805+0000 7f9473bc89c0 20 remove_watcher() i=6 2024-09-12T00:19:31.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.805+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94914782726640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x565311e8b730 con 0x7f94640f8040 2024-09-12T00:19:31.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 <== osd.0 v2:172.21.15.31:6800/3108862692 56 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94914782726640] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9468039040 con 0x7f94640f8040 2024-09-12T00:19:31.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 20 remove_watcher() i=7 2024-09-12T00:19:31.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f94640f8040 msgr2=0x7f94640aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f94640f8040 0x7f94640aa3b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311e789f0 msgr2=0x565311e7aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311e789f0 0x565311e7aeb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f946c033460 msgr2=0x7f946c0526d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f946c033460 0x7f946c0526d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e7d3f0 msgr2=0x565311e7f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e7d3f0 0x565311e7f7e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f933c039a70 msgr2=0x7f933c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f933c039a70 0x7f933c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f94640bfeb0 tx=0x7f94640dc000 comp rx=0 tx=0).stop 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 msgr2=0x565311e6d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/2752604123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e672e0 0x565311e6d880 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f946c020790 tx=0x7f946c050860 comp rx=0 tx=0).stop 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 reap_dead start 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9470ecd640 1 -- 172.21.15.66:0/2752604123 reap_dead start 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 shutdown_connections 2024-09-12T00:19:31.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 >> 172.21.15.66:0/2752604123 conn(0x565311e62700 msgr2=0x565311e60910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 shutdown_connections 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/2752604123 wait complete. 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 msgr2=0x7f934803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 0x7f934803bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f946401b2c0 tx=0x7f94640c7f10 comp rx=0 tx=0).stop 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 msgr2=0x565311e59e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x565311e41090 tx=0x7f946c0167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 shutdown_connections 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9348039ac0 0x7f934803bf80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1636932091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311e59a30 0x565311e59e50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 >> 172.21.15.66:0/1636932091 conn(0x565311e4f3e0 msgr2=0x565311e4f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 shutdown_connections 2024-09-12T00:19:31.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1636932091 wait complete. 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 msgr2=0x565311e460d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 0x565311e460d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 msgr2=0x565311e4ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 0x565311e4ac10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 msgr2=0x7f935803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 0x7f935803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9468001d80 tx=0x7f94680012e0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 msgr2=0x565311e3ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f94640ab510 tx=0x7f9464018020 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 shutdown_connections 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x565311e48820 0x565311e4ac10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x565311cbeb50 0x565311e460d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9358039a70 0x7f935803bf30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 --2- 172.21.15.66:0/1536215760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565311cbe770 0x565311e3ef60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 >> 172.21.15.66:0/1536215760 conn(0x565311d44e90 msgr2=0x565311e32150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 shutdown_connections 2024-09-12T00:19:31.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.809+0000 7f9473bc89c0 1 -- 172.21.15.66:0/1536215760 wait complete. 2024-09-12T00:19:31.828 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T00:19:31.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T00:19:31.828 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-12T00:19:31.913 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:31.913 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e9a419c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d371be6510 0x55d371be68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e9a419c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d371b239c0 con 0x55d371be9650 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e9a419c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55d371b736d0 con 0x55d371be6510 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e7547640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d371be6510 0x55d371be68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e7547640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55d371be6510 0x55d371be68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33708/0 (socket says 172.21.15.66:33708) 2024-09-12T00:19:31.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e7547640 1 -- 172.21.15.66:0/2295553192 learned_addr learned my addr 172.21.15.66:0/2295553192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e7547640 1 -- 172.21.15.66:0/2295553192 >> v1:172.21.15.31:6789/0 conn(0x55d371be9650 legacy=0x55d371be9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.909+0000 7fe4e7547640 1 -- 172.21.15.66:0/2295553192 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371b17ca0 con 0x55d371be6510 2024-09-12T00:19:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2295553192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371be68f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800a4e0 tx=0x7fe4d801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6844ffebf2e9716b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e6545640 1 -- 172.21.15.66:0/2295553192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80aa540 con 0x55d371be6510 2024-09-12T00:19:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e6545640 1 -- 172.21.15.66:0/2295553192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80aa6e0 con 0x55d371be6510 2024-09-12T00:19:31.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e6545640 1 -- 172.21.15.66:0/2295553192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80aaa40 con 0x55d371be6510 2024-09-12T00:19:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2295553192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 msgr2=0x55d371be68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2295553192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371be68f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800a4e0 tx=0x7fe4d801b090 comp rx=0 tx=0).stop 2024-09-12T00:19:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2295553192 shutdown_connections 2024-09-12T00:19:31.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2295553192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371be68f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2295553192 >> 172.21.15.66:0/2295553192 conn(0x55d371be5080 msgr2=0x55d371be5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2295553192 shutdown_connections 2024-09-12T00:19:31.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.913+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2295553192 wait complete. 2024-09-12T00:19:31.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d371b77680 con 0x55d371be6510 2024-09-12T00:19:31.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e7547640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e7547640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33712/0 (socket says 172.21.15.66:33712) 2024-09-12T00:19:31.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e7547640 1 -- 172.21.15.66:0/2030098823 learned_addr learned my addr 172.21.15.66:0/2030098823 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e7547640 1 -- 172.21.15.66:0/2030098823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371af2da0 con 0x55d371be6510 2024-09-12T00:19:31.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2030098823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8018cc0 tx=0x7fe4d80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6444b8c1a66a1b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe3d560a640 1 -- 172.21.15.66:0/2030098823 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80b9070 con 0x55d371be6510 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe3d560a640 1 -- 172.21.15.66:0/2030098823 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80aaa80 con 0x55d371be6510 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe3d560a640 1 -- 172.21.15.66:0/2030098823 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80aad60 con 0x55d371be6510 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2030098823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 msgr2=0x55d371d61410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2030098823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8018cc0 tx=0x7fe4d80033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2030098823 shutdown_connections 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2030098823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d61410 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2030098823 >> 172.21.15.66:0/2030098823 conn(0x55d371be5080 msgr2=0x55d371d5d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2030098823 shutdown_connections 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2030098823 wait complete. 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.933+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d371b19a50 con 0x55d371be6510 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7547640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7547640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33714/0 (socket says 172.21.15.66:33714) 2024-09-12T00:19:31.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7547640 1 -- 172.21.15.66:0/1470209215 learned_addr learned my addr 172.21.15.66:0/1470209215 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7547640 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371d68e80 con 0x55d371be6510 2024-09-12T00:19:31.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7547640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8018cc0 tx=0x7fe4d8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 -- 172.21.15.66:0/1470209215 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80b9070 con 0x55d371be6510 2024-09-12T00:19:31.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d371d69110 con 0x55d371be6510 2024-09-12T00:19:31.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 -- 172.21.15.66:0/1470209215 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80b5b10 con 0x55d371be6510 2024-09-12T00:19:31.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 -- 172.21.15.66:0/1470209215 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d80b5df0 con 0x55d371be6510 2024-09-12T00:19:31.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d371d69a70 con 0x55d371be6510 2024-09-12T00:19:31.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 -- 172.21.15.66:0/1470209215 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4d80b3040 con 0x55d371be6510 2024-09-12T00:19:31.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 0x7fe3cc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe3d3e07640 1 -- 172.21.15.66:0/1470209215 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe4d80c4070 con 0x55d371be6510 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 0x7fe3cc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 0x55d371d6fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371d6ff80 con 0x55d371be9650 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.937+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 0x55d371d6fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 0x7fe3cc03bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc001ec0 tx=0x7fe4dc001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 0x55d371d6fa40 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 -- 172.21.15.66:0/1470209215 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4e00083f0 con 0x55d371be9650 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371d69e60 con 0x55d371be9650 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 -- 172.21.15.66:0/1470209215 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4e00083f0 con 0x55d371be9650 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 0x55d371d74680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371d74d70 con 0x55d371d72290 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7547640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 0x55d371d74680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7547640 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 0x55d371d74680 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7547640 1 -- 172.21.15.66:0/1470209215 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4d80cd060 con 0x55d371d72290 2024-09-12T00:19:31.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371d71130 con 0x55d371be9650 2024-09-12T00:19:31.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 -- 172.21.15.66:0/1470209215 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4e00083f0 con 0x55d371be9650 2024-09-12T00:19:31.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371d71610 con 0x55d371d72290 2024-09-12T00:19:31.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7547640 1 -- 172.21.15.66:0/1470209215 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4d80cd060 con 0x55d371d72290 2024-09-12T00:19:31.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e9a419c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d371b84450 con 0x55d371d834a0 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33730/0 (socket says 172.21.15.66:33730) 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.941+0000 7fe4e7d48640 1 -- 172.21.15.66:0/558564897 learned_addr learned my addr 172.21.15.66:0/558564897 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7d48640 1 -- 172.21.15.66:0/558564897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371d83f00 con 0x55d371d834a0 2024-09-12T00:19:31.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55d371d69c60 tx=0x7fe4e000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 -- 172.21.15.66:0/558564897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e001c020 con 0x55d371d834a0 2024-09-12T00:19:31.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 -- 172.21.15.66:0/558564897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0007c40 con 0x55d371d834a0 2024-09-12T00:19:31.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d371d84760 con 0x55d371d834a0 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 -- 172.21.15.66:0/558564897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0018440 con 0x55d371d834a0 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d371d84cd0 con 0x55d371d834a0 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 -- 172.21.15.66:0/558564897 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4e001f020 con 0x55d371d834a0 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 0x7fe3c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe3d1602640 1 -- 172.21.15.66:0/558564897 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe4e0051e50 con 0x55d371d834a0 2024-09-12T00:19:31.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7547640 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 0x7fe3c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7547640 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 0x7fe3c003bf30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4d801aec0 tx=0x7fe4d801b090 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e9a419c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d371d61b80 con 0x55d371d90d70 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33734/0 (socket says 172.21.15.66:33734) 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.945+0000 7fe4e7d48640 1 -- 172.21.15.66:0/352343343 learned_addr learned my addr 172.21.15.66:0/352343343 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 -- 172.21.15.66:0/352343343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371d91740 con 0x55d371d90d70 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/352343343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007fd0 tx=0x7fe4e0016ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4700211d972436b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe3caffd640 1 -- 172.21.15.66:0/352343343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0021530 con 0x55d371d90d70 2024-09-12T00:19:31.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe3caffd640 1 -- 172.21.15.66:0/352343343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0018c10 con 0x55d371d90d70 2024-09-12T00:19:31.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe3caffd640 1 -- 172.21.15.66:0/352343343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0020cd0 con 0x55d371d90d70 2024-09-12T00:19:31.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/352343343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 msgr2=0x55d371d91150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:31.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/352343343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0007fd0 tx=0x7fe4e0016ca0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/352343343 shutdown_connections 2024-09-12T00:19:31.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/352343343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d91150 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/352343343 >> 172.21.15.66:0/352343343 conn(0x55d371d8c190 msgr2=0x55d371d8a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/352343343 shutdown_connections 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/352343343 wait complete. 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 Processor -- start 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- start start 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e9a419c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d371d8fcc0 con 0x55d371d90d70 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33750/0 (socket says 172.21.15.66:33750) 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 learned_addr learned my addr 172.21.15.66:0/2980537480 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:31.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.949+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d371d97790 con 0x55d371d90d70 2024-09-12T00:19:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0018630 tx=0x7fe4e0050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 -- 172.21.15.66:0/2980537480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0039070 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 -- 172.21.15.66:0/2980537480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0029da0 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d371d97a20 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 -- 172.21.15.66:0/2980537480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00294c0 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d371d983d0 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 -- 172.21.15.66:0/2980537480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4e003c070 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3b0039a70 0x7fe3b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe3c97fa640 1 -- 172.21.15.66:0/2980537480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe4e0031070 con 0x55d371d90d70 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3b0039a70 0x7fe3b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371da2730 0x55d371da4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371da5340 con 0x55d371da2730 2024-09-12T00:19:31.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371da2730 0x55d371da4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3b0039a70 0x7fe3b003bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80a9f90 tx=0x7fe4d80df000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371da2730 0x55d371da4bf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4dc00d040 con 0x55d371da2730 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 realm 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371da1a80 con 0x55d371da2730 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4dc00d040 con 0x55d371da2730 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.953+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371da5e40 con 0x55d371da2730 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4dc00d040 con 0x55d371da2730 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371da6710 con 0x55d371da2730 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4dc00d040 con 0x55d371da2730 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371da7130 0x55d371da9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371da9c90 con 0x55d371da7130 2024-09-12T00:19:31.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371da7130 0x55d371da9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371da7130 0x55d371da9520 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 20 searching for the correct realm 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe4e0021020 0x7fe4e0037940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe4e0021020 0x7fe4e0037940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe4e0021020 0x7fe4e0037940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7547640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe4d80f8040 0x7fe4d80ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:31.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe4d80f8040 0x7fe4d80ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.957+0000 7fe4e6d46640 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe4d80f8040 0x7fe4d80ea330 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc00d040 con 0x7fe4d80f8040 2024-09-12T00:19:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc00d040 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.961+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.965+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da7130 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4d80f8040 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x55d371da2730 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab560 con 0x7fe4e0021020 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.969+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371daa610 con 0x55d371da2730 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371daae60 con 0x55d371da2730 2024-09-12T00:19:31.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371dab990 con 0x55d371da7130 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 zone default found 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 4 Realm: () 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:31.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 zonegroup default 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371dabd30 con 0x7fe4d80f8040 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371dadbd0 con 0x55d371da7130 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371dadbd0 con 0x55d371da7130 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:31.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 started sync module instance, tier type = 2024-09-12T00:19:31.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:31.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dad120 con 0x7fe4e0021020 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94366636627216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dadfc0 con 0x7fe4e0021020 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.973+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dae810 con 0x55d371da2730 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.977+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94366636627216] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.977+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.977+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94366636630880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371daec30 con 0x55d371da2730 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.977+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371daf4e0 con 0x55d371da7130 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94366636633136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371daf050 con 0x55d371da7130 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db0440 con 0x7fe4e0021020 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94366636630880] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94366636631936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db0440 con 0x7fe4e0021020 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db0e50 con 0x55d371da2730 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94366636633136] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:31.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94366636631936] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:31.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94366636636368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db09a0 con 0x55d371da2730 2024-09-12T00:19:31.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.981+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db16f0 con 0x7fe4d80f8040 2024-09-12T00:19:31.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.985+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94366636636368] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.985+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.985+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94366636637984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db09a0 con 0x7fe4d80f8040 2024-09-12T00:19:31.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.985+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db1b90 con 0x7fe4d80f8040 2024-09-12T00:19:31.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94366636643936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db2000 con 0x7fe4d80f8040 2024-09-12T00:19:31.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db2ac0 con 0x7fe4d80f8040 2024-09-12T00:19:31.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94366636637984] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94366636643936] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94366636647824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db1b50 con 0x7fe4d80f8040 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=0 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=1 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=2 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=3 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=4 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=5 2024-09-12T00:19:31.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.989+0000 7fe4e9a419c0 20 add_watcher() i=6 2024-09-12T00:19:31.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94366636647824] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:31.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 add_watcher() i=7 2024-09-12T00:19:31.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:31.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371db5bc0 con 0x55d371da2730 2024-09-12T00:19:31.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94366636642288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371db3040 con 0x55d371da2730 2024-09-12T00:19:31.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94366636642288] v33'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:31.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:31.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:31.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:31.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 5 note: GC not initialized 2024-09-12T00:19:32.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe39cfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:32.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:32.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 Filter name: none 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe3167fc640 20 reqs_thread_entry: start 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.993+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371dd9000 con 0x55d371da2730 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:32.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371ddf5c0 con 0x55d371da2730 2024-09-12T00:19:32.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94366636830800 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d371ddaea0 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== watch-notify(notify (1) cookie 94366636636368 notify 141733920790 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55d371b239c0 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(64 notify.4 [notify cookie 94366636830800 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe3ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94366636636368 notifier 4655 bl.length()=579 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe3ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe3ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe3ca7fc640 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe31c003440 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:31.997+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== watch-notify(notify_complete (2) cookie 94366636830800 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4dc01d850 con 0x55d371da2730 2024-09-12T00:19:32.004 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:32.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe39dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:32.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94366636642288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dd6d30 con 0x55d371da2730 2024-09-12T00:19:32.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94366636642288] v33'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94366636627216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dd6d30 con 0x7fe4e0021020 2024-09-12T00:19:32.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94366636627216] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:32.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e9a419c0 20 remove_watcher() i=0 2024-09-12T00:19:32.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e9a419c0 2 removed watcher, disabling cache 2024-09-12T00:19:32.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.001+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94366636630880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dad510 con 0x55d371da2730 2024-09-12T00:19:32.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94366636630880] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e9a419c0 20 remove_watcher() i=1 2024-09-12T00:19:32.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94366636633136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dd6d30 con 0x55d371da7130 2024-09-12T00:19:32.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e7d48640 1 -- 172.21.15.66:0/2980537480 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94366636633136] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4e003b030 con 0x55d371da7130 2024-09-12T00:19:32.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e9a419c0 20 remove_watcher() i=2 2024-09-12T00:19:32.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.005+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94366636631936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dae360 con 0x7fe4e0021020 2024-09-12T00:19:32.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e7547640 1 -- 172.21.15.66:0/2980537480 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94366636631936] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4d80f5070 con 0x7fe4e0021020 2024-09-12T00:19:32.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e9a419c0 20 remove_watcher() i=3 2024-09-12T00:19:32.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94366636636368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dad510 con 0x55d371da2730 2024-09-12T00:19:32.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94366636636368] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x55d371da2730 2024-09-12T00:19:32.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e9a419c0 20 remove_watcher() i=4 2024-09-12T00:19:32.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.009+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94366636637984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371daec30 con 0x7fe4d80f8040 2024-09-12T00:19:32.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94366636637984] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:32.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e9a419c0 20 remove_watcher() i=5 2024-09-12T00:19:32.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94366636643936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dd6d30 con 0x7fe4d80f8040 2024-09-12T00:19:32.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94366636643936] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:32.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e9a419c0 20 remove_watcher() i=6 2024-09-12T00:19:32.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.013+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94366636647824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d371dad510 con 0x7fe4d80f8040 2024-09-12T00:19:32.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94366636647824] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4dc02a040 con 0x7fe4d80f8040 2024-09-12T00:19:32.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 20 remove_watcher() i=7 2024-09-12T00:19:32.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe4d80f8040 msgr2=0x7fe4d80ea330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fe4d80f8040 0x7fe4d80ea330 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371da2730 msgr2=0x55d371da4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371da2730 0x55d371da4bf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe4e0021020 msgr2=0x7fe4e0037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fe4e0021020 0x7fe4e0037940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371da7130 msgr2=0x55d371da9520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371da7130 0x55d371da9520 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3b0039a70 msgr2=0x7fe3b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3b0039a70 0x7fe3b003bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80a9f90 tx=0x7fe4d80df000 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e6d46640 1 -- 172.21.15.66:0/2980537480 reap_dead start 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 msgr2=0x55d371d97230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0018630 tx=0x7fe4e0050040 comp rx=0 tx=0).stop 2024-09-12T00:19:32.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 shutdown_connections 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/2980537480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d90d70 0x55d371d97230 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 >> 172.21.15.66:0/2980537480 conn(0x55d371d8c190 msgr2=0x55d371d8a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 shutdown_connections 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/2980537480 wait complete. 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 msgr2=0x7fe3c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 0x7fe3c003bf30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe4d801aec0 tx=0x7fe4d801b090 comp rx=0 tx=0).stop 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 msgr2=0x55d371d838c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55d371d69c60 tx=0x7fe4e000bd40 comp rx=0 tx=0).stop 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 shutdown_connections 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3c0039a70 0x7fe3c003bf30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/558564897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371d834a0 0x55d371d838c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 >> 172.21.15.66:0/558564897 conn(0x55d371d78e50 msgr2=0x55d371d79230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 shutdown_connections 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/558564897 wait complete. 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 msgr2=0x55d371d6fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 0x55d371d6fa40 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 msgr2=0x55d371d74680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 0x55d371d74680 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 msgr2=0x7fe3cc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 0x7fe3cc03bf30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc001ec0 tx=0x7fe4dc001440 comp rx=0 tx=0).stop 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 msgr2=0x55d371d68920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8018cc0 tx=0x7fe4d8017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 shutdown_connections 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55d371d72290 0x55d371d74680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55d371be9650 0x55d371d6fa40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe3cc039a70 0x7fe3cc03bf30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 --2- 172.21.15.66:0/1470209215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d371be6510 0x55d371d68920 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 >> 172.21.15.66:0/1470209215 conn(0x55d371be5080 msgr2=0x55d371d5bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 shutdown_connections 2024-09-12T00:19:32.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.017+0000 7fe4e9a419c0 1 -- 172.21.15.66:0/1470209215 wait complete. 2024-09-12T00:19:32.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:32.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T00:19:32.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T00:19:32.036 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-12T00:19:32.115 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:32.115 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:32.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b20c149c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564c05f744f0 0x564c05f748d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b20c149c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c05e289c0 con 0x564c05f77630 2024-09-12T00:19:32.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b20c149c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x564c05e786d0 con 0x564c05f744f0 2024-09-12T00:19:32.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1e71a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564c05f744f0 0x564c05f748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1e71a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x564c05f744f0 0x564c05f748d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33758/0 (socket says 172.21.15.66:33758) 2024-09-12T00:19:32.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1df19640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x564c05f77630 0x564c05f79a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38370/0 (socket says 172.21.15.66:38370) 2024-09-12T00:19:32.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1e71a640 1 -- 172.21.15.66:0/3077093309 learned_addr learned my addr 172.21.15.66:0/3077093309 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1e71a640 1 -- 172.21.15.66:0/3077093309 >> v1:172.21.15.31:6789/0 conn(0x564c05f77630 legacy=0x564c05f79a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.113+0000 7f8b1e71a640 1 -- 172.21.15.66:0/3077093309 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c05e1cca0 con 0x564c05f744f0 2024-09-12T00:19:32.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/3077093309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c05f748d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a4e0 tx=0x7f8b1001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256bf28a8e51a538 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b1d718640 1 -- 172.21.15.66:0/3077093309 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100aa540 con 0x564c05f744f0 2024-09-12T00:19:32.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b1d718640 1 -- 172.21.15.66:0/3077093309 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100aa6e0 con 0x564c05f744f0 2024-09-12T00:19:32.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b1d718640 1 -- 172.21.15.66:0/3077093309 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100aaa40 con 0x564c05f744f0 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 -- 172.21.15.66:0/3077093309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 msgr2=0x564c05f748d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/3077093309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c05f748d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a4e0 tx=0x7f8b1001b090 comp rx=0 tx=0).stop 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 -- 172.21.15.66:0/3077093309 shutdown_connections 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/3077093309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c05f748d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 -- 172.21.15.66:0/3077093309 >> 172.21.15.66:0/3077093309 conn(0x564c05f70010 msgr2=0x564c05f72430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 -- 172.21.15.66:0/3077093309 shutdown_connections 2024-09-12T00:19:32.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.117+0000 7f8b20c149c0 1 -- 172.21.15.66:0/3077093309 wait complete. 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b20c149c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b20c149c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564c05e7c680 con 0x564c05f744f0 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b1e71a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b1e71a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33766/0 (socket says 172.21.15.66:33766) 2024-09-12T00:19:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b1e71a640 1 -- 172.21.15.66:0/4073988381 learned_addr learned my addr 172.21.15.66:0/4073988381 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b1e71a640 1 -- 172.21.15.66:0/4073988381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c05df7da0 con 0x564c05f744f0 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.133+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/4073988381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8b10017ca0 tx=0x7f8b100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1a71019b79c5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0c608640 1 -- 172.21.15.66:0/4073988381 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100b9030 con 0x564c05f744f0 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0c608640 1 -- 172.21.15.66:0/4073988381 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100aaa80 con 0x564c05f744f0 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0c608640 1 -- 172.21.15.66:0/4073988381 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100aada0 con 0x564c05f744f0 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/4073988381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 msgr2=0x564c0605f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/4073988381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8b10017ca0 tx=0x7f8b100033b0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/4073988381 shutdown_connections 2024-09-12T00:19:32.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/4073988381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c0605f7b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/4073988381 >> 172.21.15.66:0/4073988381 conn(0x564c05f70010 msgr2=0x564c0605b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/4073988381 shutdown_connections 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/4073988381 wait complete. 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564c05e1ea50 con 0x564c05f744f0 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b1e71a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b1e71a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33780/0 (socket says 172.21.15.66:33780) 2024-09-12T00:19:32.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b1e71a640 1 -- 172.21.15.66:0/569674277 learned_addr learned my addr 172.21.15.66:0/569674277 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b1e71a640 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c06067250 con 0x564c05f744f0 2024-09-12T00:19:32.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8b1001b930 tx=0x7f8b10017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0ae05640 1 -- 172.21.15.66:0/569674277 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100b9070 con 0x564c05f744f0 2024-09-12T00:19:32.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c060674e0 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0ae05640 1 -- 172.21.15.66:0/569674277 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100c3030 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8a0ae05640 1 -- 172.21.15.66:0/569674277 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100cd060 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.137+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c06067e90 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8a0ae05640 1 -- 172.21.15.66:0/569674277 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b100b3040 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8a0ae05640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 0x7f8a0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8a0ae05640 1 -- 172.21.15.66:0/569674277 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8b100ba070 con 0x564c05f744f0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1df19640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 0x7f8a0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 0x564c0606de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c0606e3a0 con 0x564c05f77630 2024-09-12T00:19:32.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 0x564c0606de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1df19640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 0x7f8a0403bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b08001e40 tx=0x7f8b080013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 0x564c0606de60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/569674277 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b180083f0 con 0x564c05f77630 2024-09-12T00:19:32.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c0606e7a0 con 0x564c05f77630 2024-09-12T00:19:32.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/569674277 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b180083f0 con 0x564c05f77630 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 0x564c060729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c06073070 con 0x564c060705b0 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 0x564c060729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 0x564c060729a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b1e71a640 1 -- 172.21.15.66:0/569674277 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b100c89e0 con 0x564c060705b0 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.141+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c0606f450 con 0x564c05f77630 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/569674277 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b180083f0 con 0x564c05f77630 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c0606f930 con 0x564c060705b0 2024-09-12T00:19:32.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1e71a640 1 -- 172.21.15.66:0/569674277 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b100c89e0 con 0x564c060705b0 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564c05e89450 con 0x564c060817c0 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33788/0 (socket says 172.21.15.66:33788) 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/2234098317 learned_addr learned my addr 172.21.15.66:0/2234098317 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/2234098317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c06082220 con 0x564c060817c0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x564c06067a70 tx=0x7f8b1800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8a03fff640 1 -- 172.21.15.66:0/2234098317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1801c020 con 0x564c060817c0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8a03fff640 1 -- 172.21.15.66:0/2234098317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18007d00 con 0x564c060817c0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8a03fff640 1 -- 172.21.15.66:0/2234098317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18018440 con 0x564c060817c0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c06082a80 con 0x564c060817c0 2024-09-12T00:19:32.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.145+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c06082ff0 con 0x564c060817c0 2024-09-12T00:19:32.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a03fff640 1 -- 172.21.15.66:0/2234098317 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b1801f020 con 0x564c060817c0 2024-09-12T00:19:32.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a03fff640 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 0x7f89f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a03fff640 1 -- 172.21.15.66:0/2234098317 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8b18051d90 con 0x564c060817c0 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 0x7f89f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 0x7f89f803bf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b100e9c30 tx=0x7f8b100bef70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564c0605ff40 con 0x564c0608bf30 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33792/0 (socket says 172.21.15.66:33792) 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/211601326 learned_addr learned my addr 172.21.15.66:0/211601326 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/211601326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c0608c8e0 con 0x564c0608bf30 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/211601326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021fd0 tx=0x7f8b180168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39d6dc5fab0d2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a01ffb640 1 -- 172.21.15.66:0/211601326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18021400 con 0x564c0608bf30 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a01ffb640 1 -- 172.21.15.66:0/211601326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18029350 con 0x564c0608bf30 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8a01ffb640 1 -- 172.21.15.66:0/211601326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b180215a0 con 0x564c0608bf30 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- 172.21.15.66:0/211601326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 msgr2=0x564c0608c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/211601326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021fd0 tx=0x7f8b180168b0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- 172.21.15.66:0/211601326 shutdown_connections 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/211601326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c0608c310 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- 172.21.15.66:0/211601326 >> 172.21.15.66:0/211601326 conn(0x564c06088360 msgr2=0x564c060865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- 172.21.15.66:0/211601326 shutdown_connections 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- 172.21.15.66:0/211601326 wait complete. 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 Processor -- start 2024-09-12T00:19:32.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- start start 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.149+0000 7f8b20c149c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564c0608cf40 con 0x564c0608bf30 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1ef1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33796/0 (socket says 172.21.15.66:33796) 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 learned_addr learned my addr 172.21.15.66:0/758071572 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c06093960 con 0x564c0608bf30 2024-09-12T00:19:32.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021fd0 tx=0x7f8b18050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 -- 172.21.15.66:0/758071572 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18016e00 con 0x564c0608bf30 2024-09-12T00:19:32.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c06093bf0 con 0x564c0608bf30 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 -- 172.21.15.66:0/758071572 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18028bd0 con 0x564c0608bf30 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 -- 172.21.15.66:0/758071572 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b180203b0 con 0x564c0608bf30 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c060945a0 con 0x564c0608bf30 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 -- 172.21.15.66:0/758071572 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b18016040 con 0x564c0608bf30 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89e8039a70 0x7f89e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f89effff640 1 -- 172.21.15.66:0/758071572 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8b18032070 con 0x564c0608bf30 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89e8039a70 0x7f89e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c0609ea10 0x564c060a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a15f0 con 0x564c0609ea10 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1df19640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c0609ea10 0x564c060a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.153+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89e8039a70 0x7f89e803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b100c8cf0 tx=0x7f8b100db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c0609ea10 0x564c060a0ea0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f620 con 0x564c0609ea10 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 realm 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c0609ddc0 con 0x564c0609ea10 2024-09-12T00:19:32.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f620 con 0x564c0609ea10 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a20f0 con 0x564c0609ea10 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0800f620 con 0x564c0609ea10 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a29c0 con 0x564c0609ea10 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b0800f620 con 0x564c0609ea10 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060a33e0 0x564c060a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a5f10 con 0x564c060a33e0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060a33e0 0x564c060a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060a33e0 0x564c060a57d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 20 searching for the correct realm 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c060a33e0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8b18021020 0x7f8b1802da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b18021020 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8b18021020 0x7f8b1802da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8b18021020 0x7f8b1802da90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1e71a640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8b100e8370 0x7f8b100b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b100e8370 2024-09-12T00:19:32.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.157+0000 7f8b1df19640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8b100e8370 0x7f8b100b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8b100e8370 0x7f8b100b68e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0800f620 con 0x7f8b100e8370 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0800f620 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b100e8370 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c060a33e0 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c0609ea10 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.161+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c0609ea10 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564c060a77e0 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b100e8370 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c0609ea10 2024-09-12T00:19:32.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c0609ea10 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.165+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b100e8370 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c060a33e0 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b18021020 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c0609ea10 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x564c0609ea10 2024-09-12T00:19:32.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b100e8370 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c060a33e0 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b100e8370 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b18021020 2024-09-12T00:19:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c060a33e0 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.169+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b100e8370 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b0802b040 con 0x7f8b100e8370 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x564c0609ea10 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8b18065040 con 0x7f8b18021020 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:32.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a6960 con 0x564c0609ea10 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a7200 con 0x564c0609ea10 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a7b80 con 0x564c060a33e0 2024-09-12T00:19:32.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 zone default found 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 4 Realm: () 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 zonegroup default 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060a7f80 con 0x7f8b100e8370 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060aa260 con 0x564c060a33e0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060aa260 con 0x564c060a33e0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 started sync module instance, tier type = 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.173+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060a96f0 con 0x7f8b18021020 2024-09-12T00:19:32.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94884518861584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aa6c0 con 0x7f8b18021020 2024-09-12T00:19:32.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aaf10 con 0x564c0609ea10 2024-09-12T00:19:32.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94884518861584] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94884518862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aafb0 con 0x564c0609ea10 2024-09-12T00:19:32.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.177+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060abad0 con 0x564c060a33e0 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94884518862640] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94884518868384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aba90 con 0x564c060a33e0 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ac4e0 con 0x7f8b18021020 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94884518871088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060acd80 con 0x7f8b18021020 2024-09-12T00:19:32.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.181+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ad7a0 con 0x564c0609ea10 2024-09-12T00:19:32.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94884518868384] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94884518871088] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94884518875792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ac8d0 con 0x564c0609ea10 2024-09-12T00:19:32.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ae040 con 0x7f8b100e8370 2024-09-12T00:19:32.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94884518875792] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94884518865504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ac8d0 con 0x7f8b100e8370 2024-09-12T00:19:32.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.185+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ae530 con 0x7f8b100e8370 2024-09-12T00:19:32.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.189+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94884518865504] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.189+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.189+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94884518879232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ae4f0 con 0x7f8b100e8370 2024-09-12T00:19:32.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.189+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aef10 con 0x7f8b100e8370 2024-09-12T00:19:32.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94884518879232] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94884518881792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060aeed0 con 0x7f8b100e8370 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=0 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=1 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=2 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=3 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=4 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=5 2024-09-12T00:19:32.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.193+0000 7f8b20c149c0 20 add_watcher() i=6 2024-09-12T00:19:32.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94884518881792] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 add_watcher() i=7 2024-09-12T00:19:32.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:32.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060b2300 con 0x564c0609ea10 2024-09-12T00:19:32.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94884518877584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060af820 con 0x564c0609ea10 2024-09-12T00:19:32.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94884518877584] v33'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f89d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:32.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:32.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 5 note: GC not initialized 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f894f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 Filter name: none 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f894d7fa640 20 reqs_thread_entry: start 2024-09-12T00:19:32.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:32.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.197+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060d5900 con 0x564c0609ea10 2024-09-12T00:19:32.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-12T00:19:32.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:32.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:32.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060dbf30 con 0x564c0609ea10 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94884519066016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564c060daa80 con 0x564c0609ea10 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== watch-notify(notify (1) cookie 94884518875792 notify 141733920791 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8b08018040 con 0x564c0609ea10 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8a01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94884518875792 notifier 4662 bl.length()=567 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8a01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8a01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(64 notify.4 [notify cookie 94884519066016 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8a01ffb640 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f89e4003eb0 con 0x564c0609ea10 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.201+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== watch-notify(notify_complete (2) cookie 94884519066016 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c05e289c0 con 0x564c0609ea10 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T00:19:04.997035Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:19:04.997020Z","tags":[],"group_ids":[]} 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f89d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:32.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94884518877584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x564c0609ea10 2024-09-12T00:19:32.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94884518877584] v33'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94884518861584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x7f8b18021020 2024-09-12T00:19:32.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94884518861584] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b20c149c0 20 remove_watcher() i=0 2024-09-12T00:19:32.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b20c149c0 2 removed watcher, disabling cache 2024-09-12T00:19:32.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.205+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94884518862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x564c0609ea10 2024-09-12T00:19:32.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.209+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94884518862640] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.209+0000 7f8b20c149c0 20 remove_watcher() i=1 2024-09-12T00:19:32.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.209+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94884518868384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x564c060a33e0 2024-09-12T00:19:32.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.209+0000 7f8b1ef1b640 1 -- 172.21.15.66:0/758071572 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94884518868384] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1803c020 con 0x564c060a33e0 2024-09-12T00:19:32.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.209+0000 7f8b20c149c0 20 remove_watcher() i=2 2024-09-12T00:19:32.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94884518871088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x7f8b18021020 2024-09-12T00:19:32.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b1e71a640 1 -- 172.21.15.66:0/758071572 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94884518871088] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b100c89e0 con 0x7f8b18021020 2024-09-12T00:19:32.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b20c149c0 20 remove_watcher() i=3 2024-09-12T00:19:32.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94884518875792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ac030 con 0x564c0609ea10 2024-09-12T00:19:32.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94884518875792] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x564c0609ea10 2024-09-12T00:19:32.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b20c149c0 20 remove_watcher() i=4 2024-09-12T00:19:32.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.213+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94884518865504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x7f8b100e8370 2024-09-12T00:19:32.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94884518865504] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b20c149c0 20 remove_watcher() i=5 2024-09-12T00:19:32.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94884518879232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060ac030 con 0x7f8b100e8370 2024-09-12T00:19:32.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94884518879232] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b20c149c0 20 remove_watcher() i=6 2024-09-12T00:19:32.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.217+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94884518881792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564c060d3630 con 0x7f8b100e8370 2024-09-12T00:19:32.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94884518881792] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b0803b040 con 0x7f8b100e8370 2024-09-12T00:19:32.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 20 remove_watcher() i=7 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8b100e8370 msgr2=0x7f8b100b68e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f8b100e8370 0x7f8b100b68e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c0609ea10 msgr2=0x564c060a0ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c0609ea10 0x564c060a0ea0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8b18021020 msgr2=0x7f8b1802da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8b18021020 0x7f8b1802da90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060a33e0 msgr2=0x564c060a57d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060a33e0 0x564c060a57d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89e8039a70 msgr2=0x7f89e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89e8039a70 0x7f89e803bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b100c8cf0 tx=0x7f8b100db000 comp rx=0 tx=0).stop 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 msgr2=0x564c06093400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021fd0 tx=0x7f8b18050040 comp rx=0 tx=0).stop 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b1df19640 1 -- 172.21.15.66:0/758071572 reap_dead start 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 shutdown_connections 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/758071572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c0608bf30 0x564c06093400 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 >> 172.21.15.66:0/758071572 conn(0x564c06088360 msgr2=0x564c06086570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 shutdown_connections 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/758071572 wait complete. 2024-09-12T00:19:32.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 msgr2=0x7f89f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 0x7f89f803bf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b100e9c30 tx=0x7f8b100bef70 comp rx=0 tx=0).stop 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 msgr2=0x564c06081be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x564c06067a70 tx=0x7f8b1800bf50 comp rx=0 tx=0).stop 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 shutdown_connections 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f89f8039a70 0x7f89f803bf30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/2234098317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c060817c0 0x564c06081be0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 >> 172.21.15.66:0/2234098317 conn(0x564c06077170 msgr2=0x564c06077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 shutdown_connections 2024-09-12T00:19:32.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/2234098317 wait complete. 2024-09-12T00:19:32.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 msgr2=0x564c0606de60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 0x564c0606de60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 msgr2=0x564c060729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 0x564c060729a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 msgr2=0x7f8a0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 0x7f8a0403bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b08001e40 tx=0x7f8b080013a0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 msgr2=0x564c06066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8b1001b930 tx=0x7f8b10017e30 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 shutdown_connections 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564c060705b0 0x564c060729a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564c05f77630 0x564c0606de60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8a04039a70 0x7f8a0403bf30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 --2- 172.21.15.66:0/569674277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564c05f744f0 0x564c06066cf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 >> 172.21.15.66:0/569674277 conn(0x564c05f70010 msgr2=0x564c06059ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 shutdown_connections 2024-09-12T00:19:32.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.221+0000 7f8b20c149c0 1 -- 172.21.15.66:0/569674277 wait complete. 2024-09-12T00:19:32.239 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T00:19:04.997035Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:19:04.997020Z', 'tags': [], 'group_ids': []} 2024-09-12T00:19:32.254 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:32.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:32.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T00:19:32.255 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T00:19:32.320 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:32.320 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:32.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb3071469c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55851ae216c0 0x55851ae23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb3071469c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55851acd19c0 con 0x55851ae1d520 2024-09-12T00:19:32.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb3071469c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55851ad216d0 con 0x55851ae216c0 2024-09-12T00:19:32.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb30444b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55851ae216c0 0x55851ae23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb304c4c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55851ae1d520 0x55851ae1d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:38378/0 (socket says 172.21.15.66:38378) 2024-09-12T00:19:32.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb30444b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55851ae216c0 0x55851ae23ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33802/0 (socket says 172.21.15.66:33802) 2024-09-12T00:19:32.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb304c4c640 1 -- 172.21.15.66:0/3630462866 learned_addr learned my addr 172.21.15.66:0/3630462866 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:19:32.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb30444b640 1 -- 172.21.15.66:0/3630462866 >> v1:172.21.15.31:6789/0 conn(0x55851ae1d520 legacy=0x55851ae1d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.317+0000 7fb30444b640 1 -- 172.21.15.66:0/3630462866 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851acc5ca0 con 0x55851ae216c0 2024-09-12T00:19:32.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb30444b640 1 --2- 172.21.15.66:0/3630462866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae216c0 0x55851ae23ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400a480 tx=0x7fb2f401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2a6a6498b73e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb303c4a640 1 -- 172.21.15.66:0/3630462866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f40aa570 con 0x55851ae216c0 2024-09-12T00:19:32.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb303c4a640 1 -- 172.21.15.66:0/3630462866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f40af070 con 0x55851ae216c0 2024-09-12T00:19:32.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb303c4a640 1 -- 172.21.15.66:0/3630462866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f40aa860 con 0x55851ae216c0 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 -- 172.21.15.66:0/3630462866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae216c0 msgr2=0x55851ae23ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 --2- 172.21.15.66:0/3630462866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae216c0 0x55851ae23ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400a480 tx=0x7fb2f401b310 comp rx=0 tx=0).stop 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 -- 172.21.15.66:0/3630462866 shutdown_connections 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 --2- 172.21.15.66:0/3630462866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae216c0 0x55851ae23ab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 -- 172.21.15.66:0/3630462866 >> 172.21.15.66:0/3630462866 conn(0x55851ae19040 msgr2=0x55851ae1b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 -- 172.21.15.66:0/3630462866 shutdown_connections 2024-09-12T00:19:32.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.321+0000 7fb3071469c0 1 -- 172.21.15.66:0/3630462866 wait complete. 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb3071469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb3071469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55851ad25680 con 0x55851ae1d520 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb304c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb304c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33818/0 (socket says 172.21.15.66:33818) 2024-09-12T00:19:32.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb304c4c640 1 -- 172.21.15.66:0/674777538 learned_addr learned my addr 172.21.15.66:0/674777538 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb304c4c640 1 -- 172.21.15.66:0/674777538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851aca0da0 con 0x55851ae1d520 2024-09-12T00:19:32.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb304c4c640 1 --2- 172.21.15.66:0/674777538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8001e00 tx=0x7fb2f800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b975a05ecd382e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb1f2e0d640 1 -- 172.21.15.66:0/674777538 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f8012020 con 0x55851ae1d520 2024-09-12T00:19:32.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb1f2e0d640 1 -- 172.21.15.66:0/674777538 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f800e690 con 0x55851ae1d520 2024-09-12T00:19:32.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.337+0000 7fb1f2e0d640 1 -- 172.21.15.66:0/674777538 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f800ea10 con 0x55851ae1d520 2024-09-12T00:19:32.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/674777538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 msgr2=0x55851af08850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 --2- 172.21.15.66:0/674777538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8001e00 tx=0x7fb2f800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/674777538 shutdown_connections 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 --2- 172.21.15.66:0/674777538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af08850 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/674777538 >> 172.21.15.66:0/674777538 conn(0x55851ae19040 msgr2=0x55851af044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/674777538 shutdown_connections 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/674777538 wait complete. 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55851acc7a50 con 0x55851ae1d520 2024-09-12T00:19:32.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb304c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb304c4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33826/0 (socket says 172.21.15.66:33826) 2024-09-12T00:19:32.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb304c4c640 1 -- 172.21.15.66:0/1023983224 learned_addr learned my addr 172.21.15.66:0/1023983224 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb304c4c640 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851af10390 con 0x55851ae1d520 2024-09-12T00:19:32.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b710 tx=0x7fb2f8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb1f160a640 1 -- 172.21.15.66:0/1023983224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f8012030 con 0x55851ae1d520 2024-09-12T00:19:32.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb1f160a640 1 -- 172.21.15.66:0/1023983224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f801a750 con 0x55851ae1d520 2024-09-12T00:19:32.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55851af10620 con 0x55851ae1d520 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb1f160a640 1 -- 172.21.15.66:0/1023983224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f801aa70 con 0x55851ae1d520 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.341+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851af10fd0 con 0x55851ae1d520 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb1f160a640 1 -- 172.21.15.66:0/1023983224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2f8015020 con 0x55851ae1d520 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb1f160a640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 0x7fb1ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb1f160a640 1 -- 172.21.15.66:0/1023983224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb2f8020030 con 0x55851ae1d520 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30444b640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 0x7fb1ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 0x55851af16fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af174e0 con 0x55851ae216c0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30544d640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 0x55851af16fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30444b640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 0x7fb1ec03bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ae000 tx=0x7fb2f40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30544d640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 0x55851af16fa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30544d640 1 -- 172.21.15.66:0/1023983224 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc00a4d0 con 0x55851ae216c0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af178e0 con 0x55851ae216c0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30544d640 1 -- 172.21.15.66:0/1023983224 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2fc00a4d0 con 0x55851ae216c0 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 0x55851af1bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af1c1b0 con 0x55851af196f0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 0x55851af1bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 0x55851af1bae0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb304c4c640 1 -- 172.21.15.66:0/1023983224 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2f8008030 con 0x55851af196f0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af18590 con 0x55851ae216c0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb30544d640 1 -- 172.21.15.66:0/1023983224 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2fc00a4d0 con 0x55851ae216c0 2024-09-12T00:19:32.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af18a70 con 0x55851af196f0 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.345+0000 7fb304c4c640 1 -- 172.21.15.66:0/1023983224 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2f8008030 con 0x55851af196f0 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55851ad32450 con 0x55851af2a900 2024-09-12T00:19:32.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33842/0 (socket says 172.21.15.66:33842) 2024-09-12T00:19:32.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb30544d640 1 -- 172.21.15.66:0/771369584 learned_addr learned my addr 172.21.15.66:0/771369584 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb30544d640 1 -- 172.21.15.66:0/771369584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851af2b360 con 0x55851af2a900 2024-09-12T00:19:32.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb30544d640 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55851af11f80 tx=0x7fb2fc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 -- 172.21.15.66:0/771369584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc013640 con 0x55851af2a900 2024-09-12T00:19:32.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55851af2bbc0 con 0x55851af2a900 2024-09-12T00:19:32.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 -- 172.21.15.66:0/771369584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0137e0 con 0x55851af2a900 2024-09-12T00:19:32.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 -- 172.21.15.66:0/771369584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc013ac0 con 0x55851af2a900 2024-09-12T00:19:32.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851af2c130 con 0x55851af2a900 2024-09-12T00:19:32.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 -- 172.21.15.66:0/771369584 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2fc011040 con 0x55851af2a900 2024-09-12T00:19:32.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 0x7fb1dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb1ea7fc640 1 -- 172.21.15.66:0/771369584 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb2fc00e040 con 0x55851af2a900 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.349+0000 7fb304c4c640 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 0x7fb1dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb304c4c640 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 0x7fb1dc03bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8001430 tx=0x7fb2f8018ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55851af09080 con 0x55851af38250 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33844/0 (socket says 172.21.15.66:33844) 2024-09-12T00:19:32.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 -- 172.21.15.66:0/487263094 learned_addr learned my addr 172.21.15.66:0/487263094 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 -- 172.21.15.66:0/487263094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851af38c20 con 0x55851af38250 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 --2- 172.21.15.66:0/487263094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc050920 tx=0x7fb2fc01fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b74c611911e9026 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb1dbfff640 1 -- 172.21.15.66:0/487263094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc0293a0 con 0x55851af38250 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb1dbfff640 1 -- 172.21.15.66:0/487263094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc02a3f0 con 0x55851af38250 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb1dbfff640 1 -- 172.21.15.66:0/487263094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc04f2a0 con 0x55851af38250 2024-09-12T00:19:32.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- 172.21.15.66:0/487263094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 msgr2=0x55851af38630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 --2- 172.21.15.66:0/487263094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc050920 tx=0x7fb2fc01fc20 comp rx=0 tx=0).stop 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- 172.21.15.66:0/487263094 shutdown_connections 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 --2- 172.21.15.66:0/487263094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af38630 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- 172.21.15.66:0/487263094 >> 172.21.15.66:0/487263094 conn(0x55851af33610 msgr2=0x55851af31850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- 172.21.15.66:0/487263094 shutdown_connections 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- 172.21.15.66:0/487263094 wait complete. 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 Processor -- start 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- start start 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb3071469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55851af37140 con 0x55851af38250 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:33854/0 (socket says 172.21.15.66:33854) 2024-09-12T00:19:32.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.353+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 learned_addr learned my addr 172.21.15.66:0/1340906224 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:19:32.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851af3ecb0 con 0x55851af38250 2024-09-12T00:19:32.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30544d640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01fce0 tx=0x7fb2fc0508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 -- 172.21.15.66:0/1340906224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc048040 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55851af3ecb0 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 -- 172.21.15.66:0/1340906224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0293a0 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 -- 172.21.15.66:0/1340906224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc013e40 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851af3ecb0 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 -- 172.21.15.66:0/1340906224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb2fc03ead0 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1d0039a70 0x7fb1d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb1da7fc640 1 -- 172.21.15.66:0/1340906224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb2fc03cd20 con 0x55851af38250 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1d0039a70 0x7fb1d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851af498f0 0x55851af4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af4c500 con 0x55851af498f0 2024-09-12T00:19:32.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30444b640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851af498f0 0x55851af4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1d0039a70 0x7fb1d003bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8016fd0 tx=0x7fb2f8034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30444b640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851af498f0 0x55851af4bdb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 realm 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af4c930 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.357+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af4d200 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af4d5a0 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af4e300 0x55851af506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af50d00 con 0x55851af4e300 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af4e300 0x55851af506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af4e300 0x55851af506f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 20 searching for the correct realm 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af4e300 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb2fc021440 0x7fb2fc04b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x7fb2fc021440 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb2fc021440 0x7fb2fc04b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb2fc021440 0x7fb2fc04b0b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb304c4c640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2f8039040 0x7fb2f8050a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x7fb2f8039040 2024-09-12T00:19:32.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.361+0000 7fb30444b640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2f8039040 0x7fb2f8050a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2f8039040 0x7fb2f8050a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af498f0 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af498f0 2024-09-12T00:19:32.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af498f0 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x7fb2f8039040 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x7fb2fc021440 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af4e300 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x55851af498f0 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55851af525d0 con 0x7fb2fc021440 2024-09-12T00:19:32.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af498f0 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.365+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2fc021440 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2f8039040 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af498f0 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af498f0 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2f8039040 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.369+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2fc021440 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af498f0 2024-09-12T00:19:32.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2f8039040 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2f8039040 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2fc021440 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af4e300 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2f8039040 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x55851af498f0 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.373+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fb2f805c040 con 0x7fb2fc021440 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:19:32.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af51650 con 0x55851af498f0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af51ea0 con 0x55851af498f0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:32.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af52a00 con 0x55851af4e300 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 zone default found 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 4 Realm: () 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 zonegroup default 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af52da0 con 0x7fb2f8039040 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af54fe0 con 0x55851af4e300 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af55380 con 0x55851af4e300 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 started sync module instance, tier type = 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af544e0 con 0x7fb2fc021440 2024-09-12T00:19:32.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.377+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94030171293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af54140 con 0x7fb2fc021440 2024-09-12T00:19:32.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af561f0 con 0x55851af498f0 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94030171293952] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94030171297568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af561f0 con 0x55851af498f0 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.381+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af56c00 con 0x55851af4e300 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94030171297568] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94030171299408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af56c00 con 0x55851af4e300 2024-09-12T00:19:32.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af575c0 con 0x7fb2fc021440 2024-09-12T00:19:32.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94030171304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af579e0 con 0x7fb2fc021440 2024-09-12T00:19:32.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af58450 con 0x55851af498f0 2024-09-12T00:19:32.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94030171299408] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94030171304208] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.385+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94030171307808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af57530 con 0x55851af498f0 2024-09-12T00:19:32.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af58cf0 con 0x7fb2f8039040 2024-09-12T00:19:32.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94030171309712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af58f60 con 0x7fb2f8039040 2024-09-12T00:19:32.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af597b0 con 0x7fb2f8039040 2024-09-12T00:19:32.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.389+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94030171307808] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94030171309712] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94030171310768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af59380 con 0x7fb2f8039040 2024-09-12T00:19:32.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af59bd0 con 0x7fb2f8039040 2024-09-12T00:19:32.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94030171310768] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94030171312304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af59a60 con 0x7fb2f8039040 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=0 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=1 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=2 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=3 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=4 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=5 2024-09-12T00:19:32.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.393+0000 7fb3071469c0 20 add_watcher() i=6 2024-09-12T00:19:32.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94030171312304] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40a8070 con 0x7fb2f8039040 2024-09-12T00:19:32.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 20 add_watcher() i=7 2024-09-12T00:19:32.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:32.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af5cfd0 con 0x55851af498f0 2024-09-12T00:19:32.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2f40a8070 con 0x55851af498f0 2024-09-12T00:19:32.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94030171313424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af5a4f0 con 0x55851af498f0 2024-09-12T00:19:32.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94030171313424] v33'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb1bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:32.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:32.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:32.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.397+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af5cde0 con 0x55851af498f0 2024-09-12T00:19:32.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.401+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.401+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af5cde0 con 0x7fb2f8039040 2024-09-12T00:19:32.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.401+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.401+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af685e0 con 0x55851af4e300 2024-09-12T00:19:32.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af689e0 con 0x55851af498f0 2024-09-12T00:19:32.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'198 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68e30 con 0x7fb2fc021440 2024-09-12T00:19:32.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'72 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.405+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68e30 con 0x55851af4e300 2024-09-12T00:19:32.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.409+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'55 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.409+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68e30 con 0x55851af498f0 2024-09-12T00:19:32.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.409+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.409+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68f00 con 0x7fb2f8039040 2024-09-12T00:19:32.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.413+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.413+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68f00 con 0x7fb2fc021440 2024-09-12T00:19:32.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.413+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.413+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68f00 con 0x55851af4e300 2024-09-12T00:19:32.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.417+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.417+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68f00 con 0x7fb2fc021440 2024-09-12T00:19:32.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.417+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'73 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.417+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af68f00 con 0x7fb2f8039040 2024-09-12T00:19:32.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.421+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.421+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af698b0 con 0x7fb2fc021440 2024-09-12T00:19:32.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.421+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.421+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69890 con 0x7fb2f8039040 2024-09-12T00:19:32.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.425+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'63 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.425+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69860 con 0x55851af498f0 2024-09-12T00:19:32.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.425+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'199 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.425+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.429+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'65 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.429+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x7fb2fc021440 2024-09-12T00:19:32.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.429+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'74 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.429+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.433+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.433+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af498f0 2024-09-12T00:19:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.433+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.433+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af498f0 2024-09-12T00:19:32.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'200 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'66 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x7fb2fc021440 2024-09-12T00:19:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.437+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697d0 con 0x55851af4e300 2024-09-12T00:19:32.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.441+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x55851af4e300 2024-09-12T00:19:32.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.445+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.445+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x7fb2f8039040 2024-09-12T00:19:32.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.445+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.445+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x55851af4e300 2024-09-12T00:19:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.449+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.449+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x7fb2f8039040 2024-09-12T00:19:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.449+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.449+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x55851af4e300 2024-09-12T00:19:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.453+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'67 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.453+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af69780 con 0x7fb2f8039040 2024-09-12T00:19:32.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af697c0 con 0x7fb2fc021440 2024-09-12T00:19:32.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb1ba7e4640 20 reqs_thread_entry: start 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 20 Filter name: none 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb1b37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:32.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af67f70 con 0x55851af498f0 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.457+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:32.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55851af679e0 con 0x7fb2fc021440 2024-09-12T00:19:32.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.465 INFO:teuthology.orchestra.run.smithi066.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T00:19:32.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb1bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:32.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94030171313424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af5adc0 con 0x55851af498f0 2024-09-12T00:19:32.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94030171313424] v33'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.461+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94030171293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af594d0 con 0x7fb2fc021440 2024-09-12T00:19:32.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94030171293952] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb3071469c0 20 remove_watcher() i=0 2024-09-12T00:19:32.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb3071469c0 2 removed watcher, disabling cache 2024-09-12T00:19:32.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94030171297568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af54900 con 0x55851af498f0 2024-09-12T00:19:32.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94030171297568] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb3071469c0 20 remove_watcher() i=1 2024-09-12T00:19:32.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.465+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94030171299408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af55720 con 0x55851af4e300 2024-09-12T00:19:32.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb30544d640 1 -- 172.21.15.66:0/1340906224 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94030171299408] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc038020 con 0x55851af4e300 2024-09-12T00:19:32.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb3071469c0 20 remove_watcher() i=2 2024-09-12T00:19:32.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94030171304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af55720 con 0x7fb2fc021440 2024-09-12T00:19:32.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb304c4c640 1 -- 172.21.15.66:0/1340906224 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94030171304208] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f8008030 con 0x7fb2fc021440 2024-09-12T00:19:32.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb3071469c0 20 remove_watcher() i=3 2024-09-12T00:19:32.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.469+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94030171307808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af57110 con 0x55851af498f0 2024-09-12T00:19:32.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94030171307808] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x55851af498f0 2024-09-12T00:19:32.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb3071469c0 20 remove_watcher() i=4 2024-09-12T00:19:32.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94030171309712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af55720 con 0x7fb2f8039040 2024-09-12T00:19:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94030171309712] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb3071469c0 20 remove_watcher() i=5 2024-09-12T00:19:32.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.473+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94030171310768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af55720 con 0x7fb2f8039040 2024-09-12T00:19:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94030171310768] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 20 remove_watcher() i=6 2024-09-12T00:19:32.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94030171312304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55851af55720 con 0x7fb2f8039040 2024-09-12T00:19:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94030171312304] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2f40d5040 con 0x7fb2f8039040 2024-09-12T00:19:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 20 remove_watcher() i=7 2024-09-12T00:19:32.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2f8039040 msgr2=0x7fb2f8050a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fb2f8039040 0x7fb2f8050a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851af498f0 msgr2=0x55851af4bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851af498f0 0x55851af4bdb0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb2fc021440 msgr2=0x7fb2fc04b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fb2fc021440 0x7fb2fc04b0b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af4e300 msgr2=0x55851af506f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af4e300 0x55851af506f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1d0039a70 msgr2=0x7fb1d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1d0039a70 0x7fb1d003bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8016fd0 tx=0x7fb2f8034000 comp rx=0 tx=0).stop 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb30444b640 1 -- 172.21.15.66:0/1340906224 reap_dead start 2024-09-12T00:19:32.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 msgr2=0x55851af3e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.477+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01fce0 tx=0x7fb2fc0508b0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 shutdown_connections 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1340906224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af38250 0x55851af3e750 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 >> 172.21.15.66:0/1340906224 conn(0x55851af33610 msgr2=0x55851af31820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 shutdown_connections 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1340906224 wait complete. 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 msgr2=0x7fb1dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 0x7fb1dc03bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8001430 tx=0x7fb2f8018ce0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 msgr2=0x55851af2ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x55851af11f80 tx=0x7fb2fc0167b0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 shutdown_connections 2024-09-12T00:19:32.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1dc039a70 0x7fb1dc03bf30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/771369584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851af2a900 0x55851af2ad20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 >> 172.21.15.66:0/771369584 conn(0x55851af202b0 msgr2=0x55851af20690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 shutdown_connections 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/771369584 wait complete. 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 msgr2=0x55851af16fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 0x55851af16fa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 msgr2=0x55851af1bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 0x55851af1bae0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 msgr2=0x7fb1ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 0x7fb1ec03bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ae000 tx=0x7fb2f40a6000 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 msgr2=0x55851af0fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b710 tx=0x7fb2f8000bd0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 shutdown_connections 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55851af196f0 0x55851af1bae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55851ae216c0 0x55851af16fa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb1ec039a70 0x7fb1ec03bf30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 --2- 172.21.15.66:0/1023983224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55851ae1d520 0x55851af0fe30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 >> 172.21.15.66:0/1023983224 conn(0x55851ae19040 msgr2=0x55851af02f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 shutdown_connections 2024-09-12T00:19:32.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:19:32.481+0000 7fb3071469c0 1 -- 172.21.15.66:0/1023983224 wait complete. 2024-09-12T00:19:32.497 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T00:19:32.522 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:19:32.569 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T00:20:07.570 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-12T00:20:07.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-12T00:20:07.571 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-12T00:20:07.613 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:07.613 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:07.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5ff90a9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557d461ca770 0x557d461cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5ff90a9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d4607c9c0 con 0x557d461cd8b0 2024-09-12T00:20:07.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5ff90a9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x557d460cc6d0 con 0x557d461ca770 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5fd410640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557d461ca770 0x557d461cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5fd410640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x557d461ca770 0x557d461cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41408/0 (socket says 172.21.15.66:41408) 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5fd410640 1 -- 172.21.15.66:0/737771517 learned_addr learned my addr 172.21.15.66:0/737771517 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.609+0000 7fd5fcc0f640 1 --1- 172.21.15.66:0/737771517 >> v1:172.21.15.31:6789/0 conn(0x557d461cd8b0 0x557d461cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37870/0 (socket says 172.21.15.66:37870) 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5fd410640 1 -- 172.21.15.66:0/737771517 >> v1:172.21.15.31:6789/0 conn(0x557d461cd8b0 legacy=0x557d461cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5fd410640 1 -- 172.21.15.66:0/737771517 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d46070ca0 con 0x557d461ca770 2024-09-12T00:20:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5fd410640 1 --2- 172.21.15.66:0/737771517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d461cab50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000a4e0 tx=0x7fd5f001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529cb93a1417941a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5effff640 1 -- 172.21.15.66:0/737771517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00aa540 con 0x557d461ca770 2024-09-12T00:20:07.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5effff640 1 -- 172.21.15.66:0/737771517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f00aa6e0 con 0x557d461ca770 2024-09-12T00:20:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5effff640 1 -- 172.21.15.66:0/737771517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00aaa40 con 0x557d461ca770 2024-09-12T00:20:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/737771517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 msgr2=0x557d461cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/737771517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d461cab50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000a4e0 tx=0x7fd5f001b090 comp rx=0 tx=0).stop 2024-09-12T00:20:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/737771517 shutdown_connections 2024-09-12T00:20:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/737771517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d461cab50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/737771517 >> 172.21.15.66:0/737771517 conn(0x557d4613e080 msgr2=0x557d4613e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/737771517 shutdown_connections 2024-09-12T00:20:07.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.613+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/737771517 wait complete. 2024-09-12T00:20:07.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.629+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.629+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.629+0000 7fd5ff90a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.629+0000 7fd5ff90a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557d460d0680 con 0x557d461ca770 2024-09-12T00:20:07.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41424/0 (socket says 172.21.15.66:41424) 2024-09-12T00:20:07.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 -- 172.21.15.66:0/1343901422 learned_addr learned my addr 172.21.15.66:0/1343901422 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 -- 172.21.15.66:0/1343901422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d4604bda0 con 0x557d461ca770 2024-09-12T00:20:07.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 --2- 172.21.15.66:0/1343901422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0017ca0 tx=0x7fd5f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ac83f07362f37a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd4eb606640 1 -- 172.21.15.66:0/1343901422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00b9030 con 0x557d461ca770 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd4eb606640 1 -- 172.21.15.66:0/1343901422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f00aaa80 con 0x557d461ca770 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd4eb606640 1 -- 172.21.15.66:0/1343901422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00aada0 con 0x557d461ca770 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1343901422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 msgr2=0x557d462b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1343901422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0017ca0 tx=0x7fd5f00033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1343901422 shutdown_connections 2024-09-12T00:20:07.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1343901422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461ca770 0x557d462b5a30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1343901422 >> 172.21.15.66:0/1343901422 conn(0x557d4613e080 msgr2=0x557d462b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1343901422 shutdown_connections 2024-09-12T00:20:07.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1343901422 wait complete. 2024-09-12T00:20:07.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5ff90a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557d46072a50 con 0x557d461cd8b0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41428/0 (socket says 172.21.15.66:41428) 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 -- 172.21.15.66:0/457560045 learned_addr learned my addr 172.21.15.66:0/457560045 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.633+0000 7fd5fd410640 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d462bd770 con 0x557d461cd8b0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fd410640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0000f90 tx=0x7fd5f0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 -- 172.21.15.66:0/457560045 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00b9070 con 0x557d461cd8b0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d462bda00 con 0x557d461cd8b0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 -- 172.21.15.66:0/457560045 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f00c3030 con 0x557d461cd8b0 2024-09-12T00:20:07.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 -- 172.21.15.66:0/457560045 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f00cd060 con 0x557d461cd8b0 2024-09-12T00:20:07.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d462be2c0 con 0x557d461cd8b0 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 -- 172.21.15.66:0/457560045 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd5f00b3040 con 0x557d461cd8b0 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 0x7fd4e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd4e9e03640 1 -- 172.21.15.66:0/457560045 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fd5f00ba070 con 0x557d461cd8b0 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 0x7fd4e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 0x557d462c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462c4bb0 con 0x557d462c2280 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 0x557d462c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 0x7fd4e403bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001e90 tx=0x7fd5f40013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 0x557d462c4670 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5fdc11640 1 -- 172.21.15.66:0/457560045 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f80083f0 con 0x557d462c2280 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.637+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462c5020 con 0x557d462c2280 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 -- 172.21.15.66:0/457560045 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5f80083f0 con 0x557d462c2280 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 0x557d462c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462c98f0 con 0x557d462c6e30 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fd410640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 0x557d462c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fd410640 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 0x557d462c9220 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fd410640 1 -- 172.21.15.66:0/457560045 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5f00c8990 con 0x557d462c6e30 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462c5cd0 con 0x557d462c2280 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 -- 172.21.15.66:0/457560045 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5f80083f0 con 0x557d462c2280 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462c6190 con 0x557d462c6e30 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fd410640 1 -- 172.21.15.66:0/457560045 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5f00c8990 con 0x557d462c6e30 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5ff90a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557d460dd450 con 0x557d462d8020 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41442/0 (socket says 172.21.15.66:41442) 2024-09-12T00:20:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 -- 172.21.15.66:0/1390118552 learned_addr learned my addr 172.21.15.66:0/1390118552 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 -- 172.21.15.66:0/1390118552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d462d8a80 con 0x557d462d8020 2024-09-12T00:20:07.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.641+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x557d462be4b0 tx=0x7fd5f800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 -- 172.21.15.66:0/1390118552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f801c020 con 0x557d462d8020 2024-09-12T00:20:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 -- 172.21.15.66:0/1390118552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f8007d00 con 0x557d462d8020 2024-09-12T00:20:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 -- 172.21.15.66:0/1390118552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8018440 con 0x557d462d8020 2024-09-12T00:20:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d462d92e0 con 0x557d462d8020 2024-09-12T00:20:07.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d462d9850 con 0x557d462d8020 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 -- 172.21.15.66:0/1390118552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd5f801f020 con 0x557d462d8020 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 0x7fd4d403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd4e2ffd640 1 -- 172.21.15.66:0/1390118552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fd5f8051d90 con 0x557d462d8020 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fd410640 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 0x7fd4d403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fd410640 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 0x7fd4d403bf80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557d462be570 tx=0x7fd5f00bef90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5ff90a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557d462b61a0 con 0x557d462e59d0 2024-09-12T00:20:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41458/0 (socket says 172.21.15.66:41458) 2024-09-12T00:20:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fdc11640 1 -- 172.21.15.66:0/2327906197 learned_addr learned my addr 172.21.15.66:0/2327906197 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.645+0000 7fd5fdc11640 1 -- 172.21.15.66:0/2327906197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d462e6380 con 0x557d462e59d0 2024-09-12T00:20:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/2327906197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80500b0 tx=0x7fd5f8016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e025cac43074c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4e0ff9640 1 -- 172.21.15.66:0/2327906197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8021400 con 0x557d462e59d0 2024-09-12T00:20:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4e0ff9640 1 -- 172.21.15.66:0/2327906197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f8029c50 con 0x557d462e59d0 2024-09-12T00:20:07.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4e0ff9640 1 -- 172.21.15.66:0/2327906197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f80215a0 con 0x557d462e59d0 2024-09-12T00:20:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/2327906197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 msgr2=0x557d462e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/2327906197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80500b0 tx=0x7fd5f8016970 comp rx=0 tx=0).stop 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/2327906197 shutdown_connections 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/2327906197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462e5db0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/2327906197 >> 172.21.15.66:0/2327906197 conn(0x557d462e0d90 msgr2=0x557d462defd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/2327906197 shutdown_connections 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/2327906197 wait complete. 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 Processor -- start 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- start start 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557d462e48c0 con 0x557d462e59d0 2024-09-12T00:20:07.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41464/0 (socket says 172.21.15.66:41464) 2024-09-12T00:20:07.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 learned_addr learned my addr 172.21.15.66:0/3248689319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d462ec3a0 con 0x557d462e59d0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80169b0 tx=0x7fd5f8050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4d2ffd640 1 -- 172.21.15.66:0/3248689319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8039070 con 0x557d462e59d0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4d2ffd640 1 -- 172.21.15.66:0/3248689319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f80289c0 con 0x557d462e59d0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d462ec630 con 0x557d462e59d0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd4d2ffd640 1 -- 172.21.15.66:0/3248689319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f8028d00 con 0x557d462e59d0 2024-09-12T00:20:07.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.649+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d462ecfe0 con 0x557d462e59d0 2024-09-12T00:20:07.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd4d2ffd640 1 -- 172.21.15.66:0/3248689319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd5f803c070 con 0x557d462e59d0 2024-09-12T00:20:07.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd4d2ffd640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4c8039a70 0x7fd4c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd4d2ffd640 1 -- 172.21.15.66:0/3248689319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fd5f8031070 con 0x557d462e59d0 2024-09-12T00:20:07.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fd410640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4c8039a70 0x7fd4c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462f7330 0x557d462f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462f9f10 con 0x557d462f7330 2024-09-12T00:20:07.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462f7330 0x557d462f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fd410640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4c8039a70 0x7fd4c803bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00b4930 tx=0x7fd5f0004910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462f7330 0x557d462f97c0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f400f660 con 0x557d462f7330 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 realm 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462f6740 con 0x557d462f7330 2024-09-12T00:20:07.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f400f660 con 0x557d462f7330 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462faa10 con 0x557d462f7330 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f400f660 con 0x557d462f7330 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462fb2e0 con 0x557d462f7330 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5f400f660 con 0x557d462f7330 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462fbb90 0x557d462fdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462fe6e0 con 0x557d462fbb90 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.653+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462fbb90 0x557d462fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462fbb90 0x557d462fdf80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5ff90a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5ff90a9c0 20 searching for the correct realm 2024-09-12T00:20:07.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fdc11640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd5f8021020 0x7fd5f80203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fd410640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd5f8021020 0x7fd5f80203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fd410640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd5f8021020 0x7fd5f80203b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fd410640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd5f00f8040 0x7fd5f00e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd5f00f8040 0x7fd5f00e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd5f00f8040 0x7fd5f00e9af0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f400f660 con 0x7fd5f00f8040 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f400f660 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.657+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.661+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x557d462f7330 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.665+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462fbb90 2024-09-12T00:20:07.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f00f8040 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f402b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x557d462f7330 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d46300000 con 0x7fd5f8021020 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:07.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462ff0f0 con 0x557d462f7330 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.669+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462ff990 con 0x557d462f7330 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462fed30 con 0x557d462fbb90 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:07.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 zone default found 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 4 Realm: () 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 zonegroup default 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d462ff5c0 con 0x7fd5f00f8040 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46302880 con 0x557d462fbb90 2024-09-12T00:20:07.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46302880 con 0x557d462fbb90 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 started sync module instance, tier type = 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46301d10 con 0x7fd5f8021020 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996536832304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46302cc0 con 0x7fd5f8021020 2024-09-12T00:20:07.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.673+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46303510 con 0x557d462f7330 2024-09-12T00:20:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.677+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996536832304] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.677+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.677+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996536836192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46303930 con 0x557d462f7330 2024-09-12T00:20:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.677+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46304180 con 0x557d462fbb90 2024-09-12T00:20:07.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996536838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46304570 con 0x557d462fbb90 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305020 con 0x7fd5f8021020 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996536836192] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996536837248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305440 con 0x7fd5f8021020 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305e00 con 0x557d462f7330 2024-09-12T00:20:07.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996536838752] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996536837248] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996536840000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46304c40 con 0x557d462f7330 2024-09-12T00:20:07.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.681+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305e00 con 0x7fd5f00f8040 2024-09-12T00:20:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996536840000] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996536849424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305e00 con 0x7fd5f00f8040 2024-09-12T00:20:07.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46306fb0 con 0x7fd5f00f8040 2024-09-12T00:20:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996536851200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d463073d0 con 0x7fd5f00f8040 2024-09-12T00:20:07.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.685+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46307e50 con 0x7fd5f00f8040 2024-09-12T00:20:07.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996536849424] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996536851200] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996536854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46306f20 con 0x7fd5f00f8040 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=0 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=1 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=2 2024-09-12T00:20:07.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=3 2024-09-12T00:20:07.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=4 2024-09-12T00:20:07.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=5 2024-09-12T00:20:07.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.689+0000 7fd5ff90a9c0 20 add_watcher() i=6 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996536854848] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 20 add_watcher() i=7 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4630af50 con 0x557d462f7330 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996536846672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d463083d0 con 0x557d462f7330 2024-09-12T00:20:07.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996536846672] v33'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd4b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:07.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:07.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 5 note: GC not initialized 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd4b27e4640 20 reqs_thread_entry: start 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 20 Filter name: none 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd423fff640 20 reqs_thread_entry: start 2024-09-12T00:20:07.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e950 con 0x557d462f7330 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e950 con 0x7fd5f8021020 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462f7330 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.693+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462fbb90 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462fbb90 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462fbb90 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462f7330 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462f7330 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462fbb90 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x557d462fbb90 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632e910 con 0x7fd5f00f8040 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46330000 con 0x557d462f7330 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.697+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46330000 con 0x7fd5f8021020 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46330000 con 0x557d462fbb90 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d46330000 con 0x7fd5f00f8040 2024-09-12T00:20:07.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff70 con 0x7fd5f00f8040 2024-09-12T00:20:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff70 con 0x557d462fbb90 2024-09-12T00:20:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff70 con 0x7fd5f00f8040 2024-09-12T00:20:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff20 con 0x557d462f7330 2024-09-12T00:20:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff20 con 0x557d462fbb90 2024-09-12T00:20:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.701+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632ff00 con 0x7fd5f00f8040 2024-09-12T00:20:07.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x7fd5f8021020 2024-09-12T00:20:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x7fd5f00f8040 2024-09-12T00:20:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462f7330 2024-09-12T00:20:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462f7330 2024-09-12T00:20:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462fbb90 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462f7330 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462f7330 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462fbb90 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.705+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462fbb90 2024-09-12T00:20:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x557d462fbb90 2024-09-12T00:20:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d4632fee0 con 0x7fd5f00f8040 2024-09-12T00:20:07.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd4b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:07.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996536846672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d463083d0 con 0x557d462f7330 2024-09-12T00:20:07.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93996536846672] v33'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.709+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996536832304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305950 con 0x7fd5f8021020 2024-09-12T00:20:07.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93996536832304] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5ff90a9c0 20 remove_watcher() i=0 2024-09-12T00:20:07.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5ff90a9c0 2 removed watcher, disabling cache 2024-09-12T00:20:07.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996536836192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305950 con 0x557d462f7330 2024-09-12T00:20:07.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93996536836192] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5ff90a9c0 20 remove_watcher() i=1 2024-09-12T00:20:07.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.713+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996536838752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46303060 con 0x557d462fbb90 2024-09-12T00:20:07.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5fdc11640 1 -- 172.21.15.66:0/3248689319 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93996536838752] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f803b030 con 0x557d462fbb90 2024-09-12T00:20:07.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5ff90a9c0 20 remove_watcher() i=2 2024-09-12T00:20:07.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996536837248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305950 con 0x7fd5f8021020 2024-09-12T00:20:07.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5fd410640 1 -- 172.21.15.66:0/3248689319 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93996536837248] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f00d7050 con 0x7fd5f8021020 2024-09-12T00:20:07.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5ff90a9c0 20 remove_watcher() i=3 2024-09-12T00:20:07.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.717+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996536840000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46303a60 con 0x557d462f7330 2024-09-12T00:20:07.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93996536840000] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x557d462f7330 2024-09-12T00:20:07.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5ff90a9c0 20 remove_watcher() i=4 2024-09-12T00:20:07.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996536849424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305950 con 0x7fd5f00f8040 2024-09-12T00:20:07.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93996536849424] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5ff90a9c0 20 remove_watcher() i=5 2024-09-12T00:20:07.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.721+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996536851200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46303a60 con 0x7fd5f00f8040 2024-09-12T00:20:07.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.725+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93996536851200] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.725+0000 7fd5ff90a9c0 20 remove_watcher() i=6 2024-09-12T00:20:07.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.725+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996536854848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d46305950 con 0x7fd5f00f8040 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.725+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93996536854848] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f403b040 con 0x7fd5f00f8040 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.725+0000 7fd5ff90a9c0 20 remove_watcher() i=7 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd5f00f8040 msgr2=0x7fd5f00e9af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fd5f00f8040 0x7fd5f00e9af0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462f7330 msgr2=0x557d462f97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462f7330 0x557d462f97c0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd5f8021020 msgr2=0x7fd5f80203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fd5f8021020 0x7fd5f80203b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462fbb90 msgr2=0x557d462fdf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462fbb90 0x557d462fdf80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4c8039a70 msgr2=0x7fd4c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4c8039a70 0x7fd4c803bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00b4930 tx=0x7fd5f0004910 comp rx=0 tx=0).stop 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 msgr2=0x557d462ebe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd5f80169b0 tx=0x7fd5f8050040 comp rx=0 tx=0).stop 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5fcc0f640 1 -- 172.21.15.66:0/3248689319 reap_dead start 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 shutdown_connections 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/3248689319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462e59d0 0x557d462ebe40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 >> 172.21.15.66:0/3248689319 conn(0x557d462e0d90 msgr2=0x557d462e5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 shutdown_connections 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/3248689319 wait complete. 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 msgr2=0x7fd4d403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 0x7fd4d403bf80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557d462be570 tx=0x7fd5f00bef90 comp rx=0 tx=0).stop 2024-09-12T00:20:07.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 msgr2=0x557d462d8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x557d462be4b0 tx=0x7fd5f800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 shutdown_connections 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4d4039ac0 0x7fd4d403bf80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/1390118552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d462d8020 0x557d462d8440 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 >> 172.21.15.66:0/1390118552 conn(0x557d462cd9d0 msgr2=0x557d462cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 shutdown_connections 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/1390118552 wait complete. 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 msgr2=0x557d462c4670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 0x557d462c4670 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 msgr2=0x557d462c9220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 0x557d462c9220 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 msgr2=0x7fd4e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 0x7fd4e403bf30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4001e90 tx=0x7fd5f40013f0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 msgr2=0x557d462bd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0000f90 tx=0x7fd5f0017e30 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 shutdown_connections 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x557d462c6e30 0x557d462c9220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x557d462c2280 0x557d462c4670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd4e4039a70 0x7fd4e403bf30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 --2- 172.21.15.66:0/457560045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557d461cd8b0 0x557d462bd210 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 >> 172.21.15.66:0/457560045 conn(0x557d4613e080 msgr2=0x557d462b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 shutdown_connections 2024-09-12T00:20:07.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.729+0000 7fd5ff90a9c0 1 -- 172.21.15.66:0/457560045 wait complete. 2024-09-12T00:20:07.745 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:07.745 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:07.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T00:20:07.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T00:20:07.746 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T00:20:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f7fa59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfdb424540 0x55cfdb426930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f7fa59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfdb2d59c0 con 0x55cfdb420350 2024-09-12T00:20:07.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f7fa59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55cfdb3256d0 con 0x55cfdb424540 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f52aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfdb424540 0x55cfdb426930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f52aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55cfdb424540 0x55cfdb426930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41472/0 (socket says 172.21.15.66:41472) 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.813+0000 7f61f5aab640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55cfdb420350 0x55cfdb420730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37882/0 (socket says 172.21.15.66:37882) 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f52aa640 1 -- 172.21.15.66:0/4153066130 learned_addr learned my addr 172.21.15.66:0/4153066130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f52aa640 1 -- 172.21.15.66:0/4153066130 >> v1:172.21.15.31:6789/0 conn(0x55cfdb420350 legacy=0x55cfdb420730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f52aa640 1 -- 172.21.15.66:0/4153066130 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb2c9ca0 con 0x55cfdb424540 2024-09-12T00:20:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f52aa640 1 --2- 172.21.15.66:0/4153066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb424540 0x55cfdb426930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00a4e0 tx=0x7f61ec01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537e7a155b09a6f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f4aa9640 1 -- 172.21.15.66:0/4153066130 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec0aa540 con 0x55cfdb424540 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f4aa9640 1 -- 172.21.15.66:0/4153066130 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec0aa6e0 con 0x55cfdb424540 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f4aa9640 1 -- 172.21.15.66:0/4153066130 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61ec0aaa40 con 0x55cfdb424540 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4153066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb424540 msgr2=0x55cfdb426930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.817+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4153066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb424540 0x55cfdb426930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00a4e0 tx=0x7f61ec01b120 comp rx=0 tx=0).stop 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.821+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4153066130 shutdown_connections 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.821+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4153066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb424540 0x55cfdb426930 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.821+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4153066130 >> 172.21.15.66:0/4153066130 conn(0x55cfdb41be70 msgr2=0x55cfdb41e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.821+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4153066130 shutdown_connections 2024-09-12T00:20:07.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.821+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4153066130 wait complete. 2024-09-12T00:20:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb329680 con 0x55cfdb420350 2024-09-12T00:20:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f5aab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f5aab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41480/0 (socket says 172.21.15.66:41480) 2024-09-12T00:20:07.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f5aab640 1 -- 172.21.15.66:0/405156914 learned_addr learned my addr 172.21.15.66:0/405156914 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f5aab640 1 -- 172.21.15.66:0/405156914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb2a4da0 con 0x55cfdb420350 2024-09-12T00:20:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f5aab640 1 --2- 172.21.15.66:0/405156914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001ec0 tx=0x7f61e800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dd91194765fce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f60e3e07640 1 -- 172.21.15.66:0/405156914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e800e5d0 con 0x55cfdb420350 2024-09-12T00:20:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f60e3e07640 1 -- 172.21.15.66:0/405156914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e800e770 con 0x55cfdb420350 2024-09-12T00:20:07.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f60e3e07640 1 -- 172.21.15.66:0/405156914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e800ea70 con 0x55cfdb420350 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/405156914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 msgr2=0x55cfdb395240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/405156914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f61e8001ec0 tx=0x7f61e800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/405156914 shutdown_connections 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/405156914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb395240 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/405156914 >> 172.21.15.66:0/405156914 conn(0x55cfdb41be70 msgr2=0x55cfdb507370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/405156914 shutdown_connections 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/405156914 wait complete. 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.837+0000 7f61f7fa59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb2cba50 con 0x55cfdb420350 2024-09-12T00:20:07.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f5aab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f5aab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41490/0 (socket says 172.21.15.66:41490) 2024-09-12T00:20:07.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f5aab640 1 -- 172.21.15.66:0/4217745631 learned_addr learned my addr 172.21.15.66:0/4217745631 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f5aab640 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb50d220 con 0x55cfdb420350 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f5aab640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55cfdb50d7c0 tx=0x7f61e8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 -- 172.21.15.66:0/4217745631 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e800f8e0 con 0x55cfdb420350 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdb50b600 con 0x55cfdb420350 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 -- 172.21.15.66:0/4217745631 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e800fa80 con 0x55cfdb420350 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 -- 172.21.15.66:0/4217745631 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61e800fda0 con 0x55cfdb420350 2024-09-12T00:20:07.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdb50bb90 con 0x55cfdb420350 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 -- 172.21.15.66:0/4217745631 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61e8017070 con 0x55cfdb420350 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 0x7f60dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f60e2604640 1 -- 172.21.15.66:0/4217745631 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f61e8015020 con 0x55cfdb420350 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f52aa640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 0x7f60dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 0x55cfdb51d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb51d780 con 0x55cfdb424540 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f62ac640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 0x55cfdb51d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f52aa640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 0x7f60dc03bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0ab000 tx=0x7f61ec0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.841+0000 7f61f62ac640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 0x55cfdb51d240 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 -- 172.21.15.66:0/4217745631 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61f00083f0 con 0x55cfdb424540 2024-09-12T00:20:07.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb51db60 con 0x55cfdb424540 2024-09-12T00:20:07.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 -- 172.21.15.66:0/4217745631 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61f00083f0 con 0x55cfdb424540 2024-09-12T00:20:07.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 0x55cfdb521d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb522430 con 0x55cfdb51f970 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f5aab640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 0x55cfdb521d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f5aab640 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 0x55cfdb521d60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f5aab640 1 -- 172.21.15.66:0/4217745631 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61e802e070 con 0x55cfdb51f970 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb51e810 con 0x55cfdb424540 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 -- 172.21.15.66:0/4217745631 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61f00083f0 con 0x55cfdb424540 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb51ecd0 con 0x55cfdb51f970 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f5aab640 1 -- 172.21.15.66:0/4217745631 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61e802e070 con 0x55cfdb51f970 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f7fa59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb336450 con 0x55cfdb530b60 2024-09-12T00:20:07.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41494/0 (socket says 172.21.15.66:41494) 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.845+0000 7f61f62ac640 1 -- 172.21.15.66:0/341904030 learned_addr learned my addr 172.21.15.66:0/341904030 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 -- 172.21.15.66:0/341904030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb5315c0 con 0x55cfdb530b60 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55cfdb50c890 tx=0x7f61f000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 -- 172.21.15.66:0/341904030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f001c020 con 0x55cfdb530b60 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 -- 172.21.15.66:0/341904030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0007d00 con 0x55cfdb530b60 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 -- 172.21.15.66:0/341904030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0018440 con 0x55cfdb530b60 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdb531e20 con 0x55cfdb530b60 2024-09-12T00:20:07.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdb532390 con 0x55cfdb530b60 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 -- 172.21.15.66:0/341904030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61f001f020 con 0x55cfdb530b60 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 0x7f60d003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f60db7fe640 1 -- 172.21.15.66:0/341904030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f61f0051d20 con 0x55cfdb530b60 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f5aab640 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 0x7f60d003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f5aab640 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 0x7f60d003bf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f61e800b710 tx=0x7f61e800bf70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f7fa59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb395a90 con 0x55cfdb53e4f0 2024-09-12T00:20:07.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41498/0 (socket says 172.21.15.66:41498) 2024-09-12T00:20:07.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 -- 172.21.15.66:0/4230335983 learned_addr learned my addr 172.21.15.66:0/4230335983 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.849+0000 7f61f62ac640 1 -- 172.21.15.66:0/4230335983 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb53eee0 con 0x55cfdb53e4f0 2024-09-12T00:20:07.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 --2- 172.21.15.66:0/4230335983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f61f0021fd0 tx=0x7f61f00168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d43f2e9baf25550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60d97fa640 1 -- 172.21.15.66:0/4230335983 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0029c20 con 0x55cfdb53e4f0 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60d97fa640 1 -- 172.21.15.66:0/4230335983 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0051040 con 0x55cfdb53e4f0 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60d97fa640 1 -- 172.21.15.66:0/4230335983 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0021400 con 0x55cfdb53e4f0 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4230335983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 msgr2=0x55cfdb53e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4230335983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f61f0021fd0 tx=0x7f61f00168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4230335983 shutdown_connections 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4230335983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb53e8f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4230335983 >> 172.21.15.66:0/4230335983 conn(0x55cfdb539910 msgr2=0x55cfdb537b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4230335983 shutdown_connections 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4230335983 wait complete. 2024-09-12T00:20:07.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 Processor -- start 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- start start 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cfdb53d440 con 0x55cfdb53e4f0 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41510/0 (socket says 172.21.15.66:41510) 2024-09-12T00:20:07.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 learned_addr learned my addr 172.21.15.66:0/2397233992 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:07.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfdb544f90 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f62ac640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f61f00168f0 tx=0x7f61f004ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60c77fe640 1 -- 172.21.15.66:0/2397233992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0029480 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60c77fe640 1 -- 172.21.15.66:0/2397233992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0051050 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfdb545220 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f60c77fe640 1 -- 172.21.15.66:0/2397233992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f0020bb0 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.853+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfdb545bd0 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f60c77fe640 1 -- 172.21.15.66:0/2397233992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f61f0034030 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f60c77fe640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 0x7f60c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f60c77fe640 1 -- 172.21.15.66:0/2397233992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f61f0032070 con 0x55cfdb53e4f0 2024-09-12T00:20:07.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f5aab640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 0x7f60c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 0x55cfdb552330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb552a80 con 0x55cfdb54fea0 2024-09-12T00:20:07.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 0x55cfdb552330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f5aab640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 0x7f60c003bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61e801bce0 tx=0x7f61e8037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 0x55cfdb552330 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 realm 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb552eb0 con 0x55cfdb54fea0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:07.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb553780 con 0x55cfdb54fea0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb553b20 con 0x55cfdb54fea0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 0x55cfdb556c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb5571b0 con 0x55cfdb554880 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f62ac640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 0x55cfdb556c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f62ac640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 0x55cfdb556c70 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 20 searching for the correct realm 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb558a10 con 0x55cfdb554880 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.857+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f62ac640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 0x7f61f004a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb558a10 con 0x7f61f0021020 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f5aab640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 0x7f61f004a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f5aab640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 0x7f61f004a070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f5aab640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 0x7f61e8042540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb558a10 con 0x7f61e801d790 2024-09-12T00:20:07.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 0x7f61e8042540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 0x7f61e8042540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb558a10 con 0x55cfdb54fea0 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb558a10 con 0x55cfdb54fea0 2024-09-12T00:20:07.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.861+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x7f61e801d790 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x7f61f0021020 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x55cfdb554880 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x7f61f0021020 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61ec0cc040 con 0x7f61f0021020 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61e801d790 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.865+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb54fea0 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb54fea0 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61e801d790 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61f0021020 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb54fea0 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61e801d790 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61e801d790 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61f0021020 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.869+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb554880 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61e801d790 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x55cfdb54fea0 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f61e8062060 con 0x7f61f0021020 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:07.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb557b00 con 0x55cfdb54fea0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb5583a0 con 0x55cfdb54fea0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb557740 con 0x55cfdb554880 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 zone default found 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 4 Realm: () 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 zonegroup default 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb557fd0 con 0x7f61e801d790 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.873+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55ae00 con 0x55cfdb554880 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55b270 con 0x55cfdb554880 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 20 started sync module instance, tier type = 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55a2a0 con 0x7f61f0021020 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351226414784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55bb80 con 0x7f61f0021020 2024-09-12T00:20:07.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55c3d0 con 0x55cfdb54fea0 2024-09-12T00:20:07.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.877+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351226414784] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351226418896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55c410 con 0x55cfdb54fea0 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55cf20 con 0x55cfdb554880 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351226418896] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351226423760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55cee0 con 0x55cfdb554880 2024-09-12T00:20:07.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55bf20 con 0x7f61f0021020 2024-09-12T00:20:07.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351226427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55cee0 con 0x7f61f0021020 2024-09-12T00:20:07.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.881+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55e850 con 0x55cfdb54fea0 2024-09-12T00:20:07.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351226423760] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351226427744] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351226428800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55e3a0 con 0x55cfdb54fea0 2024-09-12T00:20:07.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55ec30 con 0x7f61e801d790 2024-09-12T00:20:07.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.885+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351226428800] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351226426128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55e850 con 0x7f61e801d790 2024-09-12T00:20:07.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55f640 con 0x7f61e801d790 2024-09-12T00:20:07.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351226433936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55fa60 con 0x7f61e801d790 2024-09-12T00:20:07.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb560500 con 0x7f61e801d790 2024-09-12T00:20:07.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.889+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351226426128] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351226433936] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351226437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55f5b0 con 0x7f61e801d790 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=0 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=1 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=2 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=3 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=4 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=5 2024-09-12T00:20:07.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=6 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351226437584] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 20 add_watcher() i=7 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb563600 con 0x55cfdb54fea0 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.893+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351226430368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb560a80 con 0x55cfdb54fea0 2024-09-12T00:20:07.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351226430368] v33'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f60a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:07.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 5 note: GC not initialized 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f60a67fc640 20 reqs_thread_entry: start 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 20 Filter name: none 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f6017fff640 20 reqs_thread_entry: start 2024-09-12T00:20:07.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f80 con 0x55cfdb54fea0 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f80 con 0x7f61f0021020 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb54fea0 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.897+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb54fea0 2024-09-12T00:20:07.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb54fea0 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x7f61e801d790 2024-09-12T00:20:07.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588630 con 0x55cfdb54fea0 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x55cfdb54fea0 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588630 con 0x7f61f0021020 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588630 con 0x55cfdb554880 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.901+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588630 con 0x7f61e801d790 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588580 con 0x7f61e801d790 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588580 con 0x55cfdb554880 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588580 con 0x7f61e801d790 2024-09-12T00:20:07.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f61ec0bc040 con 0x7f61e801d790 2024-09-12T00:20:07.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588560 con 0x55cfdb54fea0 2024-09-12T00:20:07.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588560 con 0x55cfdb554880 2024-09-12T00:20:07.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x7f61e801d790 2024-09-12T00:20:07.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.905+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x7f61f0021020 2024-09-12T00:20:07.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x7f61e801d790 2024-09-12T00:20:07.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb54fea0 2024-09-12T00:20:07.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb54fea0 2024-09-12T00:20:07.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb554880 2024-09-12T00:20:07.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb54fea0 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb54fea0 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb554880 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb554880 2024-09-12T00:20:07.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x55cfdb554880 2024-09-12T00:20:07.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.909+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb588540 con 0x7f61e801d790 2024-09-12T00:20:07.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.913+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.913+0000 7f60a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:07.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.913+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351226430368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb560a80 con 0x55cfdb54fea0 2024-09-12T00:20:07.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.913+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94351226430368] v33'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.913+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351226414784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb55e3a0 con 0x7f61f0021020 2024-09-12T00:20:07.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94351226414784] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f7fa59c0 20 remove_watcher() i=0 2024-09-12T00:20:07.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f7fa59c0 2 removed watcher, disabling cache 2024-09-12T00:20:07.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351226418896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb54fea0 2024-09-12T00:20:07.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94351226418896] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f7fa59c0 20 remove_watcher() i=1 2024-09-12T00:20:07.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.917+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351226423760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb554880 2024-09-12T00:20:07.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f62ac640 1 -- 172.21.15.66:0/2397233992 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94351226423760] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61f003d070 con 0x55cfdb554880 2024-09-12T00:20:07.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 20 remove_watcher() i=2 2024-09-12T00:20:07.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351226427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x7f61f0021020 2024-09-12T00:20:07.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f5aab640 1 -- 172.21.15.66:0/2397233992 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94351226427744] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61e8052070 con 0x7f61f0021020 2024-09-12T00:20:07.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 20 remove_watcher() i=3 2024-09-12T00:20:07.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351226428800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x55cfdb54fea0 2024-09-12T00:20:07.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94351226428800] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x55cfdb54fea0 2024-09-12T00:20:07.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 20 remove_watcher() i=4 2024-09-12T00:20:07.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.921+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351226426128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x7f61e801d790 2024-09-12T00:20:07.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.925+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94351226426128] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.925+0000 7f61f7fa59c0 20 remove_watcher() i=5 2024-09-12T00:20:07.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.925+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351226433936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x7f61e801d790 2024-09-12T00:20:07.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94351226433936] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 20 remove_watcher() i=6 2024-09-12T00:20:07.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351226437584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cfdb586f40 con 0x7f61e801d790 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94351226437584] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61ec0d5040 con 0x7f61e801d790 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 20 remove_watcher() i=7 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 msgr2=0x7f61e8042540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 0x7f61e8042540 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 msgr2=0x55cfdb552330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 0x55cfdb552330 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 msgr2=0x7f61f004a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 0x7f61f004a070 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 msgr2=0x55cfdb556c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 0x55cfdb556c70 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 msgr2=0x7f60c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 0x7f60c003bf30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61e801bce0 tx=0x7f61e8037000 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 msgr2=0x55cfdb544a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f61f00168f0 tx=0x7f61f004ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 shutdown_connections 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f61e801d790 0x7f61e8042540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f61f0021020 0x7f61f004a070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb554880 0x55cfdb556c70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb54fea0 0x55cfdb552330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60c0039a70 0x7f60c003bf30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/2397233992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb53e4f0 0x55cfdb544a30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 >> 172.21.15.66:0/2397233992 conn(0x55cfdb539910 msgr2=0x55cfdb537b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f52aa640 1 -- 172.21.15.66:0/2397233992 reap_dead start 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 shutdown_connections 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/2397233992 wait complete. 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 msgr2=0x7f60d003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 0x7f60d003bf80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f61e800b710 tx=0x7f61e800bf70 comp rx=0 tx=0).stop 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 msgr2=0x55cfdb530f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x55cfdb50c890 tx=0x7f61f000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 shutdown_connections 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60d0039ac0 0x7f60d003bf80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/341904030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb530b60 0x55cfdb530f80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.929+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 >> 172.21.15.66:0/341904030 conn(0x55cfdb526510 msgr2=0x55cfdb5268f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 shutdown_connections 2024-09-12T00:20:07.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/341904030 wait complete. 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 msgr2=0x55cfdb51d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 0x55cfdb51d240 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 msgr2=0x55cfdb521d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 0x55cfdb521d60 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 msgr2=0x7f60dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 0x7f60dc03bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0ab000 tx=0x7f61ec0a5000 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 msgr2=0x55cfdb50ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55cfdb50d7c0 tx=0x7f61e8000bd0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 shutdown_connections 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55cfdb51f970 0x55cfdb521d60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55cfdb424540 0x55cfdb51d240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f60dc039a70 0x7f60dc03bf30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 --2- 172.21.15.66:0/4217745631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cfdb420350 0x55cfdb50ccc0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:07.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 >> 172.21.15.66:0/4217745631 conn(0x55cfdb41be70 msgr2=0x55cfdb505e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:07.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 shutdown_connections 2024-09-12T00:20:07.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:07.933+0000 7f61f7fa59c0 1 -- 172.21.15.66:0/4217745631 wait complete. 2024-09-12T00:20:07.947 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:07.948 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:07.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T00:20:07.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T00:20:07.949 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T00:20:08.026 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.026 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.021+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.021+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.021+0000 7feef79ef9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f1896e370 0x560f1896e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.021+0000 7feef79ef9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f188239c0 con 0x560f18971550 2024-09-12T00:20:08.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.021+0000 7feef79ef9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560f188736d0 con 0x560f1896e370 2024-09-12T00:20:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f1896e370 0x560f1896e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560f1896e370 0x560f1896e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41522/0 (socket says 172.21.15.66:41522) 2024-09-12T00:20:08.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef4cf4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560f18971550 0x560f18973940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37884/0 (socket says 172.21.15.66:37884) 2024-09-12T00:20:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 -- 172.21.15.66:0/3303018513 learned_addr learned my addr 172.21.15.66:0/3303018513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 -- 172.21.15.66:0/3303018513 >> v1:172.21.15.31:6789/0 conn(0x560f18971550 legacy=0x560f18973940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 -- 172.21.15.66:0/3303018513 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f18817ca0 con 0x560f1896e370 2024-09-12T00:20:08.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef54f5640 1 --2- 172.21.15.66:0/3303018513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f1896e750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feee800a5c0 tx=0x7feee801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236249dd86371f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feee7fff640 1 -- 172.21.15.66:0/3303018513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80a6070 con 0x560f1896e370 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feee7fff640 1 -- 172.21.15.66:0/3303018513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee80af070 con 0x560f1896e370 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feee7fff640 1 -- 172.21.15.66:0/3303018513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80aa5c0 con 0x560f1896e370 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef79ef9c0 1 -- 172.21.15.66:0/3303018513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 msgr2=0x560f1896e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.025+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/3303018513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f1896e750 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7feee800a5c0 tx=0x7feee801b340 comp rx=0 tx=0).stop 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.029+0000 7feef79ef9c0 1 -- 172.21.15.66:0/3303018513 shutdown_connections 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.029+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/3303018513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f1896e750 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.029+0000 7feef79ef9c0 1 -- 172.21.15.66:0/3303018513 >> 172.21.15.66:0/3303018513 conn(0x560f18969e90 msgr2=0x560f1896c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.029+0000 7feef79ef9c0 1 -- 172.21.15.66:0/3303018513 shutdown_connections 2024-09-12T00:20:08.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.029+0000 7feef79ef9c0 1 -- 172.21.15.66:0/3303018513 wait complete. 2024-09-12T00:20:08.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f18877680 con 0x560f1896e370 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef54f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef54f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41534/0 (socket says 172.21.15.66:41534) 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef54f5640 1 -- 172.21.15.66:0/2620604150 learned_addr learned my addr 172.21.15.66:0/2620604150 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef54f5640 1 -- 172.21.15.66:0/2620604150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f187f2da0 con 0x560f1896e370 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef54f5640 1 --2- 172.21.15.66:0/2620604150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feee8018f70 tx=0x7feee8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ab1dc03bb1e031 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7fede3606640 1 -- 172.21.15.66:0/2620604150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80aa9e0 con 0x560f1896e370 2024-09-12T00:20:08.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7fede3606640 1 -- 172.21.15.66:0/2620604150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee80aab80 con 0x560f1896e370 2024-09-12T00:20:08.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7fede3606640 1 -- 172.21.15.66:0/2620604150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80aae60 con 0x560f1896e370 2024-09-12T00:20:08.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2620604150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 msgr2=0x560f189777b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2620604150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7feee8018f70 tx=0x7feee8003030 comp rx=0 tx=0).stop 2024-09-12T00:20:08.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2620604150 shutdown_connections 2024-09-12T00:20:08.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2620604150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f189777b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2620604150 >> 172.21.15.66:0/2620604150 conn(0x560f18969e90 msgr2=0x560f18a56470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2620604150 shutdown_connections 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.045+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2620604150 wait complete. 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f18819a50 con 0x560f1896e370 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef54f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef54f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41542/0 (socket says 172.21.15.66:41542) 2024-09-12T00:20:08.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef54f5640 1 -- 172.21.15.66:0/2750564598 learned_addr learned my addr 172.21.15.66:0/2750564598 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef54f5640 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f18a64500 con 0x560f1896e370 2024-09-12T00:20:08.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef54f5640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7feee8000c10 tx=0x7feee80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 -- 172.21.15.66:0/2750564598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80c6750 con 0x560f1896e370 2024-09-12T00:20:08.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f18a64790 con 0x560f1896e370 2024-09-12T00:20:08.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f18a650f0 con 0x560f1896e370 2024-09-12T00:20:08.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 -- 172.21.15.66:0/2750564598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee80c68f0 con 0x560f1896e370 2024-09-12T00:20:08.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 -- 172.21.15.66:0/2750564598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feee80c6bd0 con 0x560f1896e370 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 -- 172.21.15.66:0/2750564598 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feee80ce030 con 0x560f1896e370 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 0x7feddc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7fede1e03640 1 -- 172.21.15.66:0/2750564598 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7feee80cc020 con 0x560f1896e370 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 0x7feddc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 0x560f18a6b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.049+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a6b600 con 0x560f18971550 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 0x560f18a6b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 0x7feddc03bf80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feeec001e40 tx=0x7feeec0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 0x560f18a6b0c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef5cf6640 1 -- 172.21.15.66:0/2750564598 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feef000a4d0 con 0x560f18971550 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a6bea0 con 0x560f18971550 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef5cf6640 1 -- 172.21.15.66:0/2750564598 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x560f18971550 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 0x560f18a6fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a70410 con 0x560f18a6d7f0 2024-09-12T00:20:08.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef54f5640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 0x560f18a6fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef54f5640 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 0x560f18a6fc80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef54f5640 1 -- 172.21.15.66:0/2750564598 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feee80b33f0 con 0x560f18a6d7f0 2024-09-12T00:20:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a6c6f0 con 0x560f18971550 2024-09-12T00:20:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef5cf6640 1 -- 172.21.15.66:0/2750564598 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feef000a4d0 con 0x560f18971550 2024-09-12T00:20:08.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a6cad0 con 0x560f18a6d7f0 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef54f5640 1 -- 172.21.15.66:0/2750564598 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feee80b33f0 con 0x560f18a6d7f0 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.053+0000 7feef79ef9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f18884450 con 0x560f18a7eb40 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41554/0 (socket says 172.21.15.66:41554) 2024-09-12T00:20:08.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef5cf6640 1 -- 172.21.15.66:0/4200396874 learned_addr learned my addr 172.21.15.66:0/4200396874 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef5cf6640 1 -- 172.21.15.66:0/4200396874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f18a7f5a0 con 0x560f18a7eb40 2024-09-12T00:20:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef5cf6640 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560f18a64d20 tx=0x7feef00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 -- 172.21.15.66:0/4200396874 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0013450 con 0x560f18a7eb40 2024-09-12T00:20:08.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 -- 172.21.15.66:0/4200396874 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef00135f0 con 0x560f18a7eb40 2024-09-12T00:20:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f18a7fe00 con 0x560f18a7eb40 2024-09-12T00:20:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 -- 172.21.15.66:0/4200396874 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef00138d0 con 0x560f18a7eb40 2024-09-12T00:20:08.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f18a80370 con 0x560f18a7eb40 2024-09-12T00:20:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 -- 172.21.15.66:0/4200396874 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feef0011040 con 0x560f18a7eb40 2024-09-12T00:20:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 0x7fedcc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feddaffd640 1 -- 172.21.15.66:0/4200396874 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7feef000e040 con 0x560f18a7eb40 2024-09-12T00:20:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef54f5640 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 0x7fedcc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef54f5640 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 0x7fedcc03bf30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x560f18a655e0 tx=0x7feee80d2f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.057+0000 7feef79ef9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f18977f40 con 0x560f18a8b480 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41566/0 (socket says 172.21.15.66:41566) 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 -- 172.21.15.66:0/78475777 learned_addr learned my addr 172.21.15.66:0/78475777 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 -- 172.21.15.66:0/78475777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f18a8be30 con 0x560f18a8b480 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- 172.21.15.66:0/78475777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feef0050850 tx=0x7feef00293a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b760993371844f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedd8ff9640 1 -- 172.21.15.66:0/78475777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef004d020 con 0x560f18a8b480 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedd8ff9640 1 -- 172.21.15.66:0/78475777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef002aa90 con 0x560f18a8b480 2024-09-12T00:20:08.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedd8ff9640 1 -- 172.21.15.66:0/78475777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef002a590 con 0x560f18a8b480 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/78475777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 msgr2=0x560f18a8b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/78475777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feef0050850 tx=0x7feef00293a0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/78475777 shutdown_connections 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/78475777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a8b860 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/78475777 >> 172.21.15.66:0/78475777 conn(0x560f18a878b0 msgr2=0x560f18a85af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/78475777 shutdown_connections 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/78475777 wait complete. 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 Processor -- start 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- start start 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a92960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f18a8c490 con 0x560f18a8b480 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a92960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a92960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41580/0 (socket says 172.21.15.66:41580) 2024-09-12T00:20:08.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 learned_addr learned my addr 172.21.15.66:0/2691612922 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f18a92ec0 con 0x560f18a8b480 2024-09-12T00:20:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a92960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feef0029b30 tx=0x7feef00507e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedcaffd640 1 -- 172.21.15.66:0/2691612922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef00124e0 con 0x560f18a8b480 2024-09-12T00:20:08.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f18a93150 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedcaffd640 1 -- 172.21.15.66:0/2691612922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef001fae0 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7fedcaffd640 1 -- 172.21.15.66:0/2691612922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef001fdc0 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.061+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f18a93b00 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7fedcaffd640 1 -- 172.21.15.66:0/2691612922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7feef0029ba0 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7fedcaffd640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedc0039a70 0x7fedc003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7fedcaffd640 1 -- 172.21.15.66:0/2691612922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7feef0034d30 con 0x560f18a8b480 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef54f5640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedc0039a70 0x7fedc003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18a9e0b0 0x560f18aa0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa0c90 con 0x560f18a9e0b0 2024-09-12T00:20:08.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18a9e0b0 0x560f18aa0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef54f5640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedc0039a70 0x7fedc003bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feee80ea1e0 tx=0x7feee80e6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18a9e0b0 0x560f18aa0540 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeec00f620 con 0x560f18a9e0b0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 realm 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18a9d460 con 0x560f18a9e0b0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeec00f620 con 0x560f18a9e0b0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa1790 con 0x560f18a9e0b0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeec00f620 con 0x560f18a9e0b0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa2060 con 0x560f18a9e0b0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feeec00f620 con 0x560f18a9e0b0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18aa2960 0x560f18aa4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa5490 con 0x560f18aa2960 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.065+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18aa2960 0x560f18aa4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18aa2960 0x560f18aa4d50 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef79ef9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef79ef9c0 20 searching for the correct realm 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef5cf6640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7feef0013070 0x7feef0011af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef54f5640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7feef0013070 0x7feef0011af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef54f5640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7feef0013070 0x7feef0011af0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef54f5640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7feee8009040 0x7feee80d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7feee8009040 0x7feee80d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7feee8009040 0x7feee80d0410 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec00f620 con 0x7feee8009040 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec00f620 con 0x560f18a9e0b0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.069+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.073+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.077+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18aa2960 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feee8009040 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeec02b040 con 0x7feee8009040 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x560f18a9e0b0 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6d60 con 0x7feef0013070 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:08.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa5e50 con 0x560f18a9e0b0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa66f0 con 0x560f18a9e0b0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.081+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa5a90 con 0x560f18aa2960 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 zone default found 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 4 Realm: () 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 zonegroup default 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa6320 con 0x7feee8009040 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa95e0 con 0x560f18aa2960 2024-09-12T00:20:08.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa99b0 con 0x560f18aa2960 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 started sync module instance, tier type = 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:08.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aa8a70 con 0x7feef0013070 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622838328928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aaa2a0 con 0x7feef0013070 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.085+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aaaaf0 con 0x560f18a9e0b0 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.089+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622838328928] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.089+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.089+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622838332912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aaab30 con 0x560f18a9e0b0 2024-09-12T00:20:08.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.089+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aab600 con 0x560f18aa2960 2024-09-12T00:20:08.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.089+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622838332912] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622838337776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aab5c0 con 0x560f18aa2960 2024-09-12T00:20:08.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aac040 con 0x7feef0013070 2024-09-12T00:20:08.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622838340496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aac890 con 0x7feef0013070 2024-09-12T00:20:08.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aad300 con 0x560f18a9e0b0 2024-09-12T00:20:08.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622838337776] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622838340496] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622838342624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aaa640 con 0x560f18a9e0b0 2024-09-12T00:20:08.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.093+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aadba0 con 0x7feee8009040 2024-09-12T00:20:08.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.097+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622838342624] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.097+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.097+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622838345168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aadb00 con 0x7feee8009040 2024-09-12T00:20:08.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.097+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aae4c0 con 0x7feee8009040 2024-09-12T00:20:08.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622838349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aae8e0 con 0x7feee8009040 2024-09-12T00:20:08.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aaf360 con 0x7feee8009040 2024-09-12T00:20:08.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622838345168] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622838349840] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622838353488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aae430 con 0x7feee8009040 2024-09-12T00:20:08.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=0 2024-09-12T00:20:08.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=1 2024-09-12T00:20:08.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=2 2024-09-12T00:20:08.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=3 2024-09-12T00:20:08.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=4 2024-09-12T00:20:08.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=5 2024-09-12T00:20:08.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.101+0000 7feef79ef9c0 20 add_watcher() i=6 2024-09-12T00:20:08.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622838353488] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 add_watcher() i=7 2024-09-12T00:20:08.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:08.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18aae8f0 con 0x560f18a9e0b0 2024-09-12T00:20:08.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622838347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18aae8f0 con 0x560f18a9e0b0 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622838347344] v33'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7fedab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 5 note: GC not initialized 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7fedaa7e4640 20 reqs_thread_entry: start 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 Filter name: none 2024-09-12T00:20:08.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7fed1bfff640 20 reqs_thread_entry: start 2024-09-12T00:20:08.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad5410 con 0x560f18a9e0b0 2024-09-12T00:20:08.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:08.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.105+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad6960 con 0x7feee8009040 2024-09-12T00:20:08.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.109+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.109+0000 7fedab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.109+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622838347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x560f18a9e0b0 2024-09-12T00:20:08.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.109+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94622838347344] v33'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.109+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622838328928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x7feef0013070 2024-09-12T00:20:08.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94622838328928] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef79ef9c0 20 remove_watcher() i=0 2024-09-12T00:20:08.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef79ef9c0 2 removed watcher, disabling cache 2024-09-12T00:20:08.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622838332912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x560f18a9e0b0 2024-09-12T00:20:08.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94622838332912] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef79ef9c0 20 remove_watcher() i=1 2024-09-12T00:20:08.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.113+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622838337776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x560f18aa2960 2024-09-12T00:20:08.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef5cf6640 1 -- 172.21.15.66:0/2691612922 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94622838337776] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef0039020 con 0x560f18aa2960 2024-09-12T00:20:08.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 20 remove_watcher() i=2 2024-09-12T00:20:08.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622838340496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x7feef0013070 2024-09-12T00:20:08.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef54f5640 1 -- 172.21.15.66:0/2691612922 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94622838340496] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee80e1050 con 0x7feef0013070 2024-09-12T00:20:08.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 20 remove_watcher() i=3 2024-09-12T00:20:08.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622838342624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x560f18a9e0b0 2024-09-12T00:20:08.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94622838342624] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x560f18a9e0b0 2024-09-12T00:20:08.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 20 remove_watcher() i=4 2024-09-12T00:20:08.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.117+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622838345168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x7feee8009040 2024-09-12T00:20:08.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.121+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94622838345168] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.121+0000 7feef79ef9c0 20 remove_watcher() i=5 2024-09-12T00:20:08.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.121+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622838349840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x7feee8009040 2024-09-12T00:20:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94622838349840] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 20 remove_watcher() i=6 2024-09-12T00:20:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622838353488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f18ad4d30 con 0x7feee8009040 2024-09-12T00:20:08.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94622838353488] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeec03b040 con 0x7feee8009040 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 20 remove_watcher() i=7 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7feee8009040 msgr2=0x7feee80d0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7feee8009040 0x7feee80d0410 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18a9e0b0 msgr2=0x560f18aa0540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18a9e0b0 0x560f18aa0540 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7feef0013070 msgr2=0x7feef0011af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7feef0013070 0x7feef0011af0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18aa2960 msgr2=0x560f18aa4d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18aa2960 0x560f18aa4d50 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedc0039a70 msgr2=0x7fedc003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedc0039a70 0x7fedc003bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feee80ea1e0 tx=0x7feee80e6000 comp rx=0 tx=0).stop 2024-09-12T00:20:08.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 msgr2=0x560f18a92960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2691612922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a8b480 0x560f18a92960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feef0029b30 tx=0x7feef00507e0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 reap_dead start 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef4cf4640 1 -- 172.21.15.66:0/2691612922 reap_dead start 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 shutdown_connections 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 >> 172.21.15.66:0/2691612922 conn(0x560f18a878b0 msgr2=0x560f18a85ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 shutdown_connections 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2691612922 wait complete. 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 msgr2=0x7fedcc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 0x7fedcc03bf30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x560f18a655e0 tx=0x7feee80d2f10 comp rx=0 tx=0).stop 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 msgr2=0x560f18a7ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x560f18a64d20 tx=0x7feef00163e0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 shutdown_connections 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fedcc039a70 0x7fedcc03bf30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/4200396874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f18a7eb40 0x560f18a7ef60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.125+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 >> 172.21.15.66:0/4200396874 conn(0x560f18a744f0 msgr2=0x560f18a748d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 shutdown_connections 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/4200396874 wait complete. 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 msgr2=0x560f18a6b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 0x560f18a6b0c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 msgr2=0x560f18a6fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 0x560f18a6fc80 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 msgr2=0x7feddc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 0x7feddc03bf80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7feeec001e40 tx=0x7feeec0013a0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 msgr2=0x560f18a63fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7feee8000c10 tx=0x7feee80180e0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 shutdown_connections 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560f18a6d7f0 0x560f18a6fc80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560f18971550 0x560f18a6b0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7feddc039ac0 0x7feddc03bf80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 --2- 172.21.15.66:0/2750564598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f1896e370 0x560f18a63fa0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 >> 172.21.15.66:0/2750564598 conn(0x560f18969e90 msgr2=0x560f18976470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 shutdown_connections 2024-09-12T00:20:08.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.129+0000 7feef79ef9c0 1 -- 172.21.15.66:0/2750564598 wait complete. 2024-09-12T00:20:08.143 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:08.144 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:08.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T00:20:08.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T00:20:08.144 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-12T00:20:08.225 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f5989d469c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e56dd4d8c0 0x55e56dd4fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f5989d469c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e56dbfb9c0 con 0x55e56dd49770 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f5989d469c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55e56dc4b6d0 con 0x55e56dd4d8c0 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f597ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e56dd4d8c0 0x55e56dd4fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f597ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55e56dd4d8c0 0x55e56dd4fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41588/0 (socket says 172.21.15.66:41588) 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f598784c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55e56dd49770 0x55e56dd49b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37890/0 (socket says 172.21.15.66:37890) 2024-09-12T00:20:08.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f597ffff640 1 -- 172.21.15.66:0/707723817 learned_addr learned my addr 172.21.15.66:0/707723817 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f597ffff640 1 -- 172.21.15.66:0/707723817 >> v1:172.21.15.31:6789/0 conn(0x55e56dd49770 legacy=0x55e56dd49b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.221+0000 7f597ffff640 1 -- 172.21.15.66:0/707723817 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56dbefca0 con 0x55e56dd4d8c0 2024-09-12T00:20:08.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f597ffff640 1 --2- 172.21.15.66:0/707723817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd4d8c0 0x55e56dd4fcb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f597000a5c0 tx=0x7f597001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f8fc6e5b535c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f598704b640 1 -- 172.21.15.66:0/707723817 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59700a9590 con 0x55e56dd4d8c0 2024-09-12T00:20:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f598704b640 1 -- 172.21.15.66:0/707723817 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59700ae070 con 0x55e56dd4d8c0 2024-09-12T00:20:08.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f598704b640 1 -- 172.21.15.66:0/707723817 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59700a9880 con 0x55e56dd4d8c0 2024-09-12T00:20:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 -- 172.21.15.66:0/707723817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd4d8c0 msgr2=0x55e56dd4fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 --2- 172.21.15.66:0/707723817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd4d8c0 0x55e56dd4fcb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f597000a5c0 tx=0x7f597001b3d0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 -- 172.21.15.66:0/707723817 shutdown_connections 2024-09-12T00:20:08.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 --2- 172.21.15.66:0/707723817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd4d8c0 0x55e56dd4fcb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 -- 172.21.15.66:0/707723817 >> 172.21.15.66:0/707723817 conn(0x55e56dcbd080 msgr2=0x55e56dcbd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 -- 172.21.15.66:0/707723817 shutdown_connections 2024-09-12T00:20:08.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.225+0000 7f5989d469c0 1 -- 172.21.15.66:0/707723817 wait complete. 2024-09-12T00:20:08.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e56dc4f680 con 0x55e56dd49770 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f598784c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f598784c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41604/0 (socket says 172.21.15.66:41604) 2024-09-12T00:20:08.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f598784c640 1 -- 172.21.15.66:0/2032624510 learned_addr learned my addr 172.21.15.66:0/2032624510 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f598784c640 1 -- 172.21.15.66:0/2032624510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56dbcada0 con 0x55e56dd49770 2024-09-12T00:20:08.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f598784c640 1 --2- 172.21.15.66:0/2032624510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5978001ec0 tx=0x7f597800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a1a47ed9e740f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5875e0b640 1 -- 172.21.15.66:0/2032624510 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597800e5d0 con 0x55e56dd49770 2024-09-12T00:20:08.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5875e0b640 1 -- 172.21.15.66:0/2032624510 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597800e770 con 0x55e56dd49770 2024-09-12T00:20:08.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5875e0b640 1 -- 172.21.15.66:0/2032624510 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597800ea70 con 0x55e56dd49770 2024-09-12T00:20:08.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- 172.21.15.66:0/2032624510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 msgr2=0x55e56de34a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 --2- 172.21.15.66:0/2032624510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5978001ec0 tx=0x7f597800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- 172.21.15.66:0/2032624510 shutdown_connections 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 --2- 172.21.15.66:0/2032624510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de34a00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- 172.21.15.66:0/2032624510 >> 172.21.15.66:0/2032624510 conn(0x55e56dcbd080 msgr2=0x55e56de306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- 172.21.15.66:0/2032624510 shutdown_connections 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- 172.21.15.66:0/2032624510 wait complete. 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.241+0000 7f5989d469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e56dbf1a50 con 0x55e56dd49770 2024-09-12T00:20:08.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598784c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598784c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41618/0 (socket says 172.21.15.66:41618) 2024-09-12T00:20:08.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598784c640 1 -- 172.21.15.66:0/577374378 learned_addr learned my addr 172.21.15.66:0/577374378 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598784c640 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56de3c600 con 0x55e56dd49770 2024-09-12T00:20:08.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598784c640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55e56de359f0 tx=0x7f5978000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 -- 172.21.15.66:0/577374378 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597800f8e0 con 0x55e56dd49770 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56de3c890 con 0x55e56dd49770 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 -- 172.21.15.66:0/577374378 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597800fa80 con 0x55e56dd49770 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56de3d240 con 0x55e56dd49770 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 -- 172.21.15.66:0/577374378 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597802c060 con 0x55e56dd49770 2024-09-12T00:20:08.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 -- 172.21.15.66:0/577374378 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5978017070 con 0x55e56dd49770 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 0x7f587003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f586ffff640 1 -- 172.21.15.66:0/577374378 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5978015020 con 0x55e56dd49770 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f597ffff640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 0x7f587003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 0x55e56de43210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de43750 con 0x55e56dd4d8c0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598804d640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 0x55e56de43210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f597ffff640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 0x7f587003bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f59700ad000 tx=0x7f59700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.245+0000 7f598804d640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 0x55e56de43210 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 -- 172.21.15.66:0/577374378 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56dd4d8c0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de43b50 con 0x55e56dd4d8c0 2024-09-12T00:20:08.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 -- 172.21.15.66:0/577374378 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56dd4d8c0 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 0x55e56de47d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de48420 con 0x55e56de45960 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598784c640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 0x55e56de47d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598784c640 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 0x55e56de47d50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598784c640 1 -- 172.21.15.66:0/577374378 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f597802e070 con 0x55e56de45960 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de44800 con 0x55e56dd4d8c0 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 -- 172.21.15.66:0/577374378 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56dd4d8c0 2024-09-12T00:20:08.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de44ce0 con 0x55e56de45960 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598784c640 1 -- 172.21.15.66:0/577374378 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f597802e070 con 0x55e56de45960 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f5989d469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e56dc5c450 con 0x55e56de56b70 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41622/0 (socket says 172.21.15.66:41622) 2024-09-12T00:20:08.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 -- 172.21.15.66:0/820800406 learned_addr learned my addr 172.21.15.66:0/820800406 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 -- 172.21.15.66:0/820800406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56de575d0 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.249+0000 7f598804d640 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55e56de3e200 tx=0x7f59800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 -- 172.21.15.66:0/820800406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5980013640 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 -- 172.21.15.66:0/820800406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59800137e0 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56de57e30 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 -- 172.21.15.66:0/820800406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5980013ac0 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56de583a0 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 -- 172.21.15.66:0/820800406 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5980011040 con 0x55e56de56b70 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 0x7f586003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f586d7fa640 1 -- 172.21.15.66:0/820800406 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f598000e040 con 0x55e56de56b70 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598784c640 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 0x7f586003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598784c640 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 0x7f586003bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f597804e190 tx=0x7f597804f340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5989d469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e56de35250 con 0x55e56de644c0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41628/0 (socket says 172.21.15.66:41628) 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598804d640 1 -- 172.21.15.66:0/3650318800 learned_addr learned my addr 172.21.15.66:0/3650318800 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598804d640 1 -- 172.21.15.66:0/3650318800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56de64e90 con 0x55e56de644c0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f598804d640 1 --2- 172.21.15.66:0/3650318800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f598001fc20 tx=0x7f598001fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1421f0fb3022bec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5866ffd640 1 -- 172.21.15.66:0/3650318800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f598002a910 con 0x55e56de644c0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5866ffd640 1 -- 172.21.15.66:0/3650318800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598002a3f0 con 0x55e56de644c0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.253+0000 7f5866ffd640 1 -- 172.21.15.66:0/3650318800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f598002aab0 con 0x55e56de644c0 2024-09-12T00:20:08.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/3650318800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 msgr2=0x55e56de648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 --2- 172.21.15.66:0/3650318800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f598001fc20 tx=0x7f598001fc50 comp rx=0 tx=0).stop 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/3650318800 shutdown_connections 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 --2- 172.21.15.66:0/3650318800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de648a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/3650318800 >> 172.21.15.66:0/3650318800 conn(0x55e56de5f880 msgr2=0x55e56de5dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/3650318800 shutdown_connections 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/3650318800 wait complete. 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 Processor -- start 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- start start 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e56de633b0 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598804d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41630/0 (socket says 172.21.15.66:41630) 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 learned_addr learned my addr 172.21.15.66:0/1549991617 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56de6aeb0 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598804d640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f598004b010 tx=0x7f598004b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 -- 172.21.15.66:0/1549991617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5980045070 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 -- 172.21.15.66:0/1549991617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59800293a0 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e56de6b140 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 -- 172.21.15.66:0/1549991617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f598002e070 con 0x55e56de644c0 2024-09-12T00:20:08.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56de6b140 con 0x55e56de644c0 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 -- 172.21.15.66:0/1549991617 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f59800520d0 con 0x55e56de644c0 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5850039a70 0x7f585003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f58657fa640 1 -- 172.21.15.66:0/1549991617 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5980034020 con 0x55e56de644c0 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.257+0000 7f598784c640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5850039a70 0x7f585003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56de75d10 0x55e56de781a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de788f0 con 0x55e56de75d10 2024-09-12T00:20:08.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56de75d10 0x55e56de781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5850039a70 0x7f585003bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f597801baf0 tx=0x7f5978046000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56de75d10 0x55e56de781a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 realm 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de78d20 con 0x55e56de75d10 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de795f0 con 0x55e56de75d10 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de79990 con 0x55e56de75d10 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de7a6f0 0x55e56de7cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7d020 con 0x55e56de7a6f0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de7a6f0 0x55e56de7cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de7a6f0 0x55e56de7cae0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 20 searching for the correct realm 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5980033460 0x7f59800338e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5980033460 0x7f59800338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5980033460 0x7f59800338e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5978019740 0x7f5978042550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.261+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5978019740 0x7f5978042550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5978019740 0x7f5978042550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.265+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.269+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de7a6f0 2024-09-12T00:20:08.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5978019740 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x55e56de75d10 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e880 con 0x7f5980033460 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:08.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.273+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7d970 con 0x55e56de75d10 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7e210 con 0x55e56de75d10 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7d5b0 con 0x55e56de7a6f0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:08.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 zone default found 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 4 Realm: () 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 zonegroup default 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de7de40 con 0x7f5978019740 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de80c50 con 0x55e56de7a6f0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de81110 con 0x55e56de7a6f0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 started sync module instance, tier type = 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de800f0 con 0x7f5980033460 2024-09-12T00:20:08.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443879791680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de81570 con 0x7f5980033460 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.277+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de81dc0 con 0x55e56de75d10 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443879791680] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443879793936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de81e60 con 0x55e56de75d10 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de82960 con 0x55e56de7a6f0 2024-09-12T00:20:08.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443879793936] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443879801936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de82920 con 0x55e56de7a6f0 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.281+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de833a0 con 0x7f5980033460 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443879804656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de83bf0 con 0x7f5980033460 2024-09-12T00:20:08.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de845f0 con 0x55e56de75d10 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443879801936] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443879804656] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443879799056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de83740 con 0x55e56de75d10 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.285+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de84ec0 con 0x7f5978019740 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.289+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443879799056] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.289+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.289+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443879809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de83740 con 0x7f5978019740 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.289+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85360 con 0x7f5978019740 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.289+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443879809280] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443879812688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85320 con 0x7f5978019740 2024-09-12T00:20:08.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d60 con 0x7f5978019740 2024-09-12T00:20:08.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443879815216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de861d0 con 0x7f5978019740 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=0 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=1 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=2 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=3 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=4 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=5 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443879812688] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.293+0000 7f5989d469c0 20 add_watcher() i=6 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443879815216] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x7f5978019740 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 add_watcher() i=7 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56de848e0 con 0x55e56de75d10 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443879816480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de848e0 con 0x55e56de75d10 2024-09-12T00:20:08.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443879816480] v33'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59700a99f0 con 0x55e56de75d10 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f583dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 5 note: GC not initialized 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f583cfe1640 20 reqs_thread_entry: start 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 Filter name: none 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f57b67fc640 20 reqs_thread_entry: start 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56deac300 con 0x55e56de75d10 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f59700d5040 con 0x55e56de75d10 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.297+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e56dead850 con 0x7f5978019740 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f59700d5040 con 0x7f5978019740 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f583dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443879816480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56deabc20 con 0x55e56de75d10 2024-09-12T00:20:08.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94443879816480] v33'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x55e56de75d10 2024-09-12T00:20:08.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443879791680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x7f5980033460 2024-09-12T00:20:08.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.301+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94443879791680] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f5989d469c0 20 remove_watcher() i=0 2024-09-12T00:20:08.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f5989d469c0 2 removed watcher, disabling cache 2024-09-12T00:20:08.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443879793936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x55e56de75d10 2024-09-12T00:20:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94443879793936] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x55e56de75d10 2024-09-12T00:20:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f5989d469c0 20 remove_watcher() i=1 2024-09-12T00:20:08.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.305+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443879801936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x55e56de7a6f0 2024-09-12T00:20:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f598804d640 1 -- 172.21.15.66:0/1549991617 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94443879801936] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x55e56de7a6f0 2024-09-12T00:20:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 20 remove_watcher() i=2 2024-09-12T00:20:08.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443879804656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x7f5980033460 2024-09-12T00:20:08.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f598784c640 1 -- 172.21.15.66:0/1549991617 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94443879804656] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597802e070 con 0x7f5980033460 2024-09-12T00:20:08.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 20 remove_watcher() i=3 2024-09-12T00:20:08.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443879799056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de82ef0 con 0x55e56de75d10 2024-09-12T00:20:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94443879799056] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x55e56de75d10 2024-09-12T00:20:08.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 20 remove_watcher() i=4 2024-09-12T00:20:08.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.309+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443879809280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x7f5978019740 2024-09-12T00:20:08.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94443879809280] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x7f5978019740 2024-09-12T00:20:08.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f5989d469c0 20 remove_watcher() i=5 2024-09-12T00:20:08.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443879812688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de82ef0 con 0x7f5978019740 2024-09-12T00:20:08.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94443879812688] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x7f5978019740 2024-09-12T00:20:08.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f5989d469c0 20 remove_watcher() i=6 2024-09-12T00:20:08.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.313+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443879815216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e56de85d20 con 0x7f5978019740 2024-09-12T00:20:08.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94443879815216] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59700d5040 con 0x7f5978019740 2024-09-12T00:20:08.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 20 remove_watcher() i=7 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5978019740 msgr2=0x7f5978042550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5978019740 0x7f5978042550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56de75d10 msgr2=0x55e56de781a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56de75d10 0x55e56de781a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5980033460 msgr2=0x7f59800338e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5980033460 0x7f59800338e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de7a6f0 msgr2=0x55e56de7cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de7a6f0 0x55e56de7cae0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5850039a70 msgr2=0x7f585003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5850039a70 0x7f585003bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f597801baf0 tx=0x7f5978046000 comp rx=0 tx=0).stop 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 msgr2=0x55e56de6a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f597ffff640 1 -- 172.21.15.66:0/1549991617 reap_dead start 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f598004b010 tx=0x7f598004b040 comp rx=0 tx=0).stop 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 shutdown_connections 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/1549991617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de644c0 0x55e56de6a950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 >> 172.21.15.66:0/1549991617 conn(0x55e56de5f880 msgr2=0x55e56de5da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 shutdown_connections 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/1549991617 wait complete. 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 msgr2=0x7f586003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 0x7f586003bf30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f597804e190 tx=0x7f597804f340 comp rx=0 tx=0).stop 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 msgr2=0x55e56de56f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55e56de3e200 tx=0x7f59800167b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 shutdown_connections 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5860039a70 0x7f586003bf30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/820800406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56de56b70 0x55e56de56f90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 >> 172.21.15.66:0/820800406 conn(0x55e56de4c520 msgr2=0x55e56de4c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 shutdown_connections 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/820800406 wait complete. 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 msgr2=0x55e56de43210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 0x55e56de43210 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 msgr2=0x55e56de47d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 0x55e56de47d50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 msgr2=0x7f587003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 0x7f587003bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f59700ad000 tx=0x7f59700a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 msgr2=0x55e56de3c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55e56de359f0 tx=0x7f5978000bd0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 shutdown_connections 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55e56de45960 0x55e56de47d50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55e56dd4d8c0 0x55e56de43210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5870039ac0 0x7f587003bf80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 --2- 172.21.15.66:0/577374378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e56dd49770 0x55e56de3c0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 >> 172.21.15.66:0/577374378 conn(0x55e56dcbd080 msgr2=0x55e56de2f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 shutdown_connections 2024-09-12T00:20:08.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.317+0000 7f5989d469c0 1 -- 172.21.15.66:0/577374378 wait complete. 2024-09-12T00:20:08.332 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:08.333 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:08.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T00:20:08.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T00:20:08.333 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-12T00:20:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.407 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.401+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd6ad69c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f52087ec80 0x55f520881070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd6ad69c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5207309c0 con 0x55f5208815b0 2024-09-12T00:20:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd6ad69c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f5207806d0 con 0x55f52087ec80 2024-09-12T00:20:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f52087ec80 0x55f520881070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f52087ec80 0x55f520881070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41642/0 (socket says 172.21.15.66:41642) 2024-09-12T00:20:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 -- 172.21.15.66:0/579648478 learned_addr learned my addr 172.21.15.66:0/579648478 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 -- 172.21.15.66:0/579648478 >> v1:172.21.15.31:6789/0 conn(0x55f5208815b0 legacy=0x55f5208839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 -- 172.21.15.66:0/579648478 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f520724ca0 con 0x55f52087ec80 2024-09-12T00:20:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.405+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/579648478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520881070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00a4e0 tx=0x7f7dcc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadba798ca453e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd35da640 1 -- 172.21.15.66:0/579648478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0aa540 con 0x55f52087ec80 2024-09-12T00:20:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd35da640 1 -- 172.21.15.66:0/579648478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0aa6e0 con 0x55f52087ec80 2024-09-12T00:20:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd35da640 1 -- 172.21.15.66:0/579648478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0aaa40 con 0x55f52087ec80 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/579648478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 msgr2=0x55f520881070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/579648478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520881070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00a4e0 tx=0x7f7dcc01b090 comp rx=0 tx=0).stop 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/579648478 shutdown_connections 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/579648478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520881070 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/579648478 >> 172.21.15.66:0/579648478 conn(0x55f5207f2010 msgr2=0x55f5207f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/579648478 shutdown_connections 2024-09-12T00:20:08.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.409+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/579648478 wait complete. 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd6ad69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd6ad69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f520784680 con 0x55f52087ec80 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd45dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd45dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41656/0 (socket says 172.21.15.66:41656) 2024-09-12T00:20:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd45dc640 1 -- 172.21.15.66:0/3104013015 learned_addr learned my addr 172.21.15.66:0/3104013015 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.421+0000 7f7dd45dc640 1 -- 172.21.15.66:0/3104013015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5206ffda0 con 0x55f52087ec80 2024-09-12T00:20:08.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/3104013015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018cc0 tx=0x7f7dcc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229ab0b1a9228e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc260c640 1 -- 172.21.15.66:0/3104013015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0b9070 con 0x55f52087ec80 2024-09-12T00:20:08.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc260c640 1 -- 172.21.15.66:0/3104013015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0aaa80 con 0x55f52087ec80 2024-09-12T00:20:08.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc260c640 1 -- 172.21.15.66:0/3104013015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0aad60 con 0x55f52087ec80 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/3104013015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 msgr2=0x55f520969a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/3104013015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018cc0 tx=0x7f7dcc0033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/3104013015 shutdown_connections 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/3104013015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520969a30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/3104013015 >> 172.21.15.66:0/3104013015 conn(0x55f5207f2010 msgr2=0x55f5209656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/3104013015 shutdown_connections 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/3104013015 wait complete. 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f520726a50 con 0x55f52087ec80 2024-09-12T00:20:08.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41668/0 (socket says 172.21.15.66:41668) 2024-09-12T00:20:08.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 -- 172.21.15.66:0/1686721415 learned_addr learned my addr 172.21.15.66:0/1686721415 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f520971480 con 0x55f52087ec80 2024-09-12T00:20:08.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018cc0 tx=0x7f7dcc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc0e09640 1 -- 172.21.15.66:0/1686721415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0b9070 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f520971710 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc0e09640 1 -- 172.21.15.66:0/1686721415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0b5a50 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7cc0e09640 1 -- 172.21.15.66:0/1686721415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dcc0b5d30 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.425+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f520972070 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7cc0e09640 1 -- 172.21.15.66:0/1686721415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7dcc0b3040 con 0x55f52087ec80 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7cc0e09640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 0x7f7cbc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7cc0e09640 1 -- 172.21.15.66:0/1686721415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f7dcc0c4070 con 0x55f52087ec80 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 0x7f7cbc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 0x55f520978040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f520978580 con 0x55f5208815b0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 0x55f520978040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 0x7f7cbc03bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001ec0 tx=0x7f7dc8001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 0x55f520978040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/1686721415 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dc40083f0 con 0x55f5208815b0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f520972460 con 0x55f5208815b0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/1686721415 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7dc40083f0 con 0x55f5208815b0 2024-09-12T00:20:08.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 0x55f52097cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f52097d350 con 0x55f52097a890 2024-09-12T00:20:08.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 0x55f52097cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 0x55f52097cc80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd45dc640 1 -- 172.21.15.66:0/1686721415 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7dcc0cd060 con 0x55f52097a890 2024-09-12T00:20:08.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f520979730 con 0x55f5208815b0 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/1686721415 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7dc40083f0 con 0x55f5208815b0 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.429+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f520979c10 con 0x55f52097a890 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd45dc640 1 -- 172.21.15.66:0/1686721415 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7dcc0cd060 con 0x55f52097a890 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f520791450 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41678/0 (socket says 172.21.15.66:41678) 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/1456604081 learned_addr learned my addr 172.21.15.66:0/1456604081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/1456604081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f52098c500 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55f520971ca0 tx=0x7f7dc400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7cb9ffb640 1 -- 172.21.15.66:0/1456604081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc401c020 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7cb9ffb640 1 -- 172.21.15.66:0/1456604081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4007d00 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f52098cd60 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7cb9ffb640 1 -- 172.21.15.66:0/1456604081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc4018440 con 0x55f52098baa0 2024-09-12T00:20:08.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f52098d2d0 con 0x55f52098baa0 2024-09-12T00:20:08.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.433+0000 7f7cb9ffb640 1 -- 172.21.15.66:0/1456604081 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7dc401f020 con 0x55f52098baa0 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7cb9ffb640 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 0x7f7cac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7cb9ffb640 1 -- 172.21.15.66:0/1456604081 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f7dc4051e10 con 0x55f52098baa0 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 0x7f7cac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 0x7f7cac03bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0d53f0 tx=0x7f7dcc006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f52096a1a0 con 0x55f520998420 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41688/0 (socket says 172.21.15.66:41688) 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/861083712 learned_addr learned my addr 172.21.15.66:0/861083712 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/861083712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f520998dd0 con 0x55f520998420 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/861083712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4021fd0 tx=0x7f7dc40168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911ee214c0a07979 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7cb37fe640 1 -- 172.21.15.66:0/861083712 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc4021400 con 0x55f520998420 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7cb37fe640 1 -- 172.21.15.66:0/861083712 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4029350 con 0x55f520998420 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7cb37fe640 1 -- 172.21.15.66:0/861083712 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc40215a0 con 0x55f520998420 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/861083712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 msgr2=0x55f520998800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/861083712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4021fd0 tx=0x7f7dc40168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/861083712 shutdown_connections 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/861083712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f520998800 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/861083712 >> 172.21.15.66:0/861083712 conn(0x55f520994850 msgr2=0x55f520992a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/861083712 shutdown_connections 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/861083712 wait complete. 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 Processor -- start 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- start start 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd6ad69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f520999430 con 0x55f520998420 2024-09-12T00:20:08.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41698/0 (socket says 172.21.15.66:41698) 2024-09-12T00:20:08.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 learned_addr learned my addr 172.21.15.66:0/137826980 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.437+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f52099fe00 con 0x55f520998420 2024-09-12T00:20:08.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4021fd0 tx=0x7f7dc4050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 -- 172.21.15.66:0/137826980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc4028bd0 con 0x55f520998420 2024-09-12T00:20:08.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 -- 172.21.15.66:0/137826980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4028d70 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5209a0090 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 -- 172.21.15.66:0/137826980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dc40203b0 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5209a0a40 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 -- 172.21.15.66:0/137826980 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7dc4016040 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ca4039a70 0x7f7ca403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7cb1ffb640 1 -- 172.21.15.66:0/137826980 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f7dc4032070 con 0x55f520998420 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ca4039a70 0x7f7ca403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5209aae60 0x55f5209ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209ada40 con 0x55f5209aae60 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5209aae60 0x55f5209ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ca4039a70 0x7f7ca403bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006110 tx=0x7f7dcc0d9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5209aae60 0x55f5209ad2f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dc800d040 con 0x55f5209aae60 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 realm 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209aa210 con 0x55f5209aae60 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dc800d040 con 0x55f5209aae60 2024-09-12T00:20:08.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209ae540 con 0x55f5209aae60 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dc800d040 con 0x55f5209aae60 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.441+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209aee10 con 0x55f5209aae60 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7dc800d040 con 0x55f5209aae60 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f5209af710 0x55f5209b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b2260 con 0x55f5209af710 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f5209af710 0x55f5209b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f5209af710 0x55f5209b1b00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 20 searching for the correct realm 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209af710 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7dc4021020 0x7f7dc402a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dc4021020 2024-09-12T00:20:08.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7dc4021020 0x7f7dc402a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7dc4021020 0x7f7dc402a3e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd45dc640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7dcc0f5070 0x7f7dcc0bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dcc0f5070 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7dcc0f5070 0x7f7dcc0bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7dcc0f5070 0x7f7dcc0bd910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc800d040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209aae60 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc800d040 con 0x55f5209aae60 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209aae60 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.445+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209aae60 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dcc0f5070 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dc4021020 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209af710 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209aae60 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dc4021020 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209aae60 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x7f7dc4021020 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209af710 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3b30 con 0x55f5209af710 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209af710 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.449+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209af710 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209aae60 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209aae60 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209af710 2024-09-12T00:20:08.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dc4021020 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209aae60 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209af710 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.453+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dc4021020 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209af710 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x55f5209aae60 2024-09-12T00:20:08.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f7dc4065040 con 0x7f7dc4021020 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b2c20 con 0x55f5209aae60 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b2860 con 0x55f5209aae60 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b3540 con 0x55f5209af710 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 zone default found 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 4 Realm: () 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:08.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 zonegroup default 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b30a0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.457+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b5eb0 con 0x55f5209af710 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b6310 con 0x55f5209af710 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 20 started sync module instance, tier type = 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b52c0 con 0x7f7dc4021020 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94511302397456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b6310 con 0x7f7dc4021020 2024-09-12T00:20:08.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b6b60 con 0x55f5209aae60 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94511302397456] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94511302403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b6ad0 con 0x55f5209aae60 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.461+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b7930 con 0x55f5209af710 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94511302403760] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94511302405968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b78f0 con 0x55f5209af710 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b8340 con 0x7f7dc4021020 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94511302409872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b8760 con 0x7f7dc4021020 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b9230 con 0x55f5209aae60 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.465+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94511302405968] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94511302409872] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94511302410928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b7370 con 0x55f5209aae60 2024-09-12T00:20:08.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b96e0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94511302410928] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94511302413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b96a0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.469+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209ba0f0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.473+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.473+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94511302417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209ba510 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.473+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209baf10 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.473+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94511302413600] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.473+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94511302417472] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94511302418528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209baa20 con 0x7f7dcc0f5070 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=0 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=1 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=2 2024-09-12T00:20:08.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=3 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=4 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=5 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=6 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94511302418528] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 add_watcher() i=7 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209bdf00 con 0x55f5209aae60 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94511302421024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209bb330 con 0x55f5209aae60 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94511302421024] v33'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7c8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.477+0000 7f7dd6ad69c0 5 note: GC not initialized 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7c897e2640 20 reqs_thread_entry: start 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:08.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 20 Filter name: none 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7bfaffd640 20 reqs_thread_entry: start 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209e0f70 con 0x55f5209aae60 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f5209e24c0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7c8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.481+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94511302421024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209e0890 con 0x55f5209aae60 2024-09-12T00:20:08.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94511302421024] v33'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94511302397456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209baa20 con 0x7f7dc4021020 2024-09-12T00:20:08.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94511302397456] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 20 remove_watcher() i=0 2024-09-12T00:20:08.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 2 removed watcher, disabling cache 2024-09-12T00:20:08.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94511302403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209baa20 con 0x55f5209aae60 2024-09-12T00:20:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94511302403760] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 20 remove_watcher() i=1 2024-09-12T00:20:08.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.485+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94511302405968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b66b0 con 0x55f5209af710 2024-09-12T00:20:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd4ddd640 1 -- 172.21.15.66:0/137826980 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94511302405968] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc4055020 con 0x55f5209af710 2024-09-12T00:20:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd6ad69c0 20 remove_watcher() i=2 2024-09-12T00:20:08.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94511302409872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209baa20 con 0x7f7dc4021020 2024-09-12T00:20:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd45dc640 1 -- 172.21.15.66:0/137826980 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94511302409872] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc0df030 con 0x7f7dc4021020 2024-09-12T00:20:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd6ad69c0 20 remove_watcher() i=3 2024-09-12T00:20:08.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.489+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94511302410928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b6f50 con 0x55f5209aae60 2024-09-12T00:20:08.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94511302410928] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x55f5209aae60 2024-09-12T00:20:08.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd6ad69c0 20 remove_watcher() i=4 2024-09-12T00:20:08.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94511302413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b66b0 con 0x7f7dcc0f5070 2024-09-12T00:20:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94511302413600] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd6ad69c0 20 remove_watcher() i=5 2024-09-12T00:20:08.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.493+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94511302417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b8340 con 0x7f7dcc0f5070 2024-09-12T00:20:08.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94511302417472] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 20 remove_watcher() i=6 2024-09-12T00:20:08.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94511302418528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f5209b8340 con 0x7f7dcc0f5070 2024-09-12T00:20:08.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94511302418528] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dc802a040 con 0x7f7dcc0f5070 2024-09-12T00:20:08.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 20 remove_watcher() i=7 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7dcc0f5070 msgr2=0x7f7dcc0bd910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f7dcc0f5070 0x7f7dcc0bd910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5209aae60 msgr2=0x55f5209ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5209aae60 0x55f5209ad2f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7dc4021020 msgr2=0x7f7dc402a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f7dc4021020 0x7f7dc402a3e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f5209af710 msgr2=0x55f5209b1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f5209af710 0x55f5209b1b00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ca4039a70 msgr2=0x7f7ca403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7ca4039a70 0x7f7ca403bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc006110 tx=0x7f7dcc0d9000 comp rx=0 tx=0).stop 2024-09-12T00:20:08.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 msgr2=0x55f52099f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd3ddb640 1 -- 172.21.15.66:0/137826980 reap_dead start 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4021fd0 tx=0x7f7dc4050040 comp rx=0 tx=0).stop 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 shutdown_connections 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/137826980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f520998420 0x55f52099f8a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 >> 172.21.15.66:0/137826980 conn(0x55f520994850 msgr2=0x55f520992a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 shutdown_connections 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/137826980 wait complete. 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 msgr2=0x7f7cac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 0x7f7cac03bf30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0d53f0 tx=0x7f7dcc006040 comp rx=0 tx=0).stop 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 msgr2=0x55f52098bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55f520971ca0 tx=0x7f7dc400bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 shutdown_connections 2024-09-12T00:20:08.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cac039a70 0x7f7cac03bf30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1456604081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52098baa0 0x55f52098bec0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 >> 172.21.15.66:0/1456604081 conn(0x55f520981450 msgr2=0x55f520981830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 shutdown_connections 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1456604081 wait complete. 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.497+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 msgr2=0x55f520978040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 0x55f520978040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 msgr2=0x55f52097cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 0x55f52097cc80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 msgr2=0x7f7cbc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 0x7f7cbc03bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8001ec0 tx=0x7f7dc8001440 comp rx=0 tx=0).stop 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 msgr2=0x55f520970f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018cc0 tx=0x7f7dcc017e30 comp rx=0 tx=0).stop 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 shutdown_connections 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f52097a890 0x55f52097cc80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f5208815b0 0x55f520978040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f7cbc039a70 0x7f7cbc03bf30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 --2- 172.21.15.66:0/1686721415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f52087ec80 0x55f520970f20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 >> 172.21.15.66:0/1686721415 conn(0x55f5207f2010 msgr2=0x55f520964160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 shutdown_connections 2024-09-12T00:20:08.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.501+0000 7f7dd6ad69c0 1 -- 172.21.15.66:0/1686721415 wait complete. 2024-09-12T00:20:08.513 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:08.513 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:08.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T00:20:08.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T00:20:08.514 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-12T00:20:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.586 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.581+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.581+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.581+0000 7f3b1270c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55692e3a57b0 0x55692e434160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.581+0000 7f3b1270c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55692e2e59c0 con 0x55692e4346a0 2024-09-12T00:20:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.581+0000 7f3b1270c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55692e3356d0 con 0x55692e3a57b0 2024-09-12T00:20:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b10212640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55692e3a57b0 0x55692e434160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b0fa11640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55692e4346a0 0x55692e436a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37904/0 (socket says 172.21.15.66:37904) 2024-09-12T00:20:08.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b0fa11640 1 -- 172.21.15.66:0/691077457 learned_addr learned my addr 172.21.15.66:0/691077457 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b10212640 1 -- 172.21.15.66:0/691077457 >> v1:172.21.15.31:6789/0 conn(0x55692e4346a0 legacy=0x55692e436a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b10212640 1 -- 172.21.15.66:0/691077457 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e2d9ca0 con 0x55692e3a57b0 2024-09-12T00:20:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b10212640 1 --2- 172.21.15.66:0/691077457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e434160 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a480 tx=0x7f3b0001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114d055769ffa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b0f210640 1 -- 172.21.15.66:0/691077457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000af070 con 0x55692e3a57b0 2024-09-12T00:20:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b0f210640 1 -- 172.21.15.66:0/691077457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000aa530 con 0x55692e3a57b0 2024-09-12T00:20:08.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b0f210640 1 -- 172.21.15.66:0/691077457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000aa830 con 0x55692e3a57b0 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/691077457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 msgr2=0x55692e434160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/691077457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e434160 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000a480 tx=0x7f3b0001b280 comp rx=0 tx=0).stop 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/691077457 shutdown_connections 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/691077457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e434160 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.585+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/691077457 >> 172.21.15.66:0/691077457 conn(0x55692e42be90 msgr2=0x55692e42e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.589+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/691077457 shutdown_connections 2024-09-12T00:20:08.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.589+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/691077457 wait complete. 2024-09-12T00:20:08.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692e339680 con 0x55692e3a57b0 2024-09-12T00:20:08.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b10212640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b10212640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41720/0 (socket says 172.21.15.66:41720) 2024-09-12T00:20:08.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b10212640 1 -- 172.21.15.66:0/577612911 learned_addr learned my addr 172.21.15.66:0/577612911 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b10212640 1 -- 172.21.15.66:0/577612911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e2b4da0 con 0x55692e3a57b0 2024-09-12T00:20:08.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b10212640 1 --2- 172.21.15.66:0/577612911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b000ad040 tx=0x7f3b00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2431219f9a68ff07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f39fe60c640 1 -- 172.21.15.66:0/577612911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000af070 con 0x55692e3a57b0 2024-09-12T00:20:08.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f39fe60c640 1 -- 172.21.15.66:0/577612911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000b0040 con 0x55692e3a57b0 2024-09-12T00:20:08.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f39fe60c640 1 -- 172.21.15.66:0/577612911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000aa830 con 0x55692e3a57b0 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/577612911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 msgr2=0x55692e431640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/577612911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b000ad040 tx=0x7f3b00003030 comp rx=0 tx=0).stop 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/577612911 shutdown_connections 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/577612911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e431640 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/577612911 >> 172.21.15.66:0/577612911 conn(0x55692e42be90 msgr2=0x55692e518580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/577612911 shutdown_connections 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.601+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/577612911 wait complete. 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692e2dba50 con 0x55692e3a57b0 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b10212640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b10212640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41736/0 (socket says 172.21.15.66:41736) 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b10212640 1 -- 172.21.15.66:0/2451763918 learned_addr learned my addr 172.21.15.66:0/2451763918 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b10212640 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e526590 con 0x55692e3a57b0 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b10212640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b0001bb20 tx=0x7f3b00018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 -- 172.21.15.66:0/2451763918 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000c4020 con 0x55692e3a57b0 2024-09-12T00:20:08.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55692e526820 con 0x55692e3a57b0 2024-09-12T00:20:08.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 -- 172.21.15.66:0/2451763918 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b000b6690 con 0x55692e3a57b0 2024-09-12T00:20:08.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 -- 172.21.15.66:0/2451763918 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b000b6970 con 0x55692e3a57b0 2024-09-12T00:20:08.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692e5271d0 con 0x55692e3a57b0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 -- 172.21.15.66:0/2451763918 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3b000c7020 con 0x55692e3a57b0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 0x7f39f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f39fce09640 1 -- 172.21.15.66:0/2451763918 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3b000bb070 con 0x55692e3a57b0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 0x7f39f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 0x55692e52d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.605+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e52d6e0 con 0x55692e4346a0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 0x55692e52d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 0x7f39f803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b04004180 tx=0x7f3b04001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 0x55692e52d1a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 -- 172.21.15.66:0/2451763918 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e4346a0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e52db50 con 0x55692e4346a0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 -- 172.21.15.66:0/2451763918 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e4346a0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 0x55692e531d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e532420 con 0x55692e52f960 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10212640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 0x55692e531d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10212640 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 0x55692e531d50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10212640 1 -- 172.21.15.66:0/2451763918 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b000a8070 con 0x55692e52f960 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e52e800 con 0x55692e4346a0 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 -- 172.21.15.66:0/2451763918 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e4346a0 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e52ecc0 con 0x55692e52f960 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10212640 1 -- 172.21.15.66:0/2451763918 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b000a8070 con 0x55692e52f960 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b1270c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692e346450 con 0x55692e540b50 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41740/0 (socket says 172.21.15.66:41740) 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 -- 172.21.15.66:0/2018057088 learned_addr learned my addr 172.21.15.66:0/2018057088 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.609+0000 7f3b10a13640 1 -- 172.21.15.66:0/2018057088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e5415b0 con 0x55692e540b50 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55692e527060 tx=0x7f3b080167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 -- 172.21.15.66:0/2018057088 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b08013640 con 0x55692e540b50 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 -- 172.21.15.66:0/2018057088 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b080137e0 con 0x55692e540b50 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 -- 172.21.15.66:0/2018057088 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b08013ae0 con 0x55692e540b50 2024-09-12T00:20:08.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55692e541e10 con 0x55692e540b50 2024-09-12T00:20:08.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692e542380 con 0x55692e540b50 2024-09-12T00:20:08.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 -- 172.21.15.66:0/2018057088 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3b08011040 con 0x55692e540b50 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 0x7f39e803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39f5ffb640 1 -- 172.21.15.66:0/2018057088 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3b0800e040 con 0x55692e540b50 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10212640 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 0x7f39e803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10212640 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 0x7f39e803bf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b00003050 tx=0x7f3b000e9640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b1270c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692e431dd0 con 0x55692e54e4a0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41742/0 (socket says 172.21.15.66:41742) 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 -- 172.21.15.66:0/1878127239 learned_addr learned my addr 172.21.15.66:0/1878127239 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 -- 172.21.15.66:0/1878127239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e54ee90 con 0x55692e54e4a0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f3b10a13640 1 --2- 172.21.15.66:0/1878127239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3b0801fc60 tx=0x7f3b0801fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ad2a05ee9bd9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39e77fe640 1 -- 172.21.15.66:0/1878127239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0801f340 con 0x55692e54e4a0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39e77fe640 1 -- 172.21.15.66:0/1878127239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08013c80 con 0x55692e54e4a0 2024-09-12T00:20:08.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.613+0000 7f39e77fe640 1 -- 172.21.15.66:0/1878127239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0801f4e0 con 0x55692e54e4a0 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/1878127239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 msgr2=0x55692e54e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/1878127239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3b0801fc60 tx=0x7f3b0801fc90 comp rx=0 tx=0).stop 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/1878127239 shutdown_connections 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/1878127239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e54e8a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/1878127239 >> 172.21.15.66:0/1878127239 conn(0x55692e5498c0 msgr2=0x55692e547b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/1878127239 shutdown_connections 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/1878127239 wait complete. 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 Processor -- start 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- start start 2024-09-12T00:20:08.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692e54d3f0 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10a13640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41746/0 (socket says 172.21.15.66:41746) 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 learned_addr learned my addr 172.21.15.66:0/459096231 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692e554ea0 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10a13640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b08020790 tx=0x7f3b080508b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 -- 172.21.15.66:0/459096231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0802e070 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55692e555130 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 -- 172.21.15.66:0/459096231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08052110 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 -- 172.21.15.66:0/459096231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b080523f0 con 0x55692e54e4a0 2024-09-12T00:20:08.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692e555130 con 0x55692e54e4a0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 -- 172.21.15.66:0/459096231 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3b0801f6c0 con 0x55692e54e4a0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39d8039c10 0x7f39d803c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f39e5ffb640 1 -- 172.21.15.66:0/459096231 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3b08048050 con 0x55692e54e4a0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.617+0000 7f3b10212640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39d8039c10 0x7f39d803c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e55fd30 0x55692e5621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e562910 con 0x55692e55fd30 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e55fd30 0x55692e5621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39d8039c10 0x7f39d803c0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55692e527540 tx=0x7f3b000c8780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e55fd30 0x55692e5621c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b0400e640 con 0x55692e55fd30 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 realm 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e55f0a0 con 0x55692e55fd30 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b0400e640 con 0x55692e55fd30 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e563410 con 0x55692e55fd30 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b0400e640 con 0x55692e55fd30 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e563ce0 con 0x55692e55fd30 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b0400e640 con 0x55692e55fd30 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e564590 0x55692e566980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e5670c0 con 0x55692e564590 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e564590 0x55692e566980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e564590 0x55692e566980 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 20 searching for the correct realm 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3b08032020 0x7f3b080209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3b08032020 0x7f3b080209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3b08032020 0x7f3b080209d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3b000f8040 0x7f3b000c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.621+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3b000f8040 0x7f3b000c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3b000f8040 0x7f3b000c8830 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0400e640 con 0x7f3b000f8040 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0400e640 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.625+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x55692e55fd30 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.629+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e564590 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b000f8040 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b04029040 con 0x7f3b000f8040 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x55692e55fd30 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55692e5689e0 con 0x7f3b08032020 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e567b00 con 0x55692e55fd30 2024-09-12T00:20:08.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e5683a0 con 0x55692e55fd30 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e567740 con 0x55692e564590 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 zone default found 2024-09-12T00:20:08.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 4 Realm: () 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 zonegroup default 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.633+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e567fd0 con 0x7f3b000f8040 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e56ae80 con 0x55692e564590 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e56b2a0 con 0x55692e564590 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 started sync module instance, tier type = 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56a220 con 0x7f3b08032020 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93910237355376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56b6e0 con 0x7f3b08032020 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56bf30 con 0x55692e55fd30 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.637+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93910237355376] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93910237362816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56c350 con 0x55692e55fd30 2024-09-12T00:20:08.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56cba0 con 0x55692e564590 2024-09-12T00:20:08.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93910237362816] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93910237364144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56c9c0 con 0x55692e564590 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56d5b0 con 0x7f3b08032020 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93910237368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56de00 con 0x7f3b08032020 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.641+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56e800 con 0x55692e55fd30 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.645+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93910237368576] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.645+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93910237364144] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.645+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.645+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93910237365264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56d950 con 0x55692e55fd30 2024-09-12T00:20:08.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.645+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56f0a0 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93910237365264] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93910237373200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56edc0 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56f610 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93910237376208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56f980 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e5704a0 con 0x7f3b000f8040 2024-09-12T00:20:08.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.649+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93910237373200] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93910237376208] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93910237380464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56f3d0 con 0x7f3b000f8040 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=0 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=1 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=2 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=3 2024-09-12T00:20:08.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=4 2024-09-12T00:20:08.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=5 2024-09-12T00:20:08.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=6 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93910237380464] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 20 add_watcher() i=7 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e573490 con 0x55692e55fd30 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.653+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93910237374736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e570910 con 0x55692e55fd30 2024-09-12T00:20:08.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93910237374736] v33'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f39c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 5 note: GC not initialized 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f39c57e2640 20 reqs_thread_entry: start 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 Filter name: none 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3936ffd640 20 reqs_thread_entry: start 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e5964b0 con 0x55692e55fd30 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:08.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55692e597a00 con 0x7f3b000f8040 2024-09-12T00:20:08.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.657+0000 7f39c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93910237374736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e595dd0 con 0x55692e55fd30 2024-09-12T00:20:08.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93910237374736] v33'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93910237355376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56e910 con 0x7f3b08032020 2024-09-12T00:20:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93910237355376] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b1270c9c0 20 remove_watcher() i=0 2024-09-12T00:20:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b1270c9c0 2 removed watcher, disabling cache 2024-09-12T00:20:08.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93910237362816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e569d70 con 0x55692e55fd30 2024-09-12T00:20:08.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.661+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93910237362816] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 20 remove_watcher() i=1 2024-09-12T00:20:08.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93910237364144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e569d70 con 0x55692e564590 2024-09-12T00:20:08.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b10a13640 1 -- 172.21.15.66:0/459096231 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93910237364144] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0800a4d0 con 0x55692e564590 2024-09-12T00:20:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 20 remove_watcher() i=2 2024-09-12T00:20:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93910237368576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56bfb0 con 0x7f3b08032020 2024-09-12T00:20:08.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b10212640 1 -- 172.21.15.66:0/459096231 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93910237368576] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b000a8070 con 0x7f3b08032020 2024-09-12T00:20:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 20 remove_watcher() i=3 2024-09-12T00:20:08.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.665+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93910237365264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e569d70 con 0x55692e55fd30 2024-09-12T00:20:08.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93910237365264] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x55692e55fd30 2024-09-12T00:20:08.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b1270c9c0 20 remove_watcher() i=4 2024-09-12T00:20:08.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93910237373200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56c460 con 0x7f3b000f8040 2024-09-12T00:20:08.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93910237373200] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b1270c9c0 20 remove_watcher() i=5 2024-09-12T00:20:08.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.669+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93910237376208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e569d70 con 0x7f3b000f8040 2024-09-12T00:20:08.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.673+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93910237376208] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.673+0000 7f3b1270c9c0 20 remove_watcher() i=6 2024-09-12T00:20:08.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.673+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93910237380464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55692e56e310 con 0x7f3b000f8040 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.673+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93910237380464] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b04039040 con 0x7f3b000f8040 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 20 remove_watcher() i=7 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3b000f8040 msgr2=0x7f3b000c8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f3b000f8040 0x7f3b000c8830 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e55fd30 msgr2=0x55692e5621c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e55fd30 0x55692e5621c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3b08032020 msgr2=0x7f3b080209d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3b08032020 0x7f3b080209d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e564590 msgr2=0x55692e566980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e564590 0x55692e566980 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39d8039c10 msgr2=0x7f39d803c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39d8039c10 0x7f39d803c0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55692e527540 tx=0x7f3b000c8780 comp rx=0 tx=0).stop 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 msgr2=0x55692e554940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b0fa11640 1 -- 172.21.15.66:0/459096231 reap_dead start 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3b08020790 tx=0x7f3b080508b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 shutdown_connections 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/459096231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e54e4a0 0x55692e554940 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 >> 172.21.15.66:0/459096231 conn(0x55692e5498c0 msgr2=0x55692e547ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 shutdown_connections 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/459096231 wait complete. 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 msgr2=0x7f39e803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 0x7f39e803bf30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b00003050 tx=0x7f3b000e9640 comp rx=0 tx=0).stop 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 msgr2=0x55692e540f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x55692e527060 tx=0x7f3b080167b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 shutdown_connections 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39e8039a70 0x7f39e803bf30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2018057088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e540b50 0x55692e540f70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 >> 172.21.15.66:0/2018057088 conn(0x55692e536500 msgr2=0x55692e5368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 shutdown_connections 2024-09-12T00:20:08.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2018057088 wait complete. 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 msgr2=0x55692e52d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 0x55692e52d1a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 msgr2=0x55692e531d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 0x55692e531d50 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 msgr2=0x7f39f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 0x7f39f803bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b04004180 tx=0x7f3b04001340 comp rx=0 tx=0).stop 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 msgr2=0x55692e526030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b0001bb20 tx=0x7f3b00018020 comp rx=0 tx=0).stop 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 shutdown_connections 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55692e52f960 0x55692e531d50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55692e4346a0 0x55692e52d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f39f8039a70 0x7f39f803bf30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 --2- 172.21.15.66:0/2451763918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692e3a57b0 0x55692e526030 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 >> 172.21.15.66:0/2451763918 conn(0x55692e42be90 msgr2=0x55692e4302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 shutdown_connections 2024-09-12T00:20:08.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.677+0000 7f3b1270c9c0 1 -- 172.21.15.66:0/2451763918 wait complete. 2024-09-12T00:20:08.693 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:08.693 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:08.694 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T00:20:08.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T00:20:08.694 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-12T00:20:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.774 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376d8a69c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ad96371b20 0x55ad96371f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376d8a69c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad962279c0 con 0x55ad96374d00 2024-09-12T00:20:08.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376d8a69c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55ad962776d0 con 0x55ad96371b20 2024-09-12T00:20:08.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376b3ac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ad96371b20 0x55ad96371f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376b3ac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55ad96371b20 0x55ad96371f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41752/0 (socket says 172.21.15.66:41752) 2024-09-12T00:20:08.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.769+0000 7f376b3ac640 1 -- 172.21.15.66:0/3631311384 learned_addr learned my addr 172.21.15.66:0/3631311384 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376b3ac640 1 -- 172.21.15.66:0/3631311384 >> v1:172.21.15.31:6789/0 conn(0x55ad96374d00 legacy=0x55ad963770f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376b3ac640 1 -- 172.21.15.66:0/3631311384 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad9621bca0 con 0x55ad96371b20 2024-09-12T00:20:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376b3ac640 1 --2- 172.21.15.66:0/3631311384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96371f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a4e0 tx=0x7f375c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941e7918e8c92fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376a3aa640 1 -- 172.21.15.66:0/3631311384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0aa540 con 0x55ad96371b20 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376a3aa640 1 -- 172.21.15.66:0/3631311384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0aa6e0 con 0x55ad96371b20 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376a3aa640 1 -- 172.21.15.66:0/3631311384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0aaa40 con 0x55ad96371b20 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 -- 172.21.15.66:0/3631311384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 msgr2=0x55ad96371f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/3631311384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96371f00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a4e0 tx=0x7f375c01b090 comp rx=0 tx=0).stop 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 -- 172.21.15.66:0/3631311384 shutdown_connections 2024-09-12T00:20:08.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/3631311384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96371f00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 -- 172.21.15.66:0/3631311384 >> 172.21.15.66:0/3631311384 conn(0x55ad9636d640 msgr2=0x55ad9636fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 -- 172.21.15.66:0/3631311384 shutdown_connections 2024-09-12T00:20:08.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.773+0000 7f376d8a69c0 1 -- 172.21.15.66:0/3631311384 wait complete. 2024-09-12T00:20:08.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ad9627b680 con 0x55ad96371b20 2024-09-12T00:20:08.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376b3ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376b3ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41756/0 (socket says 172.21.15.66:41756) 2024-09-12T00:20:08.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376b3ac640 1 -- 172.21.15.66:0/66563537 learned_addr learned my addr 172.21.15.66:0/66563537 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376b3ac640 1 -- 172.21.15.66:0/66563537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad961f6da0 con 0x55ad96371b20 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376b3ac640 1 --2- 172.21.15.66:0/66563537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ac040 tx=0x7f375c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400a7c5960aac503 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f365960a640 1 -- 172.21.15.66:0/66563537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b9030 con 0x55ad96371b20 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f365960a640 1 -- 172.21.15.66:0/66563537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0aaa40 con 0x55ad96371b20 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f365960a640 1 -- 172.21.15.66:0/66563537 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0aad20 con 0x55ad96371b20 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- 172.21.15.66:0/66563537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 msgr2=0x55ad9645df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/66563537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ac040 tx=0x7f375c0033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- 172.21.15.66:0/66563537 shutdown_connections 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/66563537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad9645df90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- 172.21.15.66:0/66563537 >> 172.21.15.66:0/66563537 conn(0x55ad9636d640 msgr2=0x55ad96459c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- 172.21.15.66:0/66563537 shutdown_connections 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 -- 172.21.15.66:0/66563537 wait complete. 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.789+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ad9621da50 con 0x55ad96371b20 2024-09-12T00:20:08.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376b3ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376b3ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41766/0 (socket says 172.21.15.66:41766) 2024-09-12T00:20:08.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376b3ac640 1 -- 172.21.15.66:0/2765301988 learned_addr learned my addr 172.21.15.66:0/2765301988 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376b3ac640 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad96468ce0 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376b3ac640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f375c003430 tx=0x7f375c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 -- 172.21.15.66:0/2765301988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0b9070 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad96468f70 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 -- 172.21.15.66:0/2765301988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0c2070 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 -- 172.21.15.66:0/2765301988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c0cb060 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad96469920 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 -- 172.21.15.66:0/2765301988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f375c0b3040 con 0x55ad96371b20 2024-09-12T00:20:08.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 0x7f365003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f3657e07640 1 -- 172.21.15.66:0/2765301988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f375c0ba070 con 0x55ad96371b20 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376abab640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 0x7f365003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 0x55ad9646f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad9646fe30 con 0x55ad96374d00 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376bbad640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 0x55ad9646f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376abab640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 0x7f365003bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3760001ec0 tx=0x7f3760001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.793+0000 7f376bbad640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 0x55ad9646f8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 -- 172.21.15.66:0/2765301988 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37640083f0 con 0x55ad96374d00 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad96470250 con 0x55ad96374d00 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 -- 172.21.15.66:0/2765301988 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37640083f0 con 0x55ad96374d00 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 0x55ad96474450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad96474b20 con 0x55ad96472060 2024-09-12T00:20:08.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376b3ac640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 0x55ad96474450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376b3ac640 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 0x55ad96474450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376b3ac640 1 -- 172.21.15.66:0/2765301988 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f375c0a9d90 con 0x55ad96472060 2024-09-12T00:20:08.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad96470ed0 con 0x55ad96374d00 2024-09-12T00:20:08.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 -- 172.21.15.66:0/2765301988 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37640083f0 con 0x55ad96374d00 2024-09-12T00:20:08.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad96471370 con 0x55ad96472060 2024-09-12T00:20:08.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376b3ac640 1 -- 172.21.15.66:0/2765301988 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f375c0a9d90 con 0x55ad96472060 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376d8a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ad96288450 con 0x55ad96483210 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41776/0 (socket says 172.21.15.66:41776) 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 -- 172.21.15.66:0/1260325125 learned_addr learned my addr 172.21.15.66:0/1260325125 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 -- 172.21.15.66:0/1260325125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad96483c70 con 0x55ad96483210 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.797+0000 7f376bbad640 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ad96469500 tx=0x7f376400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 -- 172.21.15.66:0/1260325125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376401c020 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 -- 172.21.15.66:0/1260325125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764007d00 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad964844d0 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 -- 172.21.15.66:0/1260325125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764018440 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad96484a40 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 -- 172.21.15.66:0/1260325125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f376401f020 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 0x7f364403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f3655602640 1 -- 172.21.15.66:0/1260325125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3764051e00 con 0x55ad96483210 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 0x7f364403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 0x7f364403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f375c0a9d20 tx=0x7f375c0be400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376d8a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ad9645e720 con 0x55ad96490ae0 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41792/0 (socket says 172.21.15.66:41792) 2024-09-12T00:20:08.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376bbad640 1 -- 172.21.15.66:0/2937959322 learned_addr learned my addr 172.21.15.66:0/2937959322 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376bbad640 1 -- 172.21.15.66:0/2937959322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad964914d0 con 0x55ad96490ae0 2024-09-12T00:20:08.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f376bbad640 1 --2- 172.21.15.66:0/2937959322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3764050150 tx=0x7f3764043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd673e1e34a4b1da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f364effd640 1 -- 172.21.15.66:0/2937959322 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764021400 con 0x55ad96490ae0 2024-09-12T00:20:08.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f364effd640 1 -- 172.21.15.66:0/2937959322 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764029350 con 0x55ad96490ae0 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.801+0000 7f364effd640 1 -- 172.21.15.66:0/2937959322 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37640215a0 con 0x55ad96490ae0 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2937959322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 msgr2=0x55ad96490ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2937959322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3764050150 tx=0x7f3764043110 comp rx=0 tx=0).stop 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2937959322 shutdown_connections 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2937959322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96490ee0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2937959322 >> 172.21.15.66:0/2937959322 conn(0x55ad9648bf00 msgr2=0x55ad9648a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2937959322 shutdown_connections 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2937959322 wait complete. 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 Processor -- start 2024-09-12T00:20:08.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- start start 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96496f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ad9648fa30 con 0x55ad96490ae0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96496f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376bbad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96496f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41802/0 (socket says 172.21.15.66:41802) 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 learned_addr learned my addr 172.21.15.66:0/1683740628 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad964974e0 con 0x55ad96490ae0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376bbad640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96496f80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f376404eff0 tx=0x7f37640500b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 -- 172.21.15.66:0/1683740628 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37640178b0 con 0x55ad96490ae0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 -- 172.21.15.66:0/1683740628 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764017a50 con 0x55ad96490ae0 2024-09-12T00:20:08.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad96497770 con 0x55ad96490ae0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 -- 172.21.15.66:0/1683740628 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3764017d30 con 0x55ad96490ae0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad96498120 con 0x55ad96490ae0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 -- 172.21.15.66:0/1683740628 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3764044020 con 0x55ad96490ae0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3634039a70 0x7f363403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f364d7fa640 1 -- 172.21.15.66:0/1683740628 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3764031070 con 0x55ad96490ae0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3634039a70 0x7f363403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad964a24f0 0x55ad964a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a50d0 con 0x55ad964a24f0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.805+0000 7f376abab640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad964a24f0 0x55ad964a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3634039a70 0x7f363403bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f375c0e8460 tx=0x7f375c0db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad964a24f0 0x55ad964a4980 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376000d040 con 0x55ad964a24f0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 realm 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a18a0 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376000d040 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a5bd0 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376000d040 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a64a0 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f376000d040 con 0x55ad964a24f0 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad964a6da0 0x55ad964a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a98f0 con 0x55ad964a6da0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad964a6da0 0x55ad964a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad964a6da0 0x55ad964a9190 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 20 searching for the correct realm 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x55ad964a6da0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3764021020 0x7f376402ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x7f3764021020 2024-09-12T00:20:08.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3764021020 0x7f376402ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3764021020 0x7f376402ca90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f375c0c6410 0x7f375c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x7f375c0c6410 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.809+0000 7f376abab640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f375c0c6410 0x7f375c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f375c0c6410 0x7f375c0b4740 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376000d040 con 0x7f375c0c6410 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x55ad964a24f0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376000d040 con 0x55ad964a24f0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x55ad964a24f0 2024-09-12T00:20:08.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x55ad964a24f0 2024-09-12T00:20:08.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x7f375c0c6410 2024-09-12T00:20:08.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ab1c0 con 0x7f3764021020 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f3764021020 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f3764021020 2024-09-12T00:20:08.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.813+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f375c0c6410 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f375c0c6410 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f3764021020 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.817+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f3764021020 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a6da0 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x55ad964a24f0 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f375c0f9040 con 0x7f3764021020 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964aa2b0 con 0x55ad964a24f0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964a9ef0 con 0x55ad964a24f0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964aabd0 con 0x55ad964a6da0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 zone default found 2024-09-12T00:20:08.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 4 Realm: () 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 zonegroup default 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.821+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964aa730 con 0x7f375c0c6410 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ad560 con 0x55ad964a6da0 2024-09-12T00:20:08.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ad5b0 con 0x55ad964a6da0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 started sync module instance, tier type = 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964aca00 con 0x7f3764021020 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94204039185744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ada80 con 0x7f3764021020 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ae2d0 con 0x55ad964a24f0 2024-09-12T00:20:08.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.825+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94204039185744] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94204039192096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ae6f0 con 0x55ad964a24f0 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964aef40 con 0x55ad964a6da0 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94204039194656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964af370 con 0x55ad964a6da0 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964afe40 con 0x7f3764021020 2024-09-12T00:20:08.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94204039192096] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94204039199024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964afe00 con 0x7f3764021020 2024-09-12T00:20:08.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.829+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b0840 con 0x55ad964a24f0 2024-09-12T00:20:08.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94204039194656] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94204039199024] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94204039193152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b0800 con 0x55ad964a24f0 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b10e0 con 0x7f375c0c6410 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94204039193152] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94204039201552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b0800 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.833+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b16b0 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94204039205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b1ad0 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b2520 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94204039201552] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94204039208976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b24e0 con 0x7f375c0c6410 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=0 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=1 2024-09-12T00:20:08.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=2 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=3 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=4 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.837+0000 7f376d8a69c0 20 add_watcher() i=5 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94204039205376] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 add_watcher() i=6 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94204039208976] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 add_watcher() i=7 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b1620 con 0x55ad964a24f0 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94204039206432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b2910 con 0x55ad964a24f0 2024-09-12T00:20:08.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94204039206432] v33'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f3621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 5 note: GC not initialized 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f3620fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 Filter name: none 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f359a7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.841+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964d85d0 con 0x55ad964a24f0 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376d8a69c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad964d9b20 con 0x7f375c0c6410 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv31 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f3621fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94204039206432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964d7ef0 con 0x55ad964a24f0 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94204039206432] v33'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.845+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94204039185744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b1620 con 0x7f3764021020 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94204039185744] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376d8a69c0 20 remove_watcher() i=0 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376d8a69c0 2 removed watcher, disabling cache 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94204039192096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ac550 con 0x55ad964a24f0 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94204039192096] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376d8a69c0 20 remove_watcher() i=1 2024-09-12T00:20:08.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.849+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94204039194656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ac550 con 0x55ad964a6da0 2024-09-12T00:20:08.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376bbad640 1 -- 172.21.15.66:0/1683740628 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94204039194656] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376403b020 con 0x55ad964a6da0 2024-09-12T00:20:08.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 20 remove_watcher() i=2 2024-09-12T00:20:08.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94204039199024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ac550 con 0x7f3764021020 2024-09-12T00:20:08.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376b3ac640 1 -- 172.21.15.66:0/1683740628 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94204039199024] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c0d3040 con 0x7f3764021020 2024-09-12T00:20:08.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 20 remove_watcher() i=3 2024-09-12T00:20:08.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94204039193152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964af930 con 0x55ad964a24f0 2024-09-12T00:20:08.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94204039193152] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x55ad964a24f0 2024-09-12T00:20:08.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 20 remove_watcher() i=4 2024-09-12T00:20:08.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.853+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94204039201552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964af930 con 0x7f375c0c6410 2024-09-12T00:20:08.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94204039201552] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376d8a69c0 20 remove_watcher() i=5 2024-09-12T00:20:08.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94204039205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964ae2d0 con 0x7f375c0c6410 2024-09-12T00:20:08.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94204039205376] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376d8a69c0 20 remove_watcher() i=6 2024-09-12T00:20:08.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.857+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94204039208976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad964b16b0 con 0x7f375c0c6410 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94204039208976] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a040 con 0x7f375c0c6410 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 20 remove_watcher() i=7 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f375c0c6410 msgr2=0x7f375c0b4740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f375c0c6410 0x7f375c0b4740 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad964a24f0 msgr2=0x55ad964a4980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad964a24f0 0x55ad964a4980 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3764021020 msgr2=0x7f376402ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f3764021020 0x7f376402ca90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad964a6da0 msgr2=0x55ad964a9190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad964a6da0 0x55ad964a9190 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3634039a70 msgr2=0x7f363403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3634039a70 0x7f363403bf30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f375c0e8460 tx=0x7f375c0db000 comp rx=0 tx=0).stop 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 msgr2=0x55ad96496f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1683740628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96490ae0 0x55ad96496f80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f376404eff0 tx=0x7f37640500b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376abab640 1 -- 172.21.15.66:0/1683740628 reap_dead start 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 shutdown_connections 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 >> 172.21.15.66:0/1683740628 conn(0x55ad9648bf00 msgr2=0x55ad9648a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 shutdown_connections 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1683740628 wait complete. 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 msgr2=0x7f364403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 0x7f364403bf30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f375c0a9d20 tx=0x7f375c0be400 comp rx=0 tx=0).stop 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 msgr2=0x55ad96483630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ad96469500 tx=0x7f376400bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 shutdown_connections 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3644039a70 0x7f364403bf30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/1260325125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96483210 0x55ad96483630 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 >> 172.21.15.66:0/1260325125 conn(0x55ad96478bc0 msgr2=0x55ad96478fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 shutdown_connections 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/1260325125 wait complete. 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 msgr2=0x55ad9646f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 0x55ad9646f8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 msgr2=0x55ad96474450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 0x55ad96474450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 msgr2=0x7f365003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 0x7f365003bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3760001ec0 tx=0x7f3760001440 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 msgr2=0x55ad96468780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f375c003430 tx=0x7f375c017e30 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 shutdown_connections 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55ad96472060 0x55ad96474450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55ad96374d00 0x55ad9646f8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3650039a70 0x7f365003bf30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 --2- 172.21.15.66:0/2765301988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ad96371b20 0x55ad96468780 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 >> 172.21.15.66:0/2765301988 conn(0x55ad9636d640 msgr2=0x55ad964586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 shutdown_connections 2024-09-12T00:20:08.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.861+0000 7f376d8a69c0 1 -- 172.21.15.66:0/2765301988 wait complete. 2024-09-12T00:20:08.876 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T00:00:00.000000Z","epoch":1726099200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T00:20:08.876 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:20:08.876 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T00:20:08.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T00:20:08.876 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-12T00:20:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:08.963 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2b0126c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556eb729f550 0x556eb729f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2b0126c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556eb71539c0 con 0x556eb72a26e0 2024-09-12T00:20:08.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2b0126c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x556eb71a36d0 con 0x556eb729f550 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afed72640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556eb729f550 0x556eb729f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afed72640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x556eb729f550 0x556eb729f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41804/0 (socket says 172.21.15.66:41804) 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afed72640 1 -- 172.21.15.66:0/727634735 learned_addr learned my addr 172.21.15.66:0/727634735 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afe571640 1 --1- 172.21.15.66:0/727634735 >> v1:172.21.15.31:6789/0 conn(0x556eb72a26e0 0x556eb72a4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37926/0 (socket says 172.21.15.66:37926) 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afed72640 1 -- 172.21.15.66:0/727634735 >> v1:172.21.15.31:6789/0 conn(0x556eb72a26e0 legacy=0x556eb72a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.961+0000 7f2afed72640 1 -- 172.21.15.66:0/727634735 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb7147ca0 con 0x556eb729f550 2024-09-12T00:20:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2afed72640 1 --2- 172.21.15.66:0/727634735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb729f930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2af800a4e0 tx=0x7f2af801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be529922c83ffd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2afdd70640 1 -- 172.21.15.66:0/727634735 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80aa540 con 0x556eb729f550 2024-09-12T00:20:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2afdd70640 1 -- 172.21.15.66:0/727634735 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80aa6e0 con 0x556eb729f550 2024-09-12T00:20:08.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2afdd70640 1 -- 172.21.15.66:0/727634735 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80aaa40 con 0x556eb729f550 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/727634735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 msgr2=0x556eb729f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/727634735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb729f930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2af800a4e0 tx=0x7f2af801b090 comp rx=0 tx=0).stop 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/727634735 shutdown_connections 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/727634735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb729f930 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/727634735 >> 172.21.15.66:0/727634735 conn(0x556eb729b070 msgr2=0x556eb729d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/727634735 shutdown_connections 2024-09-12T00:20:08.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.965+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/727634735 wait complete. 2024-09-12T00:20:08.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:08.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:08.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2b0126c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2b0126c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556eb71a7680 con 0x556eb729f550 2024-09-12T00:20:08.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2afed72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2afed72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41810/0 (socket says 172.21.15.66:41810) 2024-09-12T00:20:08.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2afed72640 1 -- 172.21.15.66:0/1721204095 learned_addr learned my addr 172.21.15.66:0/1721204095 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.977+0000 7f2afed72640 1 -- 172.21.15.66:0/1721204095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb7122da0 con 0x556eb729f550 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 --2- 172.21.15.66:0/1721204095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2af8019740 tx=0x7f2af80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b891f2580937ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29ece09640 1 -- 172.21.15.66:0/1721204095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80b9070 con 0x556eb729f550 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29ece09640 1 -- 172.21.15.66:0/1721204095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80aaa90 con 0x556eb729f550 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29ece09640 1 -- 172.21.15.66:0/1721204095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80aad70 con 0x556eb729f550 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1721204095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 msgr2=0x556eb7215fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1721204095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2af8019740 tx=0x7f2af80033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1721204095 shutdown_connections 2024-09-12T00:20:08.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1721204095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7215fb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1721204095 >> 172.21.15.66:0/1721204095 conn(0x556eb729b070 msgr2=0x556eb7386590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1721204095 shutdown_connections 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1721204095 wait complete. 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556eb7149a50 con 0x556eb729f550 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41816/0 (socket says 172.21.15.66:41816) 2024-09-12T00:20:08.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 -- 172.21.15.66:0/975445136 learned_addr learned my addr 172.21.15.66:0/975445136 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb73944a0 con 0x556eb729f550 2024-09-12T00:20:08.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2afed72640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2af8018cc0 tx=0x7f2af8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29eb606640 1 -- 172.21.15.66:0/975445136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80b9070 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556eb7394730 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29eb606640 1 -- 172.21.15.66:0/975445136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80b5b10 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f29eb606640 1 -- 172.21.15.66:0/975445136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af80b5df0 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.981+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eb73950e0 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f29eb606640 1 -- 172.21.15.66:0/975445136 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2af80b3040 con 0x556eb729f550 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f29eb606640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 0x7f29e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f29eb606640 1 -- 172.21.15.66:0/975445136 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2af80c4070 con 0x556eb729f550 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afe571640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 0x7f29e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 0x556eb739b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb739b5f0 con 0x556eb72a26e0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2aff573640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 0x556eb739b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afe571640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 0x7f29e403bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2af4001e40 tx=0x7f2af40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2aff573640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 0x556eb739b0b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2aff573640 1 -- 172.21.15.66:0/975445136 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af00083f0 con 0x556eb72a26e0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb739ba40 con 0x556eb72a26e0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2aff573640 1 -- 172.21.15.66:0/975445136 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2af00083f0 con 0x556eb72a26e0 2024-09-12T00:20:08.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 0x556eb739fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73a0310 con 0x556eb739d850 2024-09-12T00:20:08.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afed72640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 0x556eb739fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afed72640 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 0x556eb739fc40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afed72640 1 -- 172.21.15.66:0/975445136 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2af80a9ce0 con 0x556eb739d850 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb739c6f0 con 0x556eb72a26e0 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2aff573640 1 -- 172.21.15.66:0/975445136 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2af00083f0 con 0x556eb72a26e0 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb739cbd0 con 0x556eb739d850 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.985+0000 7f2afed72640 1 -- 172.21.15.66:0/975445136 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2af80a9ce0 con 0x556eb739d850 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:08.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556eb71b4450 con 0x556eb73aea60 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41820/0 (socket says 172.21.15.66:41820) 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2aff573640 1 -- 172.21.15.66:0/1583180934 learned_addr learned my addr 172.21.15.66:0/1583180934 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2aff573640 1 -- 172.21.15.66:0/1583180934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb73af4c0 con 0x556eb73aea60 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2aff573640 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x556eb7394f70 tx=0x7f2af000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 -- 172.21.15.66:0/1583180934 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af001c020 con 0x556eb73aea60 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 -- 172.21.15.66:0/1583180934 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0007d00 con 0x556eb73aea60 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556eb73afd20 con 0x556eb73aea60 2024-09-12T00:20:08.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 -- 172.21.15.66:0/1583180934 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0018440 con 0x556eb73aea60 2024-09-12T00:20:08.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eb73b0290 con 0x556eb73aea60 2024-09-12T00:20:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 -- 172.21.15.66:0/1583180934 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2af001f020 con 0x556eb73aea60 2024-09-12T00:20:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 0x7f29d803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.989+0000 7f29e8e01640 1 -- 172.21.15.66:0/1583180934 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2af0051d90 con 0x556eb73aea60 2024-09-12T00:20:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2afed72640 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 0x7f29d803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2afed72640 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 0x7f29d803bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2af80c7e50 tx=0x7f2af80c8f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556eb7216720 con 0x556eb73bc390 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41826/0 (socket says 172.21.15.66:41826) 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 -- 172.21.15.66:0/4235907873 learned_addr learned my addr 172.21.15.66:0/4235907873 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 -- 172.21.15.66:0/4235907873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb73bcd80 con 0x556eb73bc390 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 --2- 172.21.15.66:0/4235907873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2af00500b0 tx=0x7f2af00168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3917efafc09316bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f29e27fc640 1 -- 172.21.15.66:0/4235907873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0021400 con 0x556eb73bc390 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f29e27fc640 1 -- 172.21.15.66:0/4235907873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0029350 con 0x556eb73bc390 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f29e27fc640 1 -- 172.21.15.66:0/4235907873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af00215a0 con 0x556eb73bc390 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/4235907873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 msgr2=0x556eb73bc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/4235907873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2af00500b0 tx=0x7f2af00168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/4235907873 shutdown_connections 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/4235907873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73bc790 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/4235907873 >> 172.21.15.66:0/4235907873 conn(0x556eb73b77d0 msgr2=0x556eb73b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/4235907873 shutdown_connections 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/4235907873 wait complete. 2024-09-12T00:20:09.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 Processor -- start 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- start start 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2b0126c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556eb73bb2e0 con 0x556eb73bc390 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41834/0 (socket says 172.21.15.66:41834) 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 learned_addr learned my addr 172.21.15.66:0/1932363602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.993+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eb73c2e30 con 0x556eb73bc390 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2aff573640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73c28d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2af0050010 tx=0x7f2af0050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 -- 172.21.15.66:0/1932363602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0039070 con 0x556eb73bc390 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 -- 172.21.15.66:0/1932363602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0016e00 con 0x556eb73bc390 2024-09-12T00:20:09.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556eb73c30c0 con 0x556eb73bc390 2024-09-12T00:20:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 -- 172.21.15.66:0/1932363602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af0028300 con 0x556eb73bc390 2024-09-12T00:20:09.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eb73c3a70 con 0x556eb73bc390 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 -- 172.21.15.66:0/1932363602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2af003c070 con 0x556eb73bc390 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29c8039a70 0x7f29c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f29e0ff9640 1 -- 172.21.15.66:0/1932363602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2af0031070 con 0x556eb73bc390 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afed72640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29c8039a70 0x7f29c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb73cdea0 0x556eb73d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d0ab0 con 0x556eb73cdea0 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb73cdea0 0x556eb73d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afed72640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29c8039a70 0x7f29c803bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2af80e99a0 tx=0x7f2af80e2000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb73cdea0 0x556eb73d0360 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af400f620 con 0x556eb73cdea0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 realm 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73cd1f0 con 0x556eb73cdea0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af400f620 con 0x556eb73cdea0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d15b0 con 0x556eb73cdea0 2024-09-12T00:20:09.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af400f620 con 0x556eb73cdea0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d1e80 con 0x556eb73cdea0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2af400f620 con 0x556eb73cdea0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb73d28a0 0x556eb73d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d53d0 con 0x556eb73d28a0 2024-09-12T00:20:09.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:08.997+0000 7f2aff573640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb73d28a0 0x556eb73d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2aff573640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb73d28a0 0x556eb73d4c90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2b0126c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2b0126c9c0 20 searching for the correct realm 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2aff573640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2af0021020 0x7f2af000c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afed72640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2af0021020 0x7f2af000c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afed72640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2af0021020 0x7f2af000c0b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afed72640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2af80f7040 0x7f2af80d1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2af80f7040 0x7f2af80d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2af80f7040 0x7f2af80d1920 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af400f620 con 0x7f2af80f7040 2024-09-12T00:20:09.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af400f620 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.001+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.005+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x556eb73cdea0 2024-09-12T00:20:09.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.009+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73d28a0 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af80f7040 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af402b040 con 0x7f2af80f7040 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x556eb73cdea0 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d6ca0 con 0x7f2af0021020 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:09.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d5e20 con 0x556eb73cdea0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d66c0 con 0x556eb73cdea0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d7040 con 0x556eb73d28a0 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 zone default found 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 4 Realm: () 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 zonegroup default 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d7440 con 0x7f2af80f7040 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9720 con 0x556eb73d28a0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9720 con 0x556eb73d28a0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 started sync module instance, tier type = 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.013+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d8bb0 con 0x7f2af0021020 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934009028560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9b50 con 0x7f2af0021020 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73da3a0 con 0x556eb73cdea0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934009028560] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934009029616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73da440 con 0x556eb73cdea0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.017+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73daf40 con 0x556eb73d28a0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934009029616] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934009035312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73daf00 con 0x556eb73d28a0 2024-09-12T00:20:09.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73db980 con 0x7f2af0021020 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934009038032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dc1d0 con 0x7f2af0021020 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dcbd0 con 0x556eb73cdea0 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934009035312] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.021+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934009038032] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934009032432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dbd20 con 0x556eb73cdea0 2024-09-12T00:20:09.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dd4a0 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934009032432] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934009042656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dbd20 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.025+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dd9e0 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.029+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934009042656] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.029+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.029+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934009046192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73dd9a0 con 0x7f2af80f7040 2024-09-12T00:20:09.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.029+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73de3e0 con 0x7f2af80f7040 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934009046192] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934009048752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73de3a0 con 0x7f2af80f7040 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=0 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=1 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=2 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=3 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=4 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=5 2024-09-12T00:20:09.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=6 2024-09-12T00:20:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934009048752] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 add_watcher() i=7 2024-09-12T00:20:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb73e1800 con 0x556eb73cdea0 2024-09-12T00:20:09.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934009044448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73decf0 con 0x556eb73cdea0 2024-09-12T00:20:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934009044448] v33'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f29b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:09.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 5 note: GC not initialized 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f292ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.033+0000 7f2b0126c9c0 20 Filter name: none 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f292dffb640 20 reqs_thread_entry: start 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb7404e30 con 0x7f2af80f7040 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:20:09.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb74034d0 con 0x556eb73cdea0 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:20:09.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7403f90 con 0x7f2af80f7040 2024-09-12T00:20:09.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v33'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.037+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93934009203168 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb7408aa0 con 0x7f2af80f7040 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify (1) cookie 93934009048752 notify 141733920799 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556eb7408420 con 0x7f2af80f7040 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 93934009048752 notifier 4725 bl.length()=556 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e27fc640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f29c4003eb0 con 0x7f2af80f7040 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(65 notify.7 [notify cookie 93934009203168 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify_complete (2) cookie 93934009203168 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556eb74036a0 con 0x7f2af80f7040 2024-09-12T00:20:09.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7408aa0 con 0x556eb73cdea0 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2b0126c9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2b0126c9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2b0126c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93934009203168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556eb7408eb0 con 0x7f2af80f7040 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== watch-notify(notify (1) cookie 93934009042656 notify 141733920800 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556eb74036a0 con 0x7f2af80f7040 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(68 notify.5 [notify cookie 93934009203168 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 93934009042656 notifier 4725 bl.length()=177 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:20:09.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:20:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f29e1ffb640 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2934003410 con 0x7f2af80f7040 2024-09-12T00:20:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.041+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== watch-notify(notify_complete (2) cookie 93934009203168 notify 141733920800 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2af4018040 con 0x7f2af80f7040 2024-09-12T00:20:09.048 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T00:20:09.041616Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:09.041604Z","tags":[],"group_ids":[]} 2024-09-12T00:20:09.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f29b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:09.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934009044448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7402b00 con 0x556eb73cdea0 2024-09-12T00:20:09.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93934009044448] v33'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934009028560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7402b00 con 0x7f2af0021020 2024-09-12T00:20:09.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93934009028560] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2b0126c9c0 20 remove_watcher() i=0 2024-09-12T00:20:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2b0126c9c0 2 removed watcher, disabling cache 2024-09-12T00:20:09.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.045+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934009029616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7402b00 con 0x556eb73cdea0 2024-09-12T00:20:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93934009029616] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2b0126c9c0 20 remove_watcher() i=1 2024-09-12T00:20:09.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934009035312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb7402b00 con 0x556eb73d28a0 2024-09-12T00:20:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2aff573640 1 -- 172.21.15.66:0/1932363602 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93934009035312] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af003b030 con 0x556eb73d28a0 2024-09-12T00:20:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2b0126c9c0 20 remove_watcher() i=2 2024-09-12T00:20:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.049+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934009038032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9480 con 0x7f2af0021020 2024-09-12T00:20:09.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2afed72640 1 -- 172.21.15.66:0/1932363602 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93934009038032] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af80a9ce0 con 0x7f2af0021020 2024-09-12T00:20:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2b0126c9c0 20 remove_watcher() i=3 2024-09-12T00:20:09.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934009032432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9480 con 0x556eb73cdea0 2024-09-12T00:20:09.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93934009032432] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x556eb73cdea0 2024-09-12T00:20:09.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2b0126c9c0 20 remove_watcher() i=4 2024-09-12T00:20:09.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934009042656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9480 con 0x7f2af80f7040 2024-09-12T00:20:09.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93934009042656] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.053+0000 7f2b0126c9c0 20 remove_watcher() i=5 2024-09-12T00:20:09.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.057+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934009046192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9480 con 0x7f2af80f7040 2024-09-12T00:20:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.057+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93934009046192] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.057+0000 7f2b0126c9c0 20 remove_watcher() i=6 2024-09-12T00:20:09.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.057+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934009048752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556eb73d9480 con 0x7f2af80f7040 2024-09-12T00:20:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93934009048752] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2af403b040 con 0x7f2af80f7040 2024-09-12T00:20:09.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 20 remove_watcher() i=7 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2af80f7040 msgr2=0x7f2af80d1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2af80f7040 0x7f2af80d1920 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb73cdea0 msgr2=0x556eb73d0360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb73cdea0 0x556eb73d0360 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2af0021020 msgr2=0x7f2af000c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2af0021020 0x7f2af000c0b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb73d28a0 msgr2=0x556eb73d4c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb73d28a0 0x556eb73d4c90 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29c8039a70 msgr2=0x7f29c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29c8039a70 0x7f29c803bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2af80e99a0 tx=0x7f2af80e2000 comp rx=0 tx=0).stop 2024-09-12T00:20:09.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 msgr2=0x556eb73c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1932363602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73bc390 0x556eb73c28d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2af0050010 tx=0x7f2af0050040 comp rx=0 tx=0).stop 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 reap_dead start 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2afe571640 1 -- 172.21.15.66:0/1932363602 reap_dead start 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 shutdown_connections 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 >> 172.21.15.66:0/1932363602 conn(0x556eb73b77d0 msgr2=0x556eb73b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 shutdown_connections 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1932363602 wait complete. 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 msgr2=0x7f29d803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 0x7f29d803bf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2af80c7e50 tx=0x7f2af80c8f20 comp rx=0 tx=0).stop 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 msgr2=0x556eb73aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x556eb7394f70 tx=0x7f2af000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 shutdown_connections 2024-09-12T00:20:09.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29d8039ac0 0x7f29d803bf80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/1583180934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb73aea60 0x556eb73aee80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 >> 172.21.15.66:0/1583180934 conn(0x556eb73a4410 msgr2=0x556eb73a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 shutdown_connections 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/1583180934 wait complete. 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 msgr2=0x556eb739b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 0x556eb739b0b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 msgr2=0x556eb739fc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 0x556eb739fc40 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 msgr2=0x7f29e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 0x7f29e403bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2af4001e40 tx=0x7f2af40013a0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 msgr2=0x556eb7393f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2af8018cc0 tx=0x7f2af8017e30 comp rx=0 tx=0).stop 2024-09-12T00:20:09.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 shutdown_connections 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x556eb739d850 0x556eb739fc40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x556eb72a26e0 0x556eb739b0b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f29e4039a70 0x7f29e403bf30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 --2- 172.21.15.66:0/975445136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556eb729f550 0x556eb7393f40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 >> 172.21.15.66:0/975445136 conn(0x556eb729b070 msgr2=0x556eb7214b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 shutdown_connections 2024-09-12T00:20:09.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.061+0000 7f2b0126c9c0 1 -- 172.21.15.66:0/975445136 wait complete. 2024-09-12T00:20:09.074 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T00:20:09.041616Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:09.041604Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:09.097 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:20:09.108 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-12T00:20:09.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T00:20:09.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T00:20:09.108 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-12T00:20:09.150 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:09.150 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0dbb0ac9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cc4bfa730 0x561cc4bfab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0dbb0ac9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561cc4ab09c0 con 0x561cc4bfb050 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0dbb0ac9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x561cc4b006d0 con 0x561cc4bfa730 2024-09-12T00:20:09.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0db8bb2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x561cc4bfa730 0x561cc4bfab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0db83b1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x561cc4bfb050 0x561cc4c01a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37932/0 (socket says 172.21.15.66:37932) 2024-09-12T00:20:09.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.145+0000 7f0db83b1640 1 -- 172.21.15.66:0/3286404224 learned_addr learned my addr 172.21.15.66:0/3286404224 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:09.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db8bb2640 1 -- 172.21.15.66:0/3286404224 >> v1:172.21.15.31:6789/0 conn(0x561cc4bfb050 legacy=0x561cc4c01a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db8bb2640 1 -- 172.21.15.66:0/3286404224 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4aa4ca0 con 0x561cc4bfa730 2024-09-12T00:20:09.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/3286404224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4bfab10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0db000a420 tx=0x7f0db001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcbbd3acabb48d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db7bb0640 1 -- 172.21.15.66:0/3286404224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00af070 con 0x561cc4bfa730 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db7bb0640 1 -- 172.21.15.66:0/3286404224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db00aa530 con 0x561cc4bfa730 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0db7bb0640 1 -- 172.21.15.66:0/3286404224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00aa850 con 0x561cc4bfa730 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3286404224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 msgr2=0x561cc4bfab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3286404224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4bfab10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0db000a420 tx=0x7f0db001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3286404224 shutdown_connections 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3286404224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4bfab10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3286404224 >> 172.21.15.66:0/3286404224 conn(0x561cc4bf6640 msgr2=0x561cc4bf8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3286404224 shutdown_connections 2024-09-12T00:20:09.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.149+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3286404224 wait complete. 2024-09-12T00:20:09.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.161+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc4b04680 con 0x561cc4bfa730 2024-09-12T00:20:09.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41844/0 (socket says 172.21.15.66:41844) 2024-09-12T00:20:09.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 -- 172.21.15.66:0/1108567276 learned_addr learned my addr 172.21.15.66:0/1108567276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 -- 172.21.15.66:0/1108567276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4a7fda0 con 0x561cc4bfa730 2024-09-12T00:20:09.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/1108567276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0db0018c00 tx=0x7f0db00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d9457b9f5eff82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0ca6e0d640 1 -- 172.21.15.66:0/1108567276 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00af040 con 0x561cc4bfa730 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0ca6e0d640 1 -- 172.21.15.66:0/1108567276 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db00aaa00 con 0x561cc4bfa730 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0ca6e0d640 1 -- 172.21.15.66:0/1108567276 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00aace0 con 0x561cc4bfa730 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/1108567276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 msgr2=0x561cc4ce7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/1108567276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0db0018c00 tx=0x7f0db00033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/1108567276 shutdown_connections 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/1108567276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ce7800 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/1108567276 >> 172.21.15.66:0/1108567276 conn(0x561cc4bf6640 msgr2=0x561cc4ce34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/1108567276 shutdown_connections 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/1108567276 wait complete. 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0dbb0ac9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc4aa6a50 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41856/0 (socket says 172.21.15.66:41856) 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 -- 172.21.15.66:0/2053858576 learned_addr learned my addr 172.21.15.66:0/2053858576 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.165+0000 7f0db8bb2640 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4cef290 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0db0018c00 tx=0x7f0db0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 -- 172.21.15.66:0/2053858576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00c5070 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc4cef520 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 -- 172.21.15.66:0/2053858576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db00c1690 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc4ceff50 con 0x561cc4bfa730 2024-09-12T00:20:09.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 -- 172.21.15.66:0/2053858576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0db00c1970 con 0x561cc4bfa730 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 -- 172.21.15.66:0/2053858576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0db00c1b10 con 0x561cc4bfa730 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 0x7f0ca003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0ca560a640 1 -- 172.21.15.66:0/2053858576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0db00bb070 con 0x561cc4bfa730 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db83b1640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 0x7f0ca003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 0x561cc4cf5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4cf63e0 con 0x561cc4bfb050 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db93b3640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 0x561cc4cf5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db83b1640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 0x7f0ca003bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0dac001d80 tx=0x7f0dac0012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db93b3640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 0x561cc4cf5ea0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db93b3640 1 -- 172.21.15.66:0/2053858576 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da80083f0 con 0x561cc4bfb050 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4cf6850 con 0x561cc4bfb050 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db93b3640 1 -- 172.21.15.66:0/2053858576 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0da80083f0 con 0x561cc4bfb050 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 0x561cc4cfaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4cfb140 con 0x561cc4cf8660 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 0x561cc4cfaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.169+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 0x561cc4cfaa50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db8bb2640 1 -- 172.21.15.66:0/2053858576 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0db00c7070 con 0x561cc4cf8660 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4cf7500 con 0x561cc4bfb050 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 -- 172.21.15.66:0/2053858576 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0da80083f0 con 0x561cc4bfb050 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4cf79c0 con 0x561cc4cf8660 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db8bb2640 1 -- 172.21.15.66:0/2053858576 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0db00c7070 con 0x561cc4cf8660 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc4b11450 con 0x561cc4d09850 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41868/0 (socket says 172.21.15.66:41868) 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 -- 172.21.15.66:0/3805931340 learned_addr learned my addr 172.21.15.66:0/3805931340 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 -- 172.21.15.66:0/3805931340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4d0a2b0 con 0x561cc4d09850 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0db93b3640 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x561cc4cef770 tx=0x7f0da800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0c9e7fc640 1 -- 172.21.15.66:0/3805931340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da801c020 con 0x561cc4d09850 2024-09-12T00:20:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0c9e7fc640 1 -- 172.21.15.66:0/3805931340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da8007d00 con 0x561cc4d09850 2024-09-12T00:20:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0c9e7fc640 1 -- 172.21.15.66:0/3805931340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da8018440 con 0x561cc4d09850 2024-09-12T00:20:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc4d0ab10 con 0x561cc4d09850 2024-09-12T00:20:09.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.173+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc4d0b080 con 0x561cc4d09850 2024-09-12T00:20:09.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c9e7fc640 1 -- 172.21.15.66:0/3805931340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0da801f020 con 0x561cc4d09850 2024-09-12T00:20:09.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c9e7fc640 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 0x7f0c9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c9e7fc640 1 -- 172.21.15.66:0/3805931340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0da8051de0 con 0x561cc4d09850 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 0x7f0c9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 0x7f0c9003bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0db00bfaa0 tx=0x7f0db00b6420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc4ce7f70 con 0x561cc4d17160 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41876/0 (socket says 172.21.15.66:41876) 2024-09-12T00:20:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db93b3640 1 -- 172.21.15.66:0/2364843374 learned_addr learned my addr 172.21.15.66:0/2364843374 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db93b3640 1 -- 172.21.15.66:0/2364843374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4d17b50 con 0x561cc4d17160 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0db93b3640 1 --2- 172.21.15.66:0/2364843374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0da8050130 tx=0x7f0da8043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3841d56bf37699a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c8ffff640 1 -- 172.21.15.66:0/2364843374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da8021400 con 0x561cc4d17160 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c8ffff640 1 -- 172.21.15.66:0/2364843374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da8029c50 con 0x561cc4d17160 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0c8ffff640 1 -- 172.21.15.66:0/2364843374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da80215a0 con 0x561cc4d17160 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2364843374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 msgr2=0x561cc4d17560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2364843374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0da8050130 tx=0x7f0da8043110 comp rx=0 tx=0).stop 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2364843374 shutdown_connections 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2364843374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d17560 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2364843374 >> 172.21.15.66:0/2364843374 conn(0x561cc4d12580 msgr2=0x561cc4d107c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2364843374 shutdown_connections 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2364843374 wait complete. 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 Processor -- start 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- start start 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d1d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.177+0000 7f0dbb0ac9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561cc4d160b0 con 0x561cc4d17160 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d1d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db93b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d1d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41880/0 (socket says 172.21.15.66:41880) 2024-09-12T00:20:09.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 learned_addr learned my addr 172.21.15.66:0/39572829 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc4d1dbc0 con 0x561cc4d17160 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db93b3640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d1d660 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0da8016a50 tx=0x7f0da8050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 -- 172.21.15.66:0/39572829 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da8028740 con 0x561cc4d17160 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 -- 172.21.15.66:0/39572829 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da80289c0 con 0x561cc4d17160 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561cc4d1de50 con 0x561cc4d17160 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 -- 172.21.15.66:0/39572829 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da8028ce0 con 0x561cc4d17160 2024-09-12T00:20:09.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc4d1e800 con 0x561cc4d17160 2024-09-12T00:20:09.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 -- 172.21.15.66:0/39572829 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0da8016040 con 0x561cc4d17160 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c84039a70 0x7f0c8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0c8e7fc640 1 -- 172.21.15.66:0/39572829 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0da8032030 con 0x561cc4d17160 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c84039a70 0x7f0c8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4d28bd0 0x561cc4d2b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d2b7b0 con 0x561cc4d28bd0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db83b1640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4d28bd0 0x561cc4d2b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c84039a70 0x7f0c8403bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0db00a9fc0 tx=0x7f0db00d9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db83b1640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4d28bd0 0x561cc4d2b060 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dac00e5a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 20 realm 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.181+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d27f80 con 0x561cc4d28bd0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dac00e5a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d2c2b0 con 0x561cc4d28bd0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dac00e5a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d2cb80 con 0x561cc4d28bd0 2024-09-12T00:20:09.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0dac00e5a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4d2d5a0 0x561cc4d2f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d30080 con 0x561cc4d2d5a0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4d2d5a0 0x561cc4d2f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4d2d5a0 0x561cc4d2f990 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 20 searching for the correct realm 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0da8021020 0x7f0da80203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0da8021020 0x7f0da80203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0da8021020 0x7f0da80203b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db8bb2640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0db00b5470 0x7f0db00c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db83b1640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0db00b5470 0x7f0db00c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.185+0000 7f0db83b1640 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0db00b5470 0x7f0db00c9760 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac00e5a0 con 0x7f0db00b5470 2024-09-12T00:20:09.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac00e5a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.189+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x561cc4d28bd0 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.193+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d2d5a0 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0db00b5470 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dac029040 con 0x7f0db00b5470 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x561cc4d28bd0 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31950 con 0x7f0da8021020 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d30a00 con 0x561cc4d28bd0 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d312a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d31d80 con 0x561cc4d2d5a0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 zone default found 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 4 Realm: () 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:09.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 zonegroup default 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d32120 con 0x7f0db00b5470 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.197+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d33f30 con 0x561cc4d2d5a0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d343a0 con 0x561cc4d2d5a0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 20 started sync module instance, tier type = 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d333d0 con 0x7f0da8021020 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94681561247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d34800 con 0x7f0da8021020 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d35050 con 0x561cc4d28bd0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94681561247520] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94681561253888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d350d0 con 0x561cc4d28bd0 2024-09-12T00:20:09.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.201+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d35920 con 0x561cc4d2d5a0 2024-09-12T00:20:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94681561253888] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94681561255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d35720 con 0x561cc4d2d5a0 2024-09-12T00:20:09.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d36240 con 0x7f0da8021020 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94681561259280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d36200 con 0x7f0da8021020 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d371a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.205+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94681561255216] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94681561259280] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94681561261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d371a0 con 0x561cc4d28bd0 2024-09-12T00:20:09.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d37590 con 0x7f0db00b5470 2024-09-12T00:20:09.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94681561261616] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94681561256336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d36cc0 con 0x7f0db00b5470 2024-09-12T00:20:09.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.209+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d37fa0 con 0x7f0db00b5470 2024-09-12T00:20:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.213+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94681561256336] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.213+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.213+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94681561264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d37fa0 con 0x7f0db00b5470 2024-09-12T00:20:09.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.213+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d38960 con 0x7f0db00b5470 2024-09-12T00:20:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94681561264816] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94681561267200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d38960 con 0x7f0db00b5470 2024-09-12T00:20:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=0 2024-09-12T00:20:09.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=1 2024-09-12T00:20:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=2 2024-09-12T00:20:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=3 2024-09-12T00:20:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=4 2024-09-12T00:20:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=5 2024-09-12T00:20:09.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=6 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94681561267200] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 add_watcher() i=7 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3bc40 con 0x561cc4d28bd0 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94681561269792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d38ef0 con 0x561cc4d28bd0 2024-09-12T00:20:09.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94681561269792] v33'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.217+0000 7f0dbb0ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 5 note: GC not initialized 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c6e7e4640 20 reqs_thread_entry: start 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 20 Filter name: none 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c677fe640 20 reqs_thread_entry: start 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d5f370 con 0x7f0db00b5470 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d63b00 con 0x7f0da8021020 2024-09-12T00:20:09.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v33'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T00:20:09.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:09.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T00:20:09.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94681561445568 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d647f0 con 0x7f0db00b5470 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== watch-notify(notify (1) cookie 94681561256336 notify 141733920801 ret 0) ==== 424+0+0 (crc 0 0 0) 0x561cc4ab09c0 con 0x7f0db00b5470 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94681561256336 notifier 4732 bl.length()=382 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c8ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(64 notify.5 [notify cookie 94681561445568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.221+0000 7f0c8ffff640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0c7c003eb0 con 0x7f0db00b5470 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== watch-notify(notify_complete (2) cookie 94681561445568 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0dac03d7f0 con 0x7f0db00b5470 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d634c0 con 0x561cc4d28bd0 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 : miss 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:09.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 8.19 8:9f82fb81:root::.bucket.meta.myfoo6%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d61930 con 0x561cc4d28bd0 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:09.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 8.19 8:9f82fb81:root::.bucket.meta.myfoo6%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d6ba70 con 0x561cc4d28bd0 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v33'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9, ofs0, ns] 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 94681561437760 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d69300 con 0x561cc4d28bd0 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify (1) cookie 94681561253888 notify 141733920793 ret 0) ==== 798+0+0 (crc 0 0 0) 0x561cc4d61d20 con 0x561cc4d28bd0 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94681561253888 notifier 4732 bl.length()=756 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0c8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:09.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0c8ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0c8ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0c8ffff640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0c7c003eb0 con 0x561cc4d28bd0 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(69 notify.1 [notify cookie 94681561437760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== watch-notify(notify_complete (2) cookie 94681561437760 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cc4d63620 con 0x561cc4d28bd0 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): orig_sources= new_sources= 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): potential sources added=[] removed=[] 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): orig_dests= new_dests= 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): potential dests added=[] removed=[] 2024-09-12T00:20:09.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.225+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d61640 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(71 bud.buckets [call] v33'7 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d61640 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(72 bud.buckets [call] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d61640 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v33'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94681561437760 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d64e80 con 0x7f0da8021020 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== watch-notify(notify (1) cookie 94681561259280 notify 141733920783 ret 0) ==== 358+0+0 (crc 0 0 0) 0x561cc4ceff50 con 0x7f0da8021020 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0c8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94681561259280 notifier 4732 bl.length()=316 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0c8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(74 notify.3 [notify cookie 94681561437760 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0c8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T00:20:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0c8f7fe640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0be0003410 con 0x7f0da8021020 2024-09-12T00:20:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== watch-notify(notify_complete (2) cookie 94681561437760 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cc4cef520 con 0x7f0da8021020 2024-09-12T00:20:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 2024-09-12T00:20:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.229+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 8.19 8:9f82fb81:root::.bucket.meta.myfoo6%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d624f0 con 0x561cc4d28bd0 2024-09-12T00:20:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(76 .bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v33'9 uv9 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T00:20:09.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9, ofs0, ns] 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94681561443424 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d61fb0 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== watch-notify(notify (1) cookie 94681561253888 notify 141733920794 ret 0) ==== 798+0+0 (crc 0 0 0) 0x561cc4d64c20 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0c8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94681561253888 notifier 4732 bl.length()=756 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0c8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0c8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0c8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(77 notify.1 [notify cookie 94681561443424 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0c8f7fe640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0be00034e0 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== watch-notify(notify_complete (2) cookie 94681561443424 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cc4d68c80 con 0x561cc4d28bd0 2024-09-12T00:20:09.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): orig_sources= new_sources= 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): potential sources added=[] removed=[] 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): orig_dests= new_dests= 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 20 handle_bi_update(): bucket=:myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]): potential dests added=[] removed=[] 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:79 4.11 4:8bb25da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0db00b5470 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(79 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 4.f 4:f172db17:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d28bd0 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(80 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:81 4.2e 4:77e3f693:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d2d5a0 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(81 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:82 4.1 4:81ccc470:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0da8021020 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(82 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.233+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 4.1 4:83c359e0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0da8021020 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(83 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:84 4.32 4:4e2cf187:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(84 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:85 4.2 4:42b02f6f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(85 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:86 4.2 4:4201b265:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(86 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:87 4.1c 4:3865b24e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0db00b5470 2024-09-12T00:20:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(87 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0db00b5470 2024-09-12T00:20:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(88 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [call out=382b] v0'0 uv5 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 4.0 4:037b56bf:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x561cc4d2d5a0 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(89 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 20 get_obj_state: octx=0x7f0db00bf8b0 obj=myfoo6:thirteen state=0x561cc4d60238 s->prefetch_data=0 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.237+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 3.1s0 3:81478651:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d62b90 con 0x7f0db00b5470 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(90 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 10 manifest: total_size = 8 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.16269407127610151372 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-12T00:20:09.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 get_obj_state: octx=0x7f0db00bf8b0 obj=myfoo6:thirteen state=0x561cc4d60238 s->prefetch_data=0 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:91 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d683c0 con 0x7f0db00b5470 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(91 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.241+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 3.1s0 3:81478651:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d683c0 con 0x7f0db00b5470 2024-09-12T00:20:09.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(92 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:93 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d6e170 con 0x7f0db00b5470 2024-09-12T00:20:09.249 INFO:teuthology.orchestra.run.smithi066.stderr:1 objects processed in :myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9]). Next marker thirteen 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d6e170 con 0x7f0da8021020 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v33'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T00:20:09.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94681561440176 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d6e170 con 0x7f0db00b5470 2024-09-12T00:20:09.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== watch-notify(notify (1) cookie 94681561256336 notify 141733920802 ret 0) ==== 598+0+0 (crc 0 0 0) 0x561cc4d68c80 con 0x7f0db00b5470 2024-09-12T00:20:09.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(93 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94681561256336 notifier 4732 bl.length()=556 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0c8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0c8ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0c8ffff640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0c7c003eb0 con 0x7f0db00b5470 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0c8f7fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(95 notify.5 [notify cookie 94681561440176 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.245+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== watch-notify(notify_complete (2) cookie 94681561440176 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561cc4d63620 con 0x7f0db00b5470 2024-09-12T00:20:09.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d64180 con 0x561cc4d28bd0 2024-09-12T00:20:09.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94681561440176 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d64180 con 0x7f0db00b5470 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== watch-notify(notify (1) cookie 94681561256336 notify 141733920803 ret 0) ==== 219+0+0 (crc 0 0 0) 0x561cc4d63620 con 0x7f0db00b5470 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0c8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94681561256336 notifier 4732 bl.length()=177 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0c8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0c8f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0c8f7fe640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0be00034e0 con 0x7f0db00b5470 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(98 notify.5 [notify cookie 94681561440176 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== watch-notify(notify_complete (2) cookie 94681561440176 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0dac03d7f0 con 0x7f0db00b5470 2024-09-12T00:20:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 10 removing user index: bar 2024-09-12T00:20:09.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.249+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d64180 con 0x7f0db00b5470 2024-09-12T00:20:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(100 bar [delete] v33'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0dbb0ac9c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-12T00:20:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0dbb0ac9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T00:20:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94681561440176 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d60050 con 0x7f0db00b5470 2024-09-12T00:20:09.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== watch-notify(notify (1) cookie 94681561267200 notify 141733920804 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f0dac03d7f0 con 0x7f0db00b5470 2024-09-12T00:20:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94681561267200 notifier 4732 bl.length()=152 2024-09-12T00:20:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0c8ffff640 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0c7c003eb0 con 0x7f0db00b5470 2024-09-12T00:20:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(101 notify.7 [notify cookie 94681561440176 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== watch-notify(notify_complete (2) cookie 94681561440176 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0dac058960 con 0x7f0db00b5470 2024-09-12T00:20:09.258 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T00:20:09.041616Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:09.041604Z","tags":[],"group_ids":[]} 2024-09-12T00:20:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:09.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94681561269792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x561cc4d28bd0 2024-09-12T00:20:09.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94681561269792] v33'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.253+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94681561247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x7f0da8021020 2024-09-12T00:20:09.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94681561247520] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0dbb0ac9c0 20 remove_watcher() i=0 2024-09-12T00:20:09.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0dbb0ac9c0 2 removed watcher, disabling cache 2024-09-12T00:20:09.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94681561253888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x561cc4d28bd0 2024-09-12T00:20:09.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94681561253888] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0dbb0ac9c0 20 remove_watcher() i=1 2024-09-12T00:20:09.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.257+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94681561255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x561cc4d2d5a0 2024-09-12T00:20:09.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0db93b3640 1 -- 172.21.15.66:0/39572829 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94681561255216] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da8028070 con 0x561cc4d2d5a0 2024-09-12T00:20:09.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0dbb0ac9c0 20 remove_watcher() i=2 2024-09-12T00:20:09.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94681561259280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x7f0da8021020 2024-09-12T00:20:09.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0db8bb2640 1 -- 172.21.15.66:0/39572829 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94681561259280] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0db00ef070 con 0x7f0da8021020 2024-09-12T00:20:09.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0dbb0ac9c0 20 remove_watcher() i=3 2024-09-12T00:20:09.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94681561261616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x561cc4d28bd0 2024-09-12T00:20:09.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94681561261616] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x561cc4d28bd0 2024-09-12T00:20:09.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.261+0000 7f0dbb0ac9c0 20 remove_watcher() i=4 2024-09-12T00:20:09.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94681561256336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x7f0db00b5470 2024-09-12T00:20:09.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94681561256336] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0dbb0ac9c0 20 remove_watcher() i=5 2024-09-12T00:20:09.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94681561264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x7f0db00b5470 2024-09-12T00:20:09.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94681561264816] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0dbb0ac9c0 20 remove_watcher() i=6 2024-09-12T00:20:09.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.265+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94681561267200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561cc4d3b660 con 0x7f0db00b5470 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94681561267200] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dac039040 con 0x7f0db00b5470 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 20 remove_watcher() i=7 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0db00b5470 msgr2=0x7f0db00c9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f0db00b5470 0x7f0db00c9760 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4d28bd0 msgr2=0x561cc4d2b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4d28bd0 0x561cc4d2b060 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0da8021020 msgr2=0x7f0da80203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0da8021020 0x7f0da80203b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4d2d5a0 msgr2=0x561cc4d2f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4d2d5a0 0x561cc4d2f990 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c84039a70 msgr2=0x7f0c8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c84039a70 0x7f0c8403bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0db00a9fc0 tx=0x7f0db00d9000 comp rx=0 tx=0).stop 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 msgr2=0x561cc4d1d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/39572829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d17160 0x561cc4d1d660 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0da8016a50 tx=0x7f0da8050090 comp rx=0 tx=0).stop 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 reap_dead start 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0db83b1640 1 -- 172.21.15.66:0/39572829 reap_dead start 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 shutdown_connections 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 >> 172.21.15.66:0/39572829 conn(0x561cc4d12580 msgr2=0x561cc4d10790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 shutdown_connections 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/39572829 wait complete. 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 msgr2=0x7f0c9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 0x7f0c9003bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0db00bfaa0 tx=0x7f0db00b6420 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 msgr2=0x561cc4d09c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x561cc4cef770 tx=0x7f0da800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 shutdown_connections 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0c90039a70 0x7f0c9003bf30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/3805931340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4d09850 0x561cc4d09c70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 >> 172.21.15.66:0/3805931340 conn(0x561cc4cff200 msgr2=0x561cc4cff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 shutdown_connections 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/3805931340 wait complete. 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 msgr2=0x561cc4cf5ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 0x561cc4cf5ea0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 msgr2=0x561cc4cfaa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 0x561cc4cfaa50 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 msgr2=0x7f0ca003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 0x7f0ca003bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0dac001d80 tx=0x7f0dac0012e0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 msgr2=0x561cc4ceed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0db0018c00 tx=0x7f0db0017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 shutdown_connections 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561cc4cf8660 0x561cc4cfaa50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561cc4bfb050 0x561cc4cf5ea0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0ca0039a70 0x7f0ca003bf30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 --2- 172.21.15.66:0/2053858576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561cc4bfa730 0x561cc4ceed30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 >> 172.21.15.66:0/2053858576 conn(0x561cc4bf6640 msgr2=0x561cc4ce1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 shutdown_connections 2024-09-12T00:20:09.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:09.269+0000 7f0dbb0ac9c0 1 -- 172.21.15.66:0/2053858576 wait complete. 2024-09-12T00:20:09.284 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T00:20:09.041616Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:09.041604Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:14.297 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:20:14.298 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T00:20:14.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T00:20:14.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T00:20:14.298 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-12T00:20:14.348 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:14.349 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:14.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc60b51b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55eb11ecf7a0 0x55eb11ecfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc60b51b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb11d819c0 con 0x55eb11ed28e0 2024-09-12T00:20:14.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc60b51b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55eb11dd16d0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc609021640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55eb11ecf7a0 0x55eb11ecfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc608820640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55eb11ed28e0 0x55eb11ed4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37944/0 (socket says 172.21.15.66:37944) 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc608820640 1 -- 172.21.15.66:0/3280718173 learned_addr learned my addr 172.21.15.66:0/3280718173 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc603fff640 1 -- 172.21.15.66:0/3280718173 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373575955 0 0) 0x55eb11d819c0 con 0x55eb11ed28e0 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc603fff640 1 -- 172.21.15.66:0/3280718173 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f8001e20 con 0x55eb11ed28e0 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc609021640 1 -- 172.21.15.66:0/3280718173 >> v1:172.21.15.31:6789/0 conn(0x55eb11ed28e0 legacy=0x55eb11ed4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.345+0000 7fc609021640 1 -- 172.21.15.66:0/3280718173 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11d75ca0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc609021640 1 --2- 172.21.15.66:0/3280718173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11ecfb80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00a420 tx=0x7fc5fc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4273d2427a3de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc603fff640 1 -- 172.21.15.66:0/3280718173 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0af070 con 0x55eb11ecf7a0 2024-09-12T00:20:14.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc603fff640 1 -- 172.21.15.66:0/3280718173 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0aa530 con 0x55eb11ecf7a0 2024-09-12T00:20:14.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc603fff640 1 -- 172.21.15.66:0/3280718173 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0aa810 con 0x55eb11ecf7a0 2024-09-12T00:20:14.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3280718173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 msgr2=0x55eb11ecfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3280718173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11ecfb80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00a420 tx=0x7fc5fc01afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3280718173 shutdown_connections 2024-09-12T00:20:14.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3280718173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11ecfb80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3280718173 >> 172.21.15.66:0/3280718173 conn(0x55eb11e430b0 msgr2=0x55eb11e434c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3280718173 shutdown_connections 2024-09-12T00:20:14.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.349+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3280718173 wait complete. 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc60b51b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc60b51b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eb11dd5680 con 0x55eb11ecf7a0 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc609021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc609021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41890/0 (socket says 172.21.15.66:41890) 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc609021640 1 -- 172.21.15.66:0/3632628757 learned_addr learned my addr 172.21.15.66:0/3632628757 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc609021640 1 -- 172.21.15.66:0/3632628757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11d50da0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.365+0000 7fc609021640 1 --2- 172.21.15.66:0/3632628757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0ad040 tx=0x7fc5fc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f1e1231621a9d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f7606640 1 -- 172.21.15.66:0/3632628757 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0ba020 con 0x55eb11ecf7a0 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f7606640 1 -- 172.21.15.66:0/3632628757 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0aa950 con 0x55eb11ecf7a0 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f7606640 1 -- 172.21.15.66:0/3632628757 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0af040 con 0x55eb11ecf7a0 2024-09-12T00:20:14.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3632628757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 msgr2=0x55eb11fba940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3632628757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0ad040 tx=0x7fc5fc0033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3632628757 shutdown_connections 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3632628757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fba940 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3632628757 >> 172.21.15.66:0/3632628757 conn(0x55eb11e430b0 msgr2=0x55eb11fb65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3632628757 shutdown_connections 2024-09-12T00:20:14.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3632628757 wait complete. 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eb11d77a50 con 0x55eb11ecf7a0 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc609021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc609021640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41894/0 (socket says 172.21.15.66:41894) 2024-09-12T00:20:14.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc609021640 1 -- 172.21.15.66:0/602721788 learned_addr learned my addr 172.21.15.66:0/602721788 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc609021640 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11fc2410 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc609021640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc018c00 tx=0x7fc5fc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f5e03640 1 -- 172.21.15.66:0/602721788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0c3070 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f5e03640 1 -- 172.21.15.66:0/602721788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0bf5b0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb11fc26a0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.369+0000 7fc4f5e03640 1 -- 172.21.15.66:0/602721788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5fc0ba040 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb11fc3050 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc4f5e03640 1 -- 172.21.15.66:0/602721788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc5fc0bf8b0 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc4f5e03640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 0x7fc4f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc4f5e03640 1 -- 172.21.15.66:0/602721788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc5fc0eb000 con 0x55eb11ecf7a0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc608820640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 0x7fc4f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 0x55eb11fc9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fc9560 con 0x55eb11ed28e0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609822640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 0x55eb11fc9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc608820640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 0x7fc4f003bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001dc0 tx=0x7fc5f4001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609822640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 0x55eb11fc9020 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609822640 1 -- 172.21.15.66:0/602721788 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6040083f0 con 0x55eb11ed28e0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fc33b0 con 0x55eb11ed28e0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609822640 1 -- 172.21.15.66:0/602721788 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6040083f0 con 0x55eb11ed28e0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 0x55eb11fcdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fce330 con 0x55eb11fcb800 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609021640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 0x55eb11fcdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.373+0000 7fc609021640 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 0x55eb11fcdbf0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609021640 1 -- 172.21.15.66:0/602721788 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5fc0ce070 con 0x55eb11fcb800 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fca670 con 0x55eb11ed28e0 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 -- 172.21.15.66:0/602721788 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6040083f0 con 0x55eb11ed28e0 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fcaae0 con 0x55eb11fcb800 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609021640 1 -- 172.21.15.66:0/602721788 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5fc0ce070 con 0x55eb11fcb800 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eb11de2450 con 0x55eb11fdca20 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41898/0 (socket says 172.21.15.66:41898) 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 -- 172.21.15.66:0/509451856 learned_addr learned my addr 172.21.15.66:0/509451856 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 -- 172.21.15.66:0/509451856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11fdd480 con 0x55eb11fdca20 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc609822640 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55eb11fc3240 tx=0x7fc60400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc4eeffd640 1 -- 172.21.15.66:0/509451856 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc60401c020 con 0x55eb11fdca20 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb11fddce0 con 0x55eb11fdca20 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc4eeffd640 1 -- 172.21.15.66:0/509451856 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604007d00 con 0x55eb11fdca20 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc4eeffd640 1 -- 172.21.15.66:0/509451856 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc604018440 con 0x55eb11fdca20 2024-09-12T00:20:14.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.377+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb11fde250 con 0x55eb11fdca20 2024-09-12T00:20:14.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4eeffd640 1 -- 172.21.15.66:0/509451856 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc60401f020 con 0x55eb11fdca20 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4eeffd640 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 0x7fc4e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4eeffd640 1 -- 172.21.15.66:0/509451856 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc604051e50 con 0x55eb11fdca20 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609021640 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 0x7fc4e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609021640 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 0x7fc4e003bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55eb11fc3750 tx=0x7fc5fc0b49a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eb11fbb0b0 con 0x55eb11fea2f0 2024-09-12T00:20:14.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41904/0 (socket says 172.21.15.66:41904) 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609822640 1 -- 172.21.15.66:0/2614052743 learned_addr learned my addr 172.21.15.66:0/2614052743 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609822640 1 -- 172.21.15.66:0/2614052743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11feace0 con 0x55eb11fea2f0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc609822640 1 --2- 172.21.15.66:0/2614052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc6040501a0 tx=0x7fc604043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f60017972825ded server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4ecff9640 1 -- 172.21.15.66:0/2614052743 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc604016e00 con 0x55eb11fea2f0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4ecff9640 1 -- 172.21.15.66:0/2614052743 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604021400 con 0x55eb11fea2f0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc4ecff9640 1 -- 172.21.15.66:0/2614052743 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc604018b50 con 0x55eb11fea2f0 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/2614052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 msgr2=0x55eb11fea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/2614052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc6040501a0 tx=0x7fc604043110 comp rx=0 tx=0).stop 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/2614052743 shutdown_connections 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/2614052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11fea6f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/2614052743 >> 172.21.15.66:0/2614052743 conn(0x55eb11fe5710 msgr2=0x55eb11fe3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/2614052743 shutdown_connections 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.381+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/2614052743 wait complete. 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 Processor -- start 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 -- start start 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11ff0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55eb11fe9240 con 0x55eb11fea2f0 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11ff0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609822640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11ff0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41920/0 (socket says 172.21.15.66:41920) 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 learned_addr learned my addr 172.21.15.66:0/3860460162 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb11ff0cf0 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609822640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11ff0790 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc60404f040 tx=0x7fc604050100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 -- 172.21.15.66:0/3860460162 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc604016e00 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 -- 172.21.15.66:0/3860460162 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604028300 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb11ff0f80 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 -- 172.21.15.66:0/3860460162 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6040285e0 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb11ff1930 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 -- 172.21.15.66:0/3860460162 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc604016040 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4d4039a70 0x7fc4d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc4deffd640 1 -- 172.21.15.66:0/3860460162 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc604032070 con 0x55eb11fea2f0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609021640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4d4039a70 0x7fc4d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ffbc90 0x55eb11ffe150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11ffe8a0 con 0x55eb11ffbc90 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc609021640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4d4039a70 0x7fc4d403bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a9790 tx=0x7fc5fc0d9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.385+0000 7fc608820640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ffbc90 0x55eb11ffe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ffbc90 0x55eb11ffe150 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5f400e550 con 0x55eb11ffbc90 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 realm 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11ffafe0 con 0x55eb11ffbc90 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5f400e550 con 0x55eb11ffbc90 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fff3a0 con 0x55eb11ffbc90 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5f400e550 con 0x55eb11ffbc90 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb11fffc70 con 0x55eb11ffbc90 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5f400e550 con 0x55eb11ffbc90 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb12000690 0x55eb12002a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb120031c0 con 0x55eb12000690 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb12000690 0x55eb12002a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb12000690 0x55eb12002a80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 20 searching for the correct realm 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc604021020 0x7fc60402aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609021640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc604021020 0x7fc60402aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609021640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc604021020 0x7fc60402aaa0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609021640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc5fc0e9460 0x7fc5fc0e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.389+0000 7fc608820640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc5fc0e9460 0x7fc5fc0e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc5fc0e9460 0x7fc5fc0e9880 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f400e550 con 0x7fc5fc0e9460 2024-09-12T00:20:14.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f400e550 con 0x55eb11ffbc90 2024-09-12T00:20:14.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.393+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.397+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x55eb11ffbc90 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb12000690 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.401+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc5fc0e9460 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5f4029040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x55eb11ffbc90 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004a90 con 0x7fc604021020 2024-09-12T00:20:14.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12003b10 con 0x55eb11ffbc90 2024-09-12T00:20:14.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004360 con 0x55eb11ffbc90 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12004ec0 con 0x55eb12000690 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 zone default found 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 4 Realm: () 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 zonegroup default 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12005260 con 0x7fc5fc0e9460 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12007100 con 0x55eb12000690 2024-09-12T00:20:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb120074a0 con 0x55eb12000690 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 started sync module instance, tier type = 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.405+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12006540 con 0x7fc604021020 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94468107690128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12007890 con 0x7fc604021020 2024-09-12T00:20:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb120080e0 con 0x55eb11ffbc90 2024-09-12T00:20:14.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94468107690128] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94468107692384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb120081e0 con 0x55eb11ffbc90 2024-09-12T00:20:14.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.409+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12008ca0 con 0x55eb12000690 2024-09-12T00:20:14.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94468107692384] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94468107700080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12008c60 con 0x55eb12000690 2024-09-12T00:20:14.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb120096b0 con 0x7fc604021020 2024-09-12T00:20:14.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94468107702784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12009ad0 con 0x7fc604021020 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200a5a0 con 0x55eb11ffbc90 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.413+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94468107700080] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94468107702784] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94468107706512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12009620 con 0x55eb11ffbc90 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200ae70 con 0x7fc5fc0e9460 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94468107706512] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94468107697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12009620 con 0x7fc5fc0e9460 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.417+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200b330 con 0x7fc5fc0e9460 2024-09-12T00:20:14.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94468107697200] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94468107709952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200b2f0 con 0x7fc5fc0e9460 2024-09-12T00:20:14.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200bd10 con 0x7fc5fc0e9460 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.421+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94468107712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200bcd0 con 0x7fc5fc0e9460 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=0 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=1 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=2 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=3 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=4 2024-09-12T00:20:14.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=5 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94468107709952] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=6 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94468107712512] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 20 add_watcher() i=7 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200a7e0 con 0x55eb11ffbc90 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94468107708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb1200c6a0 con 0x55eb11ffbc90 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.425+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94468107708384] v33'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc4bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:14.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 5 note: GC not initialized 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc4be7e4640 20 reqs_thread_entry: start 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 Filter name: none 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc42ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12032870 con 0x7fc5fc0e9460 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T00:20:14.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030f10 con 0x7fc5fc0e9460 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T00:20:14.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.429+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12031a80 con 0x7fc5fc0e9460 2024-09-12T00:20:14.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc60b51b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc60b51b9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc60b51b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94468107867488 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12036560 con 0x7fc5fc0e9460 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== watch-notify(notify (1) cookie 94468107697200 notify 141733920805 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55eb12035e60 con 0x7fc5fc0e9460 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(65 notify.5 [notify cookie 94468107867488 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc4ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94468107697200 notifier 4739 bl.length()=556 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc4ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc4ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc4ecff9640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc4cc003eb0 con 0x7fc5fc0e9460 2024-09-12T00:20:14.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== watch-notify(notify_complete (2) cookie 94468107867488 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eb12031330 con 0x7fc5fc0e9460 2024-09-12T00:20:14.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.433+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12031560 con 0x7fc5fc0e9460 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc60b51b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc60b51b9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc60b51b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94468107867488 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55eb12036990 con 0x55eb12000690 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94468107700080 notify 141733920774 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55eb11ff0f80 con 0x55eb12000690 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc4ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94468107700080 notifier 4739 bl.length()=177 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc4ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T00:20:14.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc4ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T00:20:14.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc4ecff9640 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc4cc003eb0 con 0x55eb12000690 2024-09-12T00:20:14.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 notify.2 [notify cookie 94468107867488 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== watch-notify(notify_complete (2) cookie 94468107867488 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eb11ff0cf0 con 0x55eb12000690 2024-09-12T00:20:14.443 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T00:20:14.434926Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:14.434910Z","tags":[],"group_ids":[]} 2024-09-12T00:20:14.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc4bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.437+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94468107708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x55eb11ffbc90 2024-09-12T00:20:14.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94468107708384] v33'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94468107690128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x7fc604021020 2024-09-12T00:20:14.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94468107690128] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc60b51b9c0 20 remove_watcher() i=0 2024-09-12T00:20:14.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc60b51b9c0 2 removed watcher, disabling cache 2024-09-12T00:20:14.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.441+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94468107692384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x55eb11ffbc90 2024-09-12T00:20:14.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94468107692384] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 20 remove_watcher() i=1 2024-09-12T00:20:14.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94468107700080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x55eb12000690 2024-09-12T00:20:14.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc609822640 1 -- 172.21.15.66:0/3860460162 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94468107700080] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60403c020 con 0x55eb12000690 2024-09-12T00:20:14.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 20 remove_watcher() i=2 2024-09-12T00:20:14.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94468107702784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x7fc604021020 2024-09-12T00:20:14.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc609021640 1 -- 172.21.15.66:0/3860460162 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94468107702784] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5fc0ce070 con 0x7fc604021020 2024-09-12T00:20:14.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 20 remove_watcher() i=3 2024-09-12T00:20:14.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.445+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94468107706512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x55eb11ffbc90 2024-09-12T00:20:14.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.449+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94468107706512] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x55eb11ffbc90 2024-09-12T00:20:14.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.449+0000 7fc60b51b9c0 20 remove_watcher() i=4 2024-09-12T00:20:14.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.449+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94468107697200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x7fc5fc0e9460 2024-09-12T00:20:14.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94468107697200] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc60b51b9c0 20 remove_watcher() i=5 2024-09-12T00:20:14.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94468107709952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x7fc5fc0e9460 2024-09-12T00:20:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94468107709952] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc60b51b9c0 20 remove_watcher() i=6 2024-09-12T00:20:14.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.453+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94468107712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55eb12030540 con 0x7fc5fc0e9460 2024-09-12T00:20:14.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94468107712512] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5f4039040 con 0x7fc5fc0e9460 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 20 remove_watcher() i=7 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc5fc0e9460 msgr2=0x7fc5fc0e9880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc5fc0e9460 0x7fc5fc0e9880 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ffbc90 msgr2=0x55eb11ffe150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ffbc90 0x55eb11ffe150 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc604021020 msgr2=0x7fc60402aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc604021020 0x7fc60402aaa0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb12000690 msgr2=0x55eb12002a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb12000690 0x55eb12002a80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4d4039a70 msgr2=0x7fc4d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4d4039a70 0x7fc4d403bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0a9790 tx=0x7fc5fc0d9000 comp rx=0 tx=0).stop 2024-09-12T00:20:14.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 msgr2=0x55eb11ff0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/3860460162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fea2f0 0x55eb11ff0790 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc60404f040 tx=0x7fc604050100 comp rx=0 tx=0).stop 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc608820640 1 -- 172.21.15.66:0/3860460162 reap_dead start 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 shutdown_connections 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 >> 172.21.15.66:0/3860460162 conn(0x55eb11fe5710 msgr2=0x55eb11fe3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 shutdown_connections 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/3860460162 wait complete. 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 msgr2=0x7fc4e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 0x7fc4e003bf30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55eb11fc3750 tx=0x7fc5fc0b49a0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 msgr2=0x55eb11fdce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55eb11fc3240 tx=0x7fc60400bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 shutdown_connections 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4e0039a70 0x7fc4e003bf30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/509451856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11fdca20 0x55eb11fdce40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 >> 172.21.15.66:0/509451856 conn(0x55eb11fd23d0 msgr2=0x55eb11fd27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 shutdown_connections 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/509451856 wait complete. 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 msgr2=0x55eb11fc9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 0x55eb11fc9020 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 msgr2=0x55eb11fcdbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 0x55eb11fcdbf0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 msgr2=0x7fc4f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 0x7fc4f003bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4001dc0 tx=0x7fc5f4001320 comp rx=0 tx=0).stop 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 msgr2=0x55eb11fc1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc018c00 tx=0x7fc5fc017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:14.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 shutdown_connections 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55eb11fcb800 0x55eb11fcdbf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55eb11ed28e0 0x55eb11fc9020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc4f0039a70 0x7fc4f003bf30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 --2- 172.21.15.66:0/602721788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55eb11ecf7a0 0x55eb11fc1eb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 >> 172.21.15.66:0/602721788 conn(0x55eb11e430b0 msgr2=0x55eb11fb5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 shutdown_connections 2024-09-12T00:20:14.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.457+0000 7fc60b51b9c0 1 -- 172.21.15.66:0/602721788 wait complete. 2024-09-12T00:20:14.474 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T00:20:14.434926Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:14.434910Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:14.502 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:20:14.523 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-12T00:20:14.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T00:20:14.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T00:20:14.524 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-12T00:20:14.563 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:14.564 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:14.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee8ba2b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560672828060 0x560672828440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee8ba2b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606727659c0 con 0x560672826a60 2024-09-12T00:20:14.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee8ba2b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5606727b56d0 con 0x560672828060 2024-09-12T00:20:14.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee89531640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560672828060 0x560672828440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee88d30640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560672826a60 0x560672826e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37960/0 (socket says 172.21.15.66:37960) 2024-09-12T00:20:14.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee88d30640 1 -- 172.21.15.66:0/2116391148 learned_addr learned my addr 172.21.15.66:0/2116391148 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:14.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee83fff640 1 -- 172.21.15.66:0/2116391148 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574058909 0 0) 0x5606727659c0 con 0x560672826a60 2024-09-12T00:20:14.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee83fff640 1 -- 172.21.15.66:0/2116391148 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee78001e20 con 0x560672826a60 2024-09-12T00:20:14.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee89531640 1 -- 172.21.15.66:0/2116391148 >> v1:172.21.15.31:6789/0 conn(0x560672826a60 legacy=0x560672826e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.561+0000 7fee89531640 1 -- 172.21.15.66:0/2116391148 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560672759ca0 con 0x560672828060 2024-09-12T00:20:14.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee89531640 1 --2- 172.21.15.66:0/2116391148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672828060 0x560672828440 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee7400a480 tx=0x7fee7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a44e8231ab603d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee83fff640 1 -- 172.21.15.66:0/2116391148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740b0070 con 0x560672828060 2024-09-12T00:20:14.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee83fff640 1 -- 172.21.15.66:0/2116391148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740ab540 con 0x560672828060 2024-09-12T00:20:14.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee83fff640 1 -- 172.21.15.66:0/2116391148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740ab840 con 0x560672828060 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2116391148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672828060 msgr2=0x560672828440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2116391148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672828060 0x560672828440 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fee7400a480 tx=0x7fee7401b280 comp rx=0 tx=0).stop 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2116391148 shutdown_connections 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2116391148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672828060 0x560672828440 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2116391148 >> 172.21.15.66:0/2116391148 conn(0x5606728ad040 msgr2=0x5606728af460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2116391148 shutdown_connections 2024-09-12T00:20:14.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.565+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2116391148 wait complete. 2024-09-12T00:20:14.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee8ba2b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee8ba2b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5606727b9680 con 0x560672826a60 2024-09-12T00:20:14.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee89531640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee89531640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41936/0 (socket says 172.21.15.66:41936) 2024-09-12T00:20:14.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee89531640 1 -- 172.21.15.66:0/2165609035 learned_addr learned my addr 172.21.15.66:0/2165609035 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee89531640 1 -- 172.21.15.66:0/2165609035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560672734da0 con 0x560672826a60 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fee89531640 1 --2- 172.21.15.66:0/2165609035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fee740ae040 tx=0x7fee74002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f21a31bd6323455 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.581+0000 7fed77606640 1 -- 172.21.15.66:0/2165609035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740b0040 con 0x560672826a60 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fed77606640 1 -- 172.21.15.66:0/2165609035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7400a300 con 0x560672826a60 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fed77606640 1 -- 172.21.15.66:0/2165609035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740ab840 con 0x560672826a60 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2165609035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 msgr2=0x56067299eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2165609035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fee740ae040 tx=0x7fee74002fc0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2165609035 shutdown_connections 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2165609035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x56067299eb10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2165609035 >> 172.21.15.66:0/2165609035 conn(0x5606728ad040 msgr2=0x56067299a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2165609035 shutdown_connections 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2165609035 wait complete. 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56067275ba50 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee89531640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee89531640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41950/0 (socket says 172.21.15.66:41950) 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee89531640 1 -- 172.21.15.66:0/3077435039 learned_addr learned my addr 172.21.15.66:0/3077435039 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee89531640 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606729a6570 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee89531640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fee740ab510 tx=0x5606728279a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fed75e03640 1 -- 172.21.15.66:0/3077435039 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740c4020 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606729a6800 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fed75e03640 1 -- 172.21.15.66:0/3077435039 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740b6470 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fed75e03640 1 -- 172.21.15.66:0/3077435039 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee740b0040 con 0x560672826a60 2024-09-12T00:20:14.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.585+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606729a7160 con 0x560672826a60 2024-09-12T00:20:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fed75e03640 1 -- 172.21.15.66:0/3077435039 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee740c7020 con 0x560672826a60 2024-09-12T00:20:14.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fed75e03640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 0x7fed7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fed75e03640 1 -- 172.21.15.66:0/3077435039 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee740bb070 con 0x560672826a60 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee88d30640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 0x7fed7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 0x5606729ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729ad670 con 0x560672828060 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89d32640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 0x5606729ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee88d30640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 0x7fed7003bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee84006f80 tx=0x7fee84006570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89d32640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 0x5606729ad130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89d32640 1 -- 172.21.15.66:0/3077435039 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee7c0083f0 con 0x560672828060 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729ada90 con 0x560672828060 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89d32640 1 -- 172.21.15.66:0/3077435039 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee7c0083f0 con 0x560672828060 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 0x5606729b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729b2330 con 0x5606729af8a0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89531640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 0x5606729b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89531640 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 0x5606729b1c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89531640 1 -- 172.21.15.66:0/3077435039 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee740b3040 con 0x5606729af8a0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729ae6e0 con 0x560672828060 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee89d32640 1 -- 172.21.15.66:0/3077435039 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee7c0083f0 con 0x560672828060 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.589+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729aec10 con 0x5606729af8a0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89531640 1 -- 172.21.15.66:0/3077435039 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee740b3040 con 0x5606729af8a0 2024-09-12T00:20:14.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5606727c6450 con 0x5606729c0aa0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41954/0 (socket says 172.21.15.66:41954) 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89d32640 1 -- 172.21.15.66:0/1908345010 learned_addr learned my addr 172.21.15.66:0/1908345010 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89d32640 1 -- 172.21.15.66:0/1908345010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606729c1500 con 0x5606729c0aa0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee89d32640 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5606729a6ff0 tx=0x7fee7c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fed6effd640 1 -- 172.21.15.66:0/1908345010 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c01c020 con 0x5606729c0aa0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fed6effd640 1 -- 172.21.15.66:0/1908345010 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c007d00 con 0x5606729c0aa0 2024-09-12T00:20:14.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606729c1d60 con 0x5606729c0aa0 2024-09-12T00:20:14.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fed6effd640 1 -- 172.21.15.66:0/1908345010 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c018440 con 0x5606729c0aa0 2024-09-12T00:20:14.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.593+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606729c22d0 con 0x5606729c0aa0 2024-09-12T00:20:14.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6effd640 1 -- 172.21.15.66:0/1908345010 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee7c01f020 con 0x5606729c0aa0 2024-09-12T00:20:14.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6effd640 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 0x7fed6003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6effd640 1 -- 172.21.15.66:0/1908345010 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee7c051da0 con 0x5606729c0aa0 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89531640 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 0x7fed6003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89531640 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 0x7fed6003bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee740b4510 tx=0x7fee740c0800 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56067299f280 con 0x5606729ce490 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41966/0 (socket says 172.21.15.66:41966) 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89d32640 1 -- 172.21.15.66:0/1254733223 learned_addr learned my addr 172.21.15.66:0/1254733223 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89d32640 1 -- 172.21.15.66:0/1254733223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606729cee60 con 0x5606729ce490 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee89d32640 1 --2- 172.21.15.66:0/1254733223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee7c021fd0 tx=0x7fee7c0168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d073cfa104bccdd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6cff9640 1 -- 172.21.15.66:0/1254733223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c021400 con 0x5606729ce490 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6cff9640 1 -- 172.21.15.66:0/1254733223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c029350 con 0x5606729ce490 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fed6cff9640 1 -- 172.21.15.66:0/1254733223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c0215a0 con 0x5606729ce490 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1254733223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 msgr2=0x5606729ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1254733223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee7c021fd0 tx=0x7fee7c0168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1254733223 shutdown_connections 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1254733223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729ce870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1254733223 >> 172.21.15.66:0/1254733223 conn(0x5606729c9850 msgr2=0x5606729c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1254733223 shutdown_connections 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1254733223 wait complete. 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 Processor -- start 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- start start 2024-09-12T00:20:14.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729d4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.597+0000 7fee8ba2b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5606729cd380 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729d4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89d32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729d4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41968/0 (socket says 172.21.15.66:41968) 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 learned_addr learned my addr 172.21.15.66:0/2388156713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606729d4e90 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89d32640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729d4930 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fee7c021fd0 tx=0x7fee7c04ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 -- 172.21.15.66:0/2388156713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c039070 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 -- 172.21.15.66:0/2388156713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c029c70 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606729d5120 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 -- 172.21.15.66:0/2388156713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee7c028300 con 0x5606729ce490 2024-09-12T00:20:14.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606729d5ad0 con 0x5606729ce490 2024-09-12T00:20:14.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 -- 172.21.15.66:0/2388156713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee7c03c070 con 0x5606729ce490 2024-09-12T00:20:14.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed54039a70 0x7fed5403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fed5effd640 1 -- 172.21.15.66:0/2388156713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee7c031070 con 0x5606729ce490 2024-09-12T00:20:14.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89531640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed54039a70 0x7fed5403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5606729dff30 0x5606729e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e2b40 con 0x5606729dff30 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee88d30640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5606729dff30 0x5606729e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.601+0000 7fee89531640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed54039a70 0x7fed5403bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee7401b0b0 tx=0x7fee740d9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5606729dff30 0x5606729e23f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 realm 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729df280 con 0x5606729dff30 2024-09-12T00:20:14.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e3640 con 0x5606729dff30 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e3f10 con 0x5606729dff30 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729e4930 0x5606729e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e7460 con 0x5606729e4930 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729e4930 0x5606729e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729e4930 0x5606729e6d20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 20 searching for the correct realm 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729e4930 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee7c021020 0x7fee7c02aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee7c021020 2024-09-12T00:20:14.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89531640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee7c021020 0x7fee7c02aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89531640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee7c021020 0x7fee7c02aa30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89531640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee740ef070 0x7fee740bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee740ef070 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.605+0000 7fee88d30640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee740ef070 0x7fee740bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee740ef070 0x7fee740bf3d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee740ef070 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee7c021020 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729e4930 2024-09-12T00:20:14.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729dff30 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee7c021020 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.609+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729dff30 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee7c021020 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729e4930 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x5606729e4930 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8cc0 con 0x7fee740ef070 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729e4930 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee7c069040 con 0x5606729e4930 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee7c069040 con 0x5606729dff30 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee7c069040 con 0x5606729dff30 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee7c069040 con 0x7fee740ef070 2024-09-12T00:20:14.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729e4930 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.613+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee7c021020 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729dff30 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee740ef070 2024-09-12T00:20:14.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729e4930 2024-09-12T00:20:14.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee740ef070 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee7c021020 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729e4930 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee740ef070 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.617+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x5606729dff30 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee8402e040 con 0x7fee7c021020 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:14.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e7db0 con 0x5606729dff30 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8600 con 0x5606729dff30 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e8600 con 0x5606729e4930 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:14.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 zone default found 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 4 Realm: () 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 zonegroup default 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729e90f0 con 0x7fee740ef070 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729eaf90 con 0x5606729e4930 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729eaf90 con 0x5606729e4930 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 started sync module instance, tier type = 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.621+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ea470 con 0x7fee7c021020 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585692792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729eb3a0 con 0x7fee7c021020 2024-09-12T00:20:14.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ebbf0 con 0x5606729dff30 2024-09-12T00:20:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585692792928] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585692796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ec010 con 0x5606729dff30 2024-09-12T00:20:14.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.625+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ec860 con 0x5606729e4930 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585692799264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ecbb0 con 0x5606729e4930 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585692796736] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ed170 con 0x7fee7c021020 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585692797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729eda10 con 0x7fee7c021020 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ee410 con 0x5606729dff30 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585692799264] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.629+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585692797792] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585692800512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ed560 con 0x5606729dff30 2024-09-12T00:20:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729eecb0 con 0x7fee740ef070 2024-09-12T00:20:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585692800512] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585692806944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ed560 con 0x7fee740ef070 2024-09-12T00:20:14.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.633+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ef1e0 con 0x7fee740ef070 2024-09-12T00:20:14.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.637+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585692806944] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.637+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.637+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585692810448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729ef1a0 con 0x7fee740ef070 2024-09-12T00:20:14.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.637+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729efbe0 con 0x7fee740ef070 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585692810448] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585692812976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729efba0 con 0x7fee740ef070 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=0 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=1 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=2 2024-09-12T00:20:14.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=3 2024-09-12T00:20:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=4 2024-09-12T00:20:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=5 2024-09-12T00:20:14.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=6 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585692812976] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 20 add_watcher() i=7 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5606729f2fd0 con 0x5606729dff30 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.641+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585692808752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5606729f04f0 con 0x5606729dff30 2024-09-12T00:20:14.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585692808752] v33'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fed3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 5 note: GC not initialized 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fed3e7e4640 20 reqs_thread_entry: start 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 Filter name: none 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fecaffff640 20 reqs_thread_entry: start 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560672a16640 con 0x7fee7c021020 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:14.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a1ae60 con 0x7fee740ef070 2024-09-12T00:20:14.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.645+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v33'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.651 INFO:teuthology.orchestra.run.smithi066.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-12T00:20:14.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fed3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585692808752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x5606729dff30 2024-09-12T00:20:14.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94585692808752] v33'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585692792928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x7fee7c021020 2024-09-12T00:20:14.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94585692792928] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee8ba2b9c0 20 remove_watcher() i=0 2024-09-12T00:20:14.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee8ba2b9c0 2 removed watcher, disabling cache 2024-09-12T00:20:14.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.649+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585692796736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x5606729dff30 2024-09-12T00:20:14.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94585692796736] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee8ba2b9c0 20 remove_watcher() i=1 2024-09-12T00:20:14.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585692799264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x5606729e4930 2024-09-12T00:20:14.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee89d32640 1 -- 172.21.15.66:0/2388156713 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94585692799264] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee7c03b030 con 0x5606729e4930 2024-09-12T00:20:14.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee8ba2b9c0 20 remove_watcher() i=2 2024-09-12T00:20:14.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.653+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585692797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x7fee7c021020 2024-09-12T00:20:14.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee89531640 1 -- 172.21.15.66:0/2388156713 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94585692797792] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee740b3040 con 0x7fee7c021020 2024-09-12T00:20:14.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee8ba2b9c0 20 remove_watcher() i=3 2024-09-12T00:20:14.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585692800512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x5606729dff30 2024-09-12T00:20:14.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94585692800512] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x5606729dff30 2024-09-12T00:20:14.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee8ba2b9c0 20 remove_watcher() i=4 2024-09-12T00:20:14.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.657+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585692806944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x7fee740ef070 2024-09-12T00:20:14.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94585692806944] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee8ba2b9c0 20 remove_watcher() i=5 2024-09-12T00:20:14.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585692810448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x7fee740ef070 2024-09-12T00:20:14.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94585692810448] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee8ba2b9c0 20 remove_watcher() i=6 2024-09-12T00:20:14.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.661+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585692812976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560672a143c0 con 0x7fee740ef070 2024-09-12T00:20:14.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94585692812976] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee8400f070 con 0x7fee740ef070 2024-09-12T00:20:14.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 20 remove_watcher() i=7 2024-09-12T00:20:14.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee740ef070 msgr2=0x7fee740bf3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee740ef070 0x7fee740bf3d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5606729dff30 msgr2=0x5606729e23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5606729dff30 0x5606729e23f0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee7c021020 msgr2=0x7fee7c02aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee7c021020 0x7fee7c02aa30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729e4930 msgr2=0x5606729e6d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729e4930 0x5606729e6d20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed54039a70 msgr2=0x7fed5403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed54039a70 0x7fed5403bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fee7401b0b0 tx=0x7fee740d9000 comp rx=0 tx=0).stop 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 msgr2=0x5606729d4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/2388156713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729ce490 0x5606729d4930 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fee7c021fd0 tx=0x7fee7c04ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 reap_dead start 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee88d30640 1 -- 172.21.15.66:0/2388156713 reap_dead start 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 shutdown_connections 2024-09-12T00:20:14.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 >> 172.21.15.66:0/2388156713 conn(0x5606729c9850 msgr2=0x5606729c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 shutdown_connections 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/2388156713 wait complete. 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 msgr2=0x7fed6003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 0x7fed6003bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee740b4510 tx=0x7fee740c0800 comp rx=0 tx=0).stop 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 msgr2=0x5606729c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x5606729a6ff0 tx=0x7fee7c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 shutdown_connections 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed60039ac0 0x7fed6003bf80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/1908345010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606729c0aa0 0x5606729c0ec0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 >> 172.21.15.66:0/1908345010 conn(0x5606729b6450 msgr2=0x5606729b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 shutdown_connections 2024-09-12T00:20:14.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/1908345010 wait complete. 2024-09-12T00:20:14.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 msgr2=0x5606729ad130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 0x5606729ad130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 msgr2=0x5606729b1c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 0x5606729b1c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 msgr2=0x7fed7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 0x7fed7003bf30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee84006f80 tx=0x7fee84006570 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 msgr2=0x5606729a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fee740ab510 tx=0x5606728279a0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 shutdown_connections 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5606729af8a0 0x5606729b1c90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560672828060 0x5606729ad130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed70039a70 0x7fed7003bf30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 --2- 172.21.15.66:0/3077435039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560672826a60 0x5606729a6010 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 >> 172.21.15.66:0/3077435039 conn(0x5606728ad040 msgr2=0x560672999240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 shutdown_connections 2024-09-12T00:20:14.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.665+0000 7fee8ba2b9c0 1 -- 172.21.15.66:0/3077435039 wait complete. 2024-09-12T00:20:14.682 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T00:20:14.733 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:20:14.734 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T00:20:14.741 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T00:20:14.742 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-12T00:20:14.742 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T00:20:14.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T00:20:14.742 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-12T00:20:14.778 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:14.778 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:14.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.773+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.773+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.773+0000 7f121c1a69c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55a9459ea8c0 0x55a9459eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.773+0000 7f121c1a69c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9458989c0 con 0x55a9459e6770 2024-09-12T00:20:14.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.773+0000 7f121c1a69c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55a9458e86d0 con 0x55a9459ea8c0 2024-09-12T00:20:14.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f1219cac640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55a9459e6770 0x55a9459e6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37964/0 (socket says 172.21.15.66:37964) 2024-09-12T00:20:14.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f1219cac640 1 -- 172.21.15.66:0/1829681263 learned_addr learned my addr 172.21.15.66:0/1829681263 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:14.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f12194ab640 1 --2- 172.21.15.66:0/1829681263 >> v2:172.21.15.31:3300/0 conn(0x55a9459ea8c0 0x55a9459eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f1218caa640 1 -- 172.21.15.66:0/1829681263 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009646315 0 0) 0x55a9458989c0 con 0x55a9459e6770 2024-09-12T00:20:14.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f1218caa640 1 -- 172.21.15.66:0/1829681263 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1208001e20 con 0x55a9459e6770 2024-09-12T00:20:14.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f12194ab640 1 -- 172.21.15.66:0/1829681263 >> v1:172.21.15.31:6789/0 conn(0x55a9459e6770 legacy=0x55a9459e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.777+0000 7f12194ab640 1 -- 172.21.15.66:0/1829681263 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a94588cca0 con 0x55a9459ea8c0 2024-09-12T00:20:14.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f12194ab640 1 --2- 172.21.15.66:0/1829681263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459ea8c0 0x55a9459eccb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f120400a480 tx=0x7f120401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b6929011c76f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f1218caa640 1 -- 172.21.15.66:0/1829681263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12040aa570 con 0x55a9459ea8c0 2024-09-12T00:20:14.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f1218caa640 1 -- 172.21.15.66:0/1829681263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12040af070 con 0x55a9459ea8c0 2024-09-12T00:20:14.784 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f1218caa640 1 -- 172.21.15.66:0/1829681263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12040aa860 con 0x55a9459ea8c0 2024-09-12T00:20:14.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1829681263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459ea8c0 msgr2=0x55a9459eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1829681263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459ea8c0 0x55a9459eccb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f120400a480 tx=0x7f120401b310 comp rx=0 tx=0).stop 2024-09-12T00:20:14.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1829681263 shutdown_connections 2024-09-12T00:20:14.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1829681263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459ea8c0 0x55a9459eccb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1829681263 >> 172.21.15.66:0/1829681263 conn(0x55a94595a080 msgr2=0x55a94595a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1829681263 shutdown_connections 2024-09-12T00:20:14.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.781+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1829681263 wait complete. 2024-09-12T00:20:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f121c1a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f121c1a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a9458ec680 con 0x55a9459e6770 2024-09-12T00:20:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1219cac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1219cac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41982/0 (socket says 172.21.15.66:41982) 2024-09-12T00:20:14.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1219cac640 1 -- 172.21.15.66:0/3671549350 learned_addr learned my addr 172.21.15.66:0/3671549350 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1219cac640 1 -- 172.21.15.66:0/3671549350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a945867da0 con 0x55a9459e6770 2024-09-12T00:20:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1219cac640 1 --2- 172.21.15.66:0/3671549350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f12140016a0 tx=0x7f1214001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35632241a930257e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1107e07640 1 -- 172.21.15.66:0/3671549350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1214004530 con 0x55a9459e6770 2024-09-12T00:20:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1107e07640 1 -- 172.21.15.66:0/3671549350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12140046d0 con 0x55a9459e6770 2024-09-12T00:20:14.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.797+0000 7f1107e07640 1 -- 172.21.15.66:0/3671549350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12140049f0 con 0x55a9459e6770 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3671549350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 msgr2=0x55a945ad1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3671549350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f12140016a0 tx=0x7f1214001b60 comp rx=0 tx=0).stop 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3671549350 shutdown_connections 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3671549350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad1940 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3671549350 >> 172.21.15.66:0/3671549350 conn(0x55a94595a080 msgr2=0x55a945acd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3671549350 shutdown_connections 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3671549350 wait complete. 2024-09-12T00:20:14.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a94588ea50 con 0x55a9459e6770 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1219cac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1219cac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41986/0 (socket says 172.21.15.66:41986) 2024-09-12T00:20:14.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1219cac640 1 -- 172.21.15.66:0/2732624769 learned_addr learned my addr 172.21.15.66:0/2732624769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1219cac640 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a945ad9520 con 0x55a9459e6770 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1219cac640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1214001ba0 tx=0x7f1214004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1106604640 1 -- 172.21.15.66:0/2732624769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1214013760 con 0x55a9459e6770 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a945ad97b0 con 0x55a9459e6770 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1106604640 1 -- 172.21.15.66:0/2732624769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1214013900 con 0x55a9459e6770 2024-09-12T00:20:14.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f1106604640 1 -- 172.21.15.66:0/2732624769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1214013c00 con 0x55a9459e6770 2024-09-12T00:20:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.801+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a945ada160 con 0x55a9459e6770 2024-09-12T00:20:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1106604640 1 -- 172.21.15.66:0/2732624769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1214010070 con 0x55a9459e6770 2024-09-12T00:20:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1106604640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 0x7f110003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1106604640 1 -- 172.21.15.66:0/2732624769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1214018070 con 0x55a9459e6770 2024-09-12T00:20:14.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f12194ab640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 0x7f110003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 0x55a945ae0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945ae0a50 con 0x55a945ade120 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121a4ad640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 0x55a945ae0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121a4ad640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 0x55a945ae0510 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f12194ab640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 0x7f110003bf30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12040ae000 tx=0x7f12040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121a4ad640 1 -- 172.21.15.66:0/2732624769 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f120c0083f0 con 0x55a945ade120 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945ada4d0 con 0x55a945ade120 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121a4ad640 1 -- 172.21.15.66:0/2732624769 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f120c0083f0 con 0x55a945ade120 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 0x55a945ae5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945ae5820 con 0x55a945ae2d40 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1219cac640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 0x55a945ae5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1219cac640 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 0x55a945ae5130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f1219cac640 1 -- 172.21.15.66:0/2732624769 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f121401b030 con 0x55a945ae2d40 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945ae1be0 con 0x55a945ade120 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121a4ad640 1 -- 172.21.15.66:0/2732624769 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f120c0083f0 con 0x55a945ade120 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.805+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945ae20c0 con 0x55a945ae2d40 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f1219cac640 1 -- 172.21.15.66:0/2732624769 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f121401b030 con 0x55a945ae2d40 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a9458f9450 con 0x55a945af3f70 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:41992/0 (socket says 172.21.15.66:41992) 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121a4ad640 1 -- 172.21.15.66:0/1517658266 learned_addr learned my addr 172.21.15.66:0/1517658266 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121a4ad640 1 -- 172.21.15.66:0/1517658266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a945af49d0 con 0x55a945af3f70 2024-09-12T00:20:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121a4ad640 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x55a945ada350 tx=0x7f120c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f10ff7fe640 1 -- 172.21.15.66:0/1517658266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c01c020 con 0x55a945af3f70 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f10ff7fe640 1 -- 172.21.15.66:0/1517658266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c007d20 con 0x55a945af3f70 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f10ff7fe640 1 -- 172.21.15.66:0/1517658266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c018440 con 0x55a945af3f70 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a945af5230 con 0x55a945af3f70 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a945af57a0 con 0x55a945af3f70 2024-09-12T00:20:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.809+0000 7f10ff7fe640 1 -- 172.21.15.66:0/1517658266 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f120c01f020 con 0x55a945af3f70 2024-09-12T00:20:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f10ff7fe640 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 0x7f10f403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f10ff7fe640 1 -- 172.21.15.66:0/1517658266 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f120c051d20 con 0x55a945af3f70 2024-09-12T00:20:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f1219cac640 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 0x7f10f403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f1219cac640 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 0x7f10f403bf80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a945ae0ee0 tx=0x7f121404e900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a945ad2190 con 0x55a945b01900 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42004/0 (socket says 172.21.15.66:42004) 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 -- 172.21.15.66:0/1184712615 learned_addr learned my addr 172.21.15.66:0/1184712615 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 -- 172.21.15.66:0/1184712615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a945b022f0 con 0x55a945b01900 2024-09-12T00:20:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 --2- 172.21.15.66:0/1184712615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f120c050070 tx=0x7f120c043130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a63d23b95719132 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f10fd7fa640 1 -- 172.21.15.66:0/1184712615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c021400 con 0x55a945b01900 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f10fd7fa640 1 -- 172.21.15.66:0/1184712615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c051040 con 0x55a945b01900 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f10fd7fa640 1 -- 172.21.15.66:0/1184712615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c029350 con 0x55a945b01900 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1184712615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 msgr2=0x55a945b01d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1184712615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f120c050070 tx=0x7f120c043130 comp rx=0 tx=0).stop 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1184712615 shutdown_connections 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1184712615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b01d00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1184712615 >> 172.21.15.66:0/1184712615 conn(0x55a945afcd20 msgr2=0x55a945afaf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1184712615 shutdown_connections 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1184712615 wait complete. 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 Processor -- start 2024-09-12T00:20:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- start start 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b07e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121c1a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a945b00850 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b07e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b07e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42010/0 (socket says 172.21.15.66:42010) 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.813+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 learned_addr learned my addr 172.21.15.66:0/3456465420 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a945b08370 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121a4ad640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b07e10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f120c016a50 tx=0x7f120c04ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 -- 172.21.15.66:0/3456465420 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c043030 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 -- 172.21.15.66:0/3456465420 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c051050 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 -- 172.21.15.66:0/3456465420 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c020a50 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a945b08600 con 0x55a945b01900 2024-09-12T00:20:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a945b08fb0 con 0x55a945b01900 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 -- 172.21.15.66:0/3456465420 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f120c016040 con 0x55a945b01900 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10e4039a70 0x7f10e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f10eb7fe640 1 -- 172.21.15.66:0/3456465420 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f120c031070 con 0x55a945b01900 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f1219cac640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10e4039a70 0x7f10e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945b133a0 0x55a945b15860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b15fb0 con 0x55a945b133a0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f12194ab640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945b133a0 0x55a945b15860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f1219cac640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10e4039a70 0x7f10e403bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1214010cc0 tx=0x7f1214036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f12194ab640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945b133a0 0x55a945b15860 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 20 realm 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.817+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b163e0 con 0x55a945b133a0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b16cb0 con 0x55a945b133a0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b17050 con 0x55a945b133a0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945b17db0 0x55a945b1a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1a7b0 con 0x55a945b17db0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945b17db0 0x55a945b1a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945b17db0 0x55a945b1a1a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 20 searching for the correct realm 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f120c021020 0x7f120c02b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f1219cac640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f120c021020 0x7f120c02b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f1219cac640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f120c021020 0x7f120c02b810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f1219cac640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f12140283d0 0x7f1214041400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.821+0000 7f12194ab640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f12140283d0 0x7f1214041400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f12140283d0 0x7f1214041400 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.825+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.829+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b17db0 2024-09-12T00:20:14.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.833+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f12140283d0 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x55a945b133a0 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c080 con 0x7f120c021020 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:14.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1b200 con 0x55a945b133a0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1ba50 con 0x55a945b133a0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c420 con 0x55a945b17db0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:14.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 zone default found 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 4 Realm: () 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 zonegroup default 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1c870 con 0x7f12140283d0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1eb50 con 0x55a945b17db0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1eef0 con 0x55a945b17db0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 started sync module instance, tier type = 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.837+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1df90 con 0x7f120c021020 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185507117792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1f380 con 0x7f120c021020 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1fbd0 con 0x55a945b133a0 2024-09-12T00:20:14.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185507117792] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185507120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1fc10 con 0x55a945b133a0 2024-09-12T00:20:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.841+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b20730 con 0x55a945b17db0 2024-09-12T00:20:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185507120000] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185507127808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b206f0 con 0x55a945b17db0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b21140 con 0x7f120c021020 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185507130512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b21560 con 0x7f120c021020 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.845+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b21fd0 con 0x55a945b133a0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185507127808] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185507130512] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185507134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b210b0 con 0x55a945b133a0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b22870 con 0x7f12140283d0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185507134112] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.849+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185507125024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b210b0 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b22dc0 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185507125024] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185507137680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b22d80 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.853+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b237a0 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185507137680] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185507140240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b23760 con 0x7f12140283d0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=0 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=1 2024-09-12T00:20:14.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=2 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=3 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=4 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=5 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=6 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185507140240] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040a8070 con 0x7f12140283d0 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 20 add_watcher() i=7 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.857+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b26bc0 con 0x55a945b133a0 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f12040a8070 con 0x55a945b133a0 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185507135936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b24110 con 0x55a945b133a0 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185507135936] v33'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f10cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f121c1a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f121c1a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.861+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b2f400 con 0x55a945b133a0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b2fab0 con 0x7f12140283d0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b2fef0 con 0x55a945b17db0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.865+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b2fe20 con 0x55a945b133a0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'225 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30470 con 0x7f120c021020 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'75 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b308f0 con 0x55a945b17db0 2024-09-12T00:20:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.869+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b308a0 con 0x55a945b133a0 2024-09-12T00:20:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.873+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.873+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b309d0 con 0x7f12140283d0 2024-09-12T00:20:14.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.877+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.877+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30db0 con 0x7f120c021020 2024-09-12T00:20:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.877+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.877+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30d90 con 0x55a945b17db0 2024-09-12T00:20:14.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30e20 con 0x7f120c021020 2024-09-12T00:20:14.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'76 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30e20 con 0x7f12140283d0 2024-09-12T00:20:14.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'32 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.881+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30dc0 con 0x7f120c021020 2024-09-12T00:20:14.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.885+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.885+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30dc0 con 0x7f12140283d0 2024-09-12T00:20:14.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.885+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.885+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30d30 con 0x55a945b133a0 2024-09-12T00:20:14.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.889+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'226 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.889+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b30d10 con 0x55a945b17db0 2024-09-12T00:20:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.889+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.889+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f120c021020 2024-09-12T00:20:14.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.893+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'77 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.893+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.893+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.893+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b133a0 2024-09-12T00:20:14.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.897+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.897+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b133a0 2024-09-12T00:20:14.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.897+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'227 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.897+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f120c021020 2024-09-12T00:20:14.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.901+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.905+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f12140283d0 2024-09-12T00:20:14.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.909+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.909+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.913+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.913+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f12140283d0 2024-09-12T00:20:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.913+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.913+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x55a945b17db0 2024-09-12T00:20:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.917+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'70 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.917+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f12140283d0 2024-09-12T00:20:14.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.917+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b31410 con 0x7f120c021020 2024-09-12T00:20:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f10ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:14.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:14.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 20 Filter name: none 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f103bfff640 20 reqs_thread_entry: start 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.921+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b2d650 con 0x7f120c021020 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4eda0 con 0x55a945b133a0 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv8 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 : miss 2024-09-12T00:20:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:96 8.19 8:9f82fb81:root::.bucket.meta.myfoo6%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4ec80 con 0x55a945b133a0 2024-09-12T00:20:14.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(96 .bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv9 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x17 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:97 4.11 4:8bb25da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc190 con 0x7f12140283d0 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(97 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:98 4.f 4:f172db17:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x55a945b133a0 2024-09-12T00:20:14.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(98 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.925+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 4.2e 4:77e3f693:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x55a945b17db0 2024-09-12T00:20:14.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(99 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.932 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:100 4.1 4:81ccc470:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x7f120c021020 2024-09-12T00:20:14.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(100 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 4.1 4:83c359e0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x7f120c021020 2024-09-12T00:20:14.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(101 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:102 4.32 4:4e2cf187:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc190 con 0x55a945b133a0 2024-09-12T00:20:14.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(102 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 4.2 4:42b02f6f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x55a945b133a0 2024-09-12T00:20:14.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(103 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:104 4.2 4:4201b265:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x55a945b133a0 2024-09-12T00:20:14.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(104 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:105 4.1c 4:3865b24e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x7f12140283d0 2024-09-12T00:20:14.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.929+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(105 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:106 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc1d0 con 0x7f12140283d0 2024-09-12T00:20:14.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(106 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [call out=349b] v0'0 uv7 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T00:20:14.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:107 4.0 4:037b56bf:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcc190 con 0x55a945b17db0 2024-09-12T00:20:14.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(107 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 20 get_obj_state: octx=0x7f120c028820 obj=myfoo6:thirteen state=0x55a945bca658 s->prefetch_data=0 2024-09-12T00:20:14.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:108 3.1s0 3:81478651:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcb480 con 0x7f12140283d0 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(108 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 10 manifest: total_size = 8 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 20 get_obj_state: setting s->obj_tag to _izy2W4FzEsmm5fo-djBGY9hP1TEoSJ4 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 20 get_obj_state: octx=0x7f120c028820 obj=myfoo6:thirteen state=0x55a945bca658 s->prefetch_data=0 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 20 prepare_atomic_modification: state is not atomic. state=0x55a945bca658 2024-09-12T00:20:14.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 2024-09-12T00:20:14.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.933+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:109 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcb480 con 0x7f12140283d0 2024-09-12T00:20:14.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.937+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(109 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.937+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 3.1s0 3:81478651:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcb480 con 0x7f12140283d0 2024-09-12T00:20:14.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(110 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9_thirteen [call] v33'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b539d0 con 0x7f12140283d0 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:112 4.11 4:8bb25da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b539d0 con 0x7f12140283d0 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:113 4.f 4:f172db17:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b539d0 con 0x55a945b133a0 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:114 4.2e 4:77e3f693:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b5a300 con 0x55a945b17db0 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:115 4.1 4:81ccc470:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b5cbf0 con 0x7f120c021020 2024-09-12T00:20:14.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:116 4.1 4:83c359e0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b5f4e0 con 0x7f120c021020 2024-09-12T00:20:14.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:117 4.32 4:4e2cf187:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b5cbf0 con 0x55a945b133a0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(113 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:118 4.2 4:42b02f6f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bca490 con 0x55a945b133a0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(114 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:119 4.2 4:4201b265:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57a50 con 0x55a945b133a0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:120 4.1c 4:3865b24e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bca490 con 0x7f12140283d0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(115 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:121 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bca490 con 0x7f12140283d0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 4.0 4:037b56bf:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b17db0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(112 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(116 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.941+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(117 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(120 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(122 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(118 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(119 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(111 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f10fd7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(121 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:20:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:123 4.11 4:8bb25da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f12140283d0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:124 4.f 4:f172db17:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945bca920 con 0x55a945b133a0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:125 4.2e 4:77e3f693:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b17db0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:126 4.1 4:81ccc470:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b56770 con 0x7f120c021020 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:127 4.1 4:83c359e0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f120c021020 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:128 4.32 4:4e2cf187:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57040 con 0x55a945b133a0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:129 4.2 4:42b02f6f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b133a0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:130 4.2 4:4201b265:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b56770 con 0x55a945b133a0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:131 4.1c 4:3865b24e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f12140283d0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:132 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57040 con 0x7f12140283d0 2024-09-12T00:20:14.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:133 4.0 4:037b56bf:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b17db0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(126 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(123 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(127 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(131 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(125 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(133 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(132 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(124 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(128 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(129 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(130 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.945+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b133a0 2024-09-12T00:20:14.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(134 bud.buckets [call] v33'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-12T00:20:14.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b133a0 2024-09-12T00:20:14.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b57490 con 0x55a945b133a0 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v33'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94185507420912 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b53520 con 0x7f120c021020 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== watch-notify(notify (1) cookie 94185507130512 notify 141733920785 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55a945b304c0 con 0x7f120c021020 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f10fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94185507130512 notifier 4753 bl.length()=150 2024-09-12T00:20:14.959 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(137 notify.3 [notify cookie 94185507420912 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.949+0000 7f10fcff9640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1044003330 con 0x7f120c021020 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== watch-notify(notify_complete (2) cookie 94185507420912 notify 141733920785 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a945ada160 con 0x7f120c021020 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:139 8.19 8:9f82fb81:root::.bucket.meta.myfoo6%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(139 .bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [call,call,delete] v33'11 uv11 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 from cache 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9, ofs0, ns] 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94185507318768 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== watch-notify(notify (1) cookie 94185507120000 notify 141733920796 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55a945b4e1f0 con 0x55a945b133a0 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f10fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 94185507120000 notifier 4753 bl.length()=207 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f10fd7fa640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f10dc003d70 con 0x55a945b133a0 2024-09-12T00:20:14.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(140 notify.1 [notify cookie 94185507318768 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== watch-notify(notify_complete (2) cookie 94185507318768 notify 141733920796 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a945b08600 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 49 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:142 4.11 4:8bb25da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f12140283d0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:143 4.f 4:f172db17:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945bca920 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:144 4.2e 4:77e3f693:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcad00 con 0x55a945b17db0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:145 4.1 4:81ccc470:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4d940 con 0x7f120c021020 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:146 4.1 4:83c359e0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b54750 con 0x7f120c021020 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:147 4.32 4:4e2cf187:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b55020 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:148 4.2 4:42b02f6f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b55970 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 4.2 4:4201b265:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b56260 con 0x55a945b133a0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:150 4.1c 4:3865b24e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b5abb0 con 0x7f12140283d0 2024-09-12T00:20:14.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:151 4.7 4:e120d5d9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f12140283d0 2024-09-12T00:20:14.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.953+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:152 4.0 4:037b56bf:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945bcad00 con 0x55a945b17db0 2024-09-12T00:20:14.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(144 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.2 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(152 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.10 [delete] v33'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(150 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.8 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(145 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.3 [delete] v33'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(151 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.9 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 50 ==== osd_op_reply(147 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.5 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 51 ==== osd_op_reply(143 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.1 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 52 ==== osd_op_reply(148 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.6 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 53 ==== osd_op_reply(149 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.7 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(146 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.4 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(142 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9.0 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 : miss 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:153 6.a 6:544d95c5:::pubsub..bucket.myfoo6%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f120c021020 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(153 pubsub..bucket.myfoo6/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:14.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 info.flags=0x0 2024-09-12T00:20:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 to cache LRU end 2024-09-12T00:20:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.957+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:154 6.a 6:544d95c5:::pubsub..bucket.myfoo6%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f120c021020 2024-09-12T00:20:14.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(154 pubsub..bucket.myfoo6/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.9 [delete] v33'43 uv37 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 54 ==== osd_op_reply(155 bud.buckets [call] v33'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f121c1a69c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-12T00:20:14.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 55 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v33'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f121c1a69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.961+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94185507420912 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4c8d0 con 0x7f12140283d0 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== watch-notify(notify (1) cookie 94185507125024 notify 141733920806 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a945b08600 con 0x7f12140283d0 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f10fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94185507125024 notifier 4753 bl.length()=170 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f10fd7fa640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f10dc003d70 con 0x7f12140283d0 2024-09-12T00:20:14.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(157 notify.5 [notify cookie 94185507420912 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== watch-notify(notify_complete (2) cookie 94185507420912 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a945b2f5d0 con 0x7f12140283d0 2024-09-12T00:20:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f121c1a69c0 10 removing email index: 2024-09-12T00:20:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f121c1a69c0 10 removing user buckets index 2024-09-12T00:20:14.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 56 ==== osd_op_reply(159 bud.buckets [delete] v33'13 uv13 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f121c1a69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-12T00:20:14.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94185507420912 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4c8d0 con 0x7f12140283d0 2024-09-12T00:20:14.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== watch-notify(notify (1) cookie 94185507137680 notify 141733920807 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a945b2f5d0 con 0x7f12140283d0 2024-09-12T00:20:14.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f10fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94185507137680 notifier 4753 bl.length()=160 2024-09-12T00:20:14.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f10fcff9640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f10440032f0 con 0x7f12140283d0 2024-09-12T00:20:14.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(160 notify.6 [notify cookie 94185507420912 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.965+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== watch-notify(notify_complete (2) cookie 94185507420912 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a945b2f3c0 con 0x7f12140283d0 2024-09-12T00:20:14.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f121c1a69c0 10 removing user index: bud 2024-09-12T00:20:14.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b562c0 con 0x7f120c021020 2024-09-12T00:20:14.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(162 bud [call,call,delete] v33'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f121c1a69c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-12T00:20:14.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f121c1a69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T00:20:14.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94185507420912 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a945b4c8d0 con 0x7f12140283d0 2024-09-12T00:20:14.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== watch-notify(notify (1) cookie 94185507125024 notify 141733920808 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55a945b2f3c0 con 0x7f12140283d0 2024-09-12T00:20:14.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f10fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94185507125024 notifier 4753 bl.length()=152 2024-09-12T00:20:14.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f10fd7fa640 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f10dc003d70 con 0x7f12140283d0 2024-09-12T00:20:14.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(163 notify.5 [notify cookie 94185507420912 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.969+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== watch-notify(notify_complete (2) cookie 94185507420912 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a945b2f7a0 con 0x7f12140283d0 2024-09-12T00:20:14.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f10cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:14.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185507135936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94185507135936] v33'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185507117792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f120c021020 2024-09-12T00:20:14.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94185507117792] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f121c1a69c0 20 remove_watcher() i=0 2024-09-12T00:20:14.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f121c1a69c0 2 removed watcher, disabling cache 2024-09-12T00:20:14.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.973+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185507120000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x55a945b133a0 2024-09-12T00:20:14.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94185507120000] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f121c1a69c0 20 remove_watcher() i=1 2024-09-12T00:20:14.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185507127808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1e380 con 0x55a945b17db0 2024-09-12T00:20:14.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f121a4ad640 1 -- 172.21.15.66:0/3456465420 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94185507127808] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f120c05b040 con 0x55a945b17db0 2024-09-12T00:20:14.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f121c1a69c0 20 remove_watcher() i=2 2024-09-12T00:20:14.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.977+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185507130512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f120c021020 2024-09-12T00:20:14.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f1219cac640 1 -- 172.21.15.66:0/3456465420 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94185507130512] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f121401b030 con 0x7f120c021020 2024-09-12T00:20:14.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f121c1a69c0 20 remove_watcher() i=3 2024-09-12T00:20:14.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185507134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1e380 con 0x55a945b133a0 2024-09-12T00:20:14.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.1 v2:172.21.15.66:6808/1373122057 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94185507134112] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x55a945b133a0 2024-09-12T00:20:14.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f121c1a69c0 20 remove_watcher() i=4 2024-09-12T00:20:14.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.981+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185507125024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b20c90 con 0x7f12140283d0 2024-09-12T00:20:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 50 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94185507125024] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.989 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f121c1a69c0 20 remove_watcher() i=5 2024-09-12T00:20:14.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185507137680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b67af0 con 0x7f12140283d0 2024-09-12T00:20:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 51 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94185507137680] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f121c1a69c0 20 remove_watcher() i=6 2024-09-12T00:20:14.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.985+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185507140240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a945b1e380 con 0x7f12140283d0 2024-09-12T00:20:14.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 <== osd.0 v2:172.21.15.31:6800/3108862692 52 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94185507140240] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12040d5040 con 0x7f12140283d0 2024-09-12T00:20:14.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 20 remove_watcher() i=7 2024-09-12T00:20:14.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f12140283d0 msgr2=0x7f1214041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:14.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f12140283d0 0x7f1214041400 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:14.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945b133a0 msgr2=0x55a945b15860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945b133a0 0x55a945b15860 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f120c021020 msgr2=0x7f120c02b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f120c021020 0x7f120c02b810 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945b17db0 msgr2=0x55a945b1a1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945b17db0 0x55a945b1a1a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10e4039a70 msgr2=0x7f10e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10e4039a70 0x7f10e403bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1214010cc0 tx=0x7f1214036000 comp rx=0 tx=0).stop 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 msgr2=0x55a945b07e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/3456465420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945b01900 0x55a945b07e10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f120c016a50 tx=0x7f120c04ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f12194ab640 1 -- 172.21.15.66:0/3456465420 reap_dead start 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 shutdown_connections 2024-09-12T00:20:15.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 >> 172.21.15.66:0/3456465420 conn(0x55a945afcd20 msgr2=0x55a945afaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 shutdown_connections 2024-09-12T00:20:15.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/3456465420 wait complete. 2024-09-12T00:20:15.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 msgr2=0x7f10f403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 0x7f10f403bf80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55a945ae0ee0 tx=0x7f121404e900 comp rx=0 tx=0).stop 2024-09-12T00:20:15.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 msgr2=0x55a945af4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x55a945ada350 tx=0x7f120c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 shutdown_connections 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f10f4039ac0 0x7f10f403bf80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/1517658266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a945af3f70 0x55a945af4390 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 >> 172.21.15.66:0/1517658266 conn(0x55a945ae9920 msgr2=0x55a945ae9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 shutdown_connections 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/1517658266 wait complete. 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 msgr2=0x55a945ae0510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 0x55a945ae0510 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 msgr2=0x55a945ae5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.989+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 0x55a945ae5130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 msgr2=0x7f110003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 0x7f110003bf30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12040ae000 tx=0x7f12040a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:15.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 msgr2=0x55a945ad8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1214001ba0 tx=0x7f1214004470 comp rx=0 tx=0).stop 2024-09-12T00:20:15.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 shutdown_connections 2024-09-12T00:20:15.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55a945ae2d40 0x55a945ae5130 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55a945ade120 0x55a945ae0510 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1100039a70 0x7f110003bf30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 --2- 172.21.15.66:0/2732624769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a9459e6770 0x55a945ad8fc0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 >> 172.21.15.66:0/2732624769 conn(0x55a94595a080 msgr2=0x55a945acbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 shutdown_connections 2024-09-12T00:20:15.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:14.993+0000 7f121c1a69c0 1 -- 172.21.15.66:0/2732624769 wait complete. 2024-09-12T00:20:15.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T00:20:15.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T00:20:15.010 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-12T00:20:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:15.093 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f76119c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56129190b670 0x56129190da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f76119c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612917bd9c0 con 0x56129187d7b0 2024-09-12T00:20:15.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f76119c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56129180d6d0 con 0x56129190b670 2024-09-12T00:20:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f4916640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56129190b670 0x56129190da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f5117640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56129187d7b0 0x561291909f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:37970/0 (socket says 172.21.15.66:37970) 2024-09-12T00:20:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f5117640 1 -- 172.21.15.66:0/3884264723 learned_addr learned my addr 172.21.15.66:0/3884264723 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f4916640 1 -- 172.21.15.66:0/3884264723 >> v1:172.21.15.31:6789/0 conn(0x56129187d7b0 legacy=0x561291909f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.089+0000 7ff6f4916640 1 -- 172.21.15.66:0/3884264723 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612917b1ca0 con 0x56129190b670 2024-09-12T00:20:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f4916640 1 --2- 172.21.15.66:0/3884264723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129190b670 0x56129190da90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00a480 tx=0x7ff6ec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1a123b94debd5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6e7fff640 1 -- 172.21.15.66:0/3884264723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ec0af070 con 0x56129190b670 2024-09-12T00:20:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6e7fff640 1 -- 172.21.15.66:0/3884264723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6ec0aa530 con 0x56129190b670 2024-09-12T00:20:15.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6e7fff640 1 -- 172.21.15.66:0/3884264723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6ec0aa830 con 0x56129190b670 2024-09-12T00:20:15.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3884264723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129190b670 msgr2=0x56129190da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3884264723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129190b670 0x56129190da90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00a480 tx=0x7ff6ec01b280 comp rx=0 tx=0).stop 2024-09-12T00:20:15.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3884264723 shutdown_connections 2024-09-12T00:20:15.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3884264723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129190b670 0x56129190da90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3884264723 >> 172.21.15.66:0/3884264723 conn(0x561291903e90 msgr2=0x5612919062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3884264723 shutdown_connections 2024-09-12T00:20:15.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.093+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3884264723 wait complete. 2024-09-12T00:20:15.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.109+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.109+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561291811680 con 0x56129187d7b0 2024-09-12T00:20:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42022/0 (socket says 172.21.15.66:42022) 2024-09-12T00:20:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 -- 172.21.15.66:0/1005825320 learned_addr learned my addr 172.21.15.66:0/1005825320 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 -- 172.21.15.66:0/1005825320 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129178cda0 con 0x56129187d7b0 2024-09-12T00:20:15.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 --2- 172.21.15.66:0/1005825320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8001810 tx=0x7ff6e8001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc941e754e69bd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff5e3606640 1 -- 172.21.15.66:0/1005825320 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8004530 con 0x56129187d7b0 2024-09-12T00:20:15.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff5e3606640 1 -- 172.21.15.66:0/1005825320 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e80046d0 con 0x56129187d7b0 2024-09-12T00:20:15.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff5e3606640 1 -- 172.21.15.66:0/1005825320 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e80049f0 con 0x56129187d7b0 2024-09-12T00:20:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1005825320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 msgr2=0x5612919fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/1005825320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8001810 tx=0x7ff6e8001cd0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1005825320 shutdown_connections 2024-09-12T00:20:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/1005825320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x5612919fb510 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1005825320 >> 172.21.15.66:0/1005825320 conn(0x561291903e90 msgr2=0x5612919f7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1005825320 shutdown_connections 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1005825320 wait complete. 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f76119c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5612917b3a50 con 0x56129187d7b0 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42038/0 (socket says 172.21.15.66:42038) 2024-09-12T00:20:15.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.113+0000 7ff6f5117640 1 -- 172.21.15.66:0/4273656966 learned_addr learned my addr 172.21.15.66:0/4273656966 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:15.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f5117640 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291a03130 con 0x56129187d7b0 2024-09-12T00:20:15.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f5117640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8000f90 tx=0x7ff6e8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 -- 172.21.15.66:0/4273656966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8013630 con 0x56129187d7b0 2024-09-12T00:20:15.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 -- 172.21.15.66:0/4273656966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e80137d0 con 0x56129187d7b0 2024-09-12T00:20:15.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 -- 172.21.15.66:0/4273656966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8013ad0 con 0x56129187d7b0 2024-09-12T00:20:15.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561291a033c0 con 0x56129187d7b0 2024-09-12T00:20:15.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561291a03d70 con 0x56129187d7b0 2024-09-12T00:20:15.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 -- 172.21.15.66:0/4273656966 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff6e8010070 con 0x56129187d7b0 2024-09-12T00:20:15.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 0x7ff5dc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff5e1e03640 1 -- 172.21.15.66:0/4273656966 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff6e8018070 con 0x56129187d7b0 2024-09-12T00:20:15.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f4916640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 0x7ff5dc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 0x561291a09d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a0a280 con 0x56129190b670 2024-09-12T00:20:15.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f5918640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 0x561291a09d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.117+0000 7ff6f4916640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 0x7ff5dc03bf80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0ac000 tx=0x7ff6ec0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 0x561291a09d40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 -- 172.21.15.66:0/4273656966 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6f00083f0 con 0x56129190b670 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a0a680 con 0x56129190b670 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 -- 172.21.15.66:0/4273656966 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6f00083f0 con 0x56129190b670 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 0x561291a0e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a0ef50 con 0x561291a0c490 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5117640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 0x561291a0e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5117640 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 0x561291a0e880 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5117640 1 -- 172.21.15.66:0/4273656966 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff6e801b030 con 0x561291a0c490 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a0b300 con 0x56129190b670 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 -- 172.21.15.66:0/4273656966 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6f00083f0 con 0x56129190b670 2024-09-12T00:20:15.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a0b7e0 con 0x561291a0c490 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5117640 1 -- 172.21.15.66:0/4273656966 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6e801b030 con 0x561291a0c490 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f76119c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56129181e450 con 0x561291a1d680 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42040/0 (socket says 172.21.15.66:42040) 2024-09-12T00:20:15.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.121+0000 7ff6f5918640 1 -- 172.21.15.66:0/2774600112 learned_addr learned my addr 172.21.15.66:0/2774600112 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:15.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 -- 172.21.15.66:0/2774600112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291a1e0e0 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x561291a03950 tx=0x7ff6f000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 -- 172.21.15.66:0/2774600112 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f001c020 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561291a1e940 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 -- 172.21.15.66:0/2774600112 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0007d00 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 -- 172.21.15.66:0/2774600112 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0018440 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561291a1eeb0 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 -- 172.21.15.66:0/2774600112 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff6f001f020 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 0x7ff5d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff5daffd640 1 -- 172.21.15.66:0/2774600112 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff6f0051ea0 con 0x561291a1d680 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5117640 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 0x7ff5d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5117640 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 0x7ff5d003bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8010ad0 tx=0x7ff6e8013cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f76119c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5612919fbd60 con 0x561291a2af50 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42050/0 (socket says 172.21.15.66:42050) 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 -- 172.21.15.66:0/1074708465 learned_addr learned my addr 172.21.15.66:0/1074708465 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.125+0000 7ff6f5918640 1 -- 172.21.15.66:0/1074708465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291a2b940 con 0x561291a2af50 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 --2- 172.21.15.66:0/1074708465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0050130 tx=0x7ff6f0050240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8e965c16292e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5d8ff9640 1 -- 172.21.15.66:0/1074708465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0021400 con 0x561291a2af50 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5d8ff9640 1 -- 172.21.15.66:0/1074708465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0018b50 con 0x561291a2af50 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5d8ff9640 1 -- 172.21.15.66:0/1074708465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00215a0 con 0x561291a2af50 2024-09-12T00:20:15.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1074708465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 msgr2=0x561291a2b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/1074708465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0050130 tx=0x7ff6f0050240 comp rx=0 tx=0).stop 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1074708465 shutdown_connections 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/1074708465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a2b350 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1074708465 >> 172.21.15.66:0/1074708465 conn(0x561291a26370 msgr2=0x561291a245b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1074708465 shutdown_connections 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/1074708465 wait complete. 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 Processor -- start 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- start start 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561291a29ea0 con 0x561291a2af50 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:42062/0 (socket says 172.21.15.66:42062) 2024-09-12T00:20:15.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 learned_addr learned my addr 172.21.15.66:0/3422768066 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561291a31930 con 0x561291a2af50 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f5918640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0050280 tx=0x7ff6f0050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5c6ffd640 1 -- 172.21.15.66:0/3422768066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0029c70 con 0x561291a2af50 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561291a31bc0 con 0x561291a2af50 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5c6ffd640 1 -- 172.21.15.66:0/3422768066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f0029e10 con 0x561291a2af50 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff5c6ffd640 1 -- 172.21.15.66:0/3422768066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0020b60 con 0x561291a2af50 2024-09-12T00:20:15.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.129+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561291a32570 con 0x561291a2af50 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff5c6ffd640 1 -- 172.21.15.66:0/3422768066 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff6f0016040 con 0x561291a2af50 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff5c6ffd640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5c0039a70 0x7ff5c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff5c6ffd640 1 -- 172.21.15.66:0/3422768066 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff6f0036d70 con 0x561291a2af50 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f5117640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5c0039a70 0x7ff5c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561291a3c9b0 0x561291a3ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a3f5c0 con 0x561291a3c9b0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561291a3c9b0 0x561291a3ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f5117640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5c0039a70 0x7ff5c003bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6e804e900 tx=0x7ff6e8035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561291a3c9b0 0x561291a3ee70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 realm 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a3f990 con 0x561291a3c9b0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a40260 con 0x561291a3c9b0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a40600 con 0x561291a3c9b0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a41360 0x561291a43750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a43d60 con 0x561291a41360 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f5918640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a41360 0x561291a43750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f5918640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a41360 0x561291a43750 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 20 searching for the correct realm 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.133+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5918640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff6f0021020 0x7ff6f0028300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5117640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff6f0021020 0x7ff6f0028300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5117640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff6f0021020 0x7ff6f0028300 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5117640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff6e8041440 0x7ff6e80419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff6e8041440 0x7ff6e80419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff6e8041440 0x7ff6e80419e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.137+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.141+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.145+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a41360 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6e8041440 2024-09-12T00:20:15.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x561291a3c9b0 2024-09-12T00:20:15.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x561291a455c0 con 0x7ff6f0021020 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:15.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a446b0 con 0x561291a3c9b0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a44f00 con 0x561291a3c9b0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a459f0 con 0x561291a41360 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 zone default found 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 4 Realm: () 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:15.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 zonegroup default 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.149+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a45d90 con 0x7ff6e8041440 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a47ba0 con 0x561291a41360 2024-09-12T00:20:15.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a48130 con 0x561291a41360 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 started sync module instance, tier type = 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:15.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a47010 con 0x7ff6f0021020 2024-09-12T00:20:15.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637752871776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a48590 con 0x7ff6f0021020 2024-09-12T00:20:15.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.153+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a48de0 con 0x561291a3c9b0 2024-09-12T00:20:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.157+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637752871776] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.157+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.157+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637752873984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a48de0 con 0x561291a3c9b0 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.157+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a498d0 con 0x561291a41360 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.157+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637752873984] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637752882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a48de0 con 0x561291a41360 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4a2e0 con 0x7ff6f0021020 2024-09-12T00:20:15.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637752884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4a250 con 0x7ff6f0021020 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4b240 con 0x561291a3c9b0 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637752882080] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637752884784] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637752886992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4b240 con 0x561291a3c9b0 2024-09-12T00:20:15.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.161+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4b690 con 0x7ff6e8041440 2024-09-12T00:20:15.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.165+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637752886992] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.165+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.165+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637752879408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4b650 con 0x7ff6e8041440 2024-09-12T00:20:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.165+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4c0a0 con 0x7ff6e8041440 2024-09-12T00:20:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637752879408] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637752888608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4c0a0 con 0x7ff6e8041440 2024-09-12T00:20:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ca60 con 0x7ff6e8041440 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637752888608] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637752892672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ca60 con 0x7ff6e8041440 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=0 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=1 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=2 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=3 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=4 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=5 2024-09-12T00:20:15.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.169+0000 7ff6f76119c0 20 add_watcher() i=6 2024-09-12T00:20:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637752892672] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f76119c0 20 add_watcher() i=7 2024-09-12T00:20:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f76119c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a4fd20 con 0x561291a3c9b0 2024-09-12T00:20:15.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.173+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637752895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4cff0 con 0x561291a3c9b0 2024-09-12T00:20:15.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637752895264] v33'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff5abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:15.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f76119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:15.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f76119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:15.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a586b0 con 0x561291a3c9b0 2024-09-12T00:20:15.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.177+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a58d20 con 0x7ff6e8041440 2024-09-12T00:20:15.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59160 con 0x561291a41360 2024-09-12T00:20:15.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59010 con 0x561291a3c9b0 2024-09-12T00:20:15.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'230 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.181+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59640 con 0x7ff6f0021020 2024-09-12T00:20:15.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.185+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'78 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.185+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59bb0 con 0x561291a41360 2024-09-12T00:20:15.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.185+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.185+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59bb0 con 0x561291a3c9b0 2024-09-12T00:20:15.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.189+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.189+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59bb0 con 0x7ff6e8041440 2024-09-12T00:20:15.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.189+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.189+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a59bb0 con 0x7ff6f0021020 2024-09-12T00:20:15.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.193+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.193+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a1c0 con 0x561291a41360 2024-09-12T00:20:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.193+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.193+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x7ff6f0021020 2024-09-12T00:20:15.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'79 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x7ff6e8041440 2024-09-12T00:20:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'33 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x7ff6f0021020 2024-09-12T00:20:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.197+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x7ff6e8041440 2024-09-12T00:20:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.201+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'67 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.201+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x561291a3c9b0 2024-09-12T00:20:15.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.201+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'231 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.201+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a010 con 0x561291a41360 2024-09-12T00:20:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'71 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a0a0 con 0x7ff6f0021020 2024-09-12T00:20:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'80 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a0a0 con 0x561291a41360 2024-09-12T00:20:15.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.205+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a0a0 con 0x561291a3c9b0 2024-09-12T00:20:15.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.209+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.209+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a0a0 con 0x561291a3c9b0 2024-09-12T00:20:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.209+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'232 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x561291a3c9b0 2024-09-12T00:20:15.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.209+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a0a0 con 0x561291a41360 2024-09-12T00:20:15.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.213+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'72 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.213+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a140 con 0x7ff6f0021020 2024-09-12T00:20:15.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.213+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.213+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a140 con 0x561291a41360 2024-09-12T00:20:15.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a140 con 0x561291a41360 2024-09-12T00:20:15.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a160 con 0x561291a41360 2024-09-12T00:20:15.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.217+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a1a0 con 0x561291a41360 2024-09-12T00:20:15.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'60 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a1d0 con 0x7ff6e8041440 2024-09-12T00:20:15.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a1d0 con 0x561291a41360 2024-09-12T00:20:15.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.221+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a210 con 0x7ff6e8041440 2024-09-12T00:20:15.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.225+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.225+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a230 con 0x561291a41360 2024-09-12T00:20:15.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.229+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'73 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.229+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a230 con 0x7ff6e8041440 2024-09-12T00:20:15.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.229+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.229+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a5a210 con 0x7ff6f0021020 2024-09-12T00:20:15.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff5aafe5640 20 reqs_thread_entry: start 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f76119c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f76119c0 20 Filter name: none 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff5a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f76119c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.233+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a568e0 con 0x7ff6e8041440 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff6ec0b2040 con 0x7ff6e8041440 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:15.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a77f10 con 0x7ff6e8041440 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 : miss 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:96 8.7 8:e0bb2b1b:root::.bucket.meta.myfoo7%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a77d40 con 0x7ff6e8041440 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(96 .bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 info.flags=0x17 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 to cache LRU end 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 4.8 4:122ca9f9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5250 con 0x561291a41360 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(97 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.237+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 4.21 4:871e1da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5250 con 0x7ff6e8041440 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(98 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 4.17 4:eacbf1a3:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5250 con 0x7ff6e8041440 2024-09-12T00:20:15.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(99 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 4.33 4:cec22f9b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5290 con 0x7ff6e8041440 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(100 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 4.e 4:7054a769:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5290 con 0x7ff6f0021020 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(101 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:102 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5290 con 0x561291a3c9b0 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(102 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [call out=381b] v0'0 uv4 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 10 cls_bucket_list_unordered: got fourteen 2024-09-12T00:20:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 4.2a 4:55a93236:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af5290 con 0x561291a3c9b0 2024-09-12T00:20:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(103 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.241+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:104 4.35 4:af6a910e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af52d0 con 0x561291a3c9b0 2024-09-12T00:20:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(104 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:105 4.4 4:2340c220:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af52d0 con 0x7ff6e8041440 2024-09-12T00:20:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(105 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 4.1f 4:fa19a4d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af52d0 con 0x561291a41360 2024-09-12T00:20:15.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(106 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:107 4.30 4:0c3fe91b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af52d0 con 0x561291a41360 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(107 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 20 get_obj_state: octx=0x7ff6f0046930 obj=myfoo7:fourteen state=0x561291af3718 s->prefetch_data=0 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:108 3.2ds0 3:b6b2ae9b:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af4540 con 0x561291a41360 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(108 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 10 manifest: total_size = 8 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.4239552225518163300 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 20 get_obj_state: octx=0x7ff6f0046930 obj=myfoo7:fourteen state=0x561291af3718 s->prefetch_data=0 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 20 prepare_atomic_modification: state is not atomic. state=0x561291af3718 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 2024-09-12T00:20:15.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.245+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:109 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af4540 con 0x561291a3c9b0 2024-09-12T00:20:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(109 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:110 3.2ds0 3:b6b2ae9b:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af4540 con 0x561291a41360 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(110 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10_fourteen [call] v33'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:111 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a7cb10 con 0x561291a3c9b0 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:112 4.8 4:122ca9f9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af4640 con 0x561291a41360 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:113 4.21 4:871e1da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af3530 con 0x7ff6e8041440 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:114 4.17 4:eacbf1a3:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a83440 con 0x7ff6e8041440 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:115 4.33 4:cec22f9b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a860c0 con 0x7ff6e8041440 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:116 4.e 4:7054a769:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a88ee0 con 0x7ff6f0021020 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:117 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8bb90 con 0x561291a3c9b0 2024-09-12T00:20:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:118 4.2a 4:55a93236:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a860c0 con 0x561291a3c9b0 2024-09-12T00:20:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:119 4.35 4:af6a910e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a909c0 con 0x561291a3c9b0 2024-09-12T00:20:15.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:120 4.4 4:2340c220:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a860c0 con 0x7ff6e8041440 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(116 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(119 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 4.1f 4:fa19a4d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8e4f0 con 0x561291a41360 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.249+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 4.30 4:0c3fe91b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a937b0 con 0x561291a41360 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(113 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(118 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(114 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(115 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(120 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(121 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(111 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff5d8ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(112 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(122 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7ff6f003b020 con 0x561291a41360 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(117 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 4.8 4:122ca9f9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af45c0 con 0x561291a41360 2024-09-12T00:20:15.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:124 4.21 4:871e1da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a85b70 con 0x7ff6e8041440 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:125 4.17 4:eacbf1a3:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8c020 con 0x7ff6e8041440 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:126 4.33 4:cec22f9b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af45c0 con 0x7ff6e8041440 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:127 4.e 4:7054a769:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8e490 con 0x7ff6f0021020 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:128 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a7cda0 con 0x561291a3c9b0 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:129 4.2a 4:55a93236:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8c020 con 0x561291a3c9b0 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:130 4.35 4:af6a910e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af45c0 con 0x561291a3c9b0 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:131 4.4 4:2340c220:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a7cda0 con 0x7ff6e8041440 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:132 4.1f 4:fa19a4d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af45c0 con 0x561291a41360 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:133 4.30 4:0c3fe91b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8e490 con 0x561291a41360 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(128 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [call out=128b] v0'0 uv6 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(127 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4 [call out=89b] v0'0 uv10 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(130 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(124 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(129 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(123 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(131 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(133 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(125 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(126 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(132 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.253+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a86130 con 0x7ff6e8041440 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(134 fud.buckets [call] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6f0021020 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-12T00:20:15.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(136 myfoo7 [call,call,delete] v33'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94637753129568 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== watch-notify(notify (1) cookie 94637752884784 notify 141733920786 ret 0) ==== 192+0+0 (crc 0 0 0) 0x561291a59620 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94637752884784 notifier 4760 bl.length()=150 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(137 notify.3 [notify cookie 94637753129568 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.257+0000 7ff5d8ff9640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff5b8003d70 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== watch-notify(notify_complete (2) cookie 94637753129568 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561291a58fb0 con 0x7ff6f0021020 2024-09-12T00:20:15.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:139 8.7 8:e0bb2b1b:root::.bucket.meta.myfoo7%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6e8041440 2024-09-12T00:20:15.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(139 .bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 [call,call,delete] v33'3 uv3 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 from cache 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10, ofs0, ns] 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94637753072816 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x561291a3c9b0 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== watch-notify(notify (1) cookie 94637752886992 notify 141733920797 ret 0) ==== 250+0+0 (crc 0 0 0) 0x561291a772a0 con 0x561291a3c9b0 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94637752886992 notifier 4760 bl.length()=208 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff5c7fff640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff51c0032d0 con 0x561291a3c9b0 2024-09-12T00:20:15.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(140 notify.4 [notify cookie 94637753072816 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== watch-notify(notify_complete (2) cookie 94637753072816 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561291a31bc0 con 0x561291a3c9b0 2024-09-12T00:20:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:142 4.8 4:122ca9f9:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x561291a41360 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:143 4.21 4:871e1da0:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a865b0 con 0x7ff6e8041440 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:144 4.17 4:eacbf1a3:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a86e40 con 0x7ff6e8041440 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:145 4.33 4:cec22f9b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a87220 con 0x7ff6e8041440 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:146 4.e 4:7054a769:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6f0021020 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:147 4.2a 4:550d69d1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a865b0 con 0x561291a3c9b0 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:148 4.2a 4:55a93236:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a87220 con 0x561291a3c9b0 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 4.35 4:af6a910e:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a86e40 con 0x561291a3c9b0 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:150 4.4 4:2340c220:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a865b0 con 0x7ff6e8041440 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:151 4.1f 4:fa19a4d6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a87220 con 0x561291a41360 2024-09-12T00:20:15.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.261+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:152 4.30 4:0c3fe91b:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a86e40 con 0x561291a41360 2024-09-12T00:20:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(142 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.0 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(143 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.1 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(147 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.5 [delete] v33'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(144 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.2 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(146 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.4 [delete] v33'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(145 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.3 [delete] v33'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(148 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.6 [delete] v33'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(152 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.10 [delete] v33'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(150 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.8 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(149 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.7 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(151 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10.9 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 : miss 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:153 6.17 6:ea870f50:::pubsub..bucket.myfoo7%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a8ba10 con 0x561291a3c9b0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== osd_op_reply(153 pubsub..bucket.myfoo7/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:15.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 info.flags=0x0 2024-09-12T00:20:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 to cache LRU end 2024-09-12T00:20:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.265+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:154 6.17 6:ea870f50:::pubsub..bucket.myfoo7%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a8ba10 con 0x561291a3c9b0 2024-09-12T00:20:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.269+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(154 pubsub..bucket.myfoo7/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.10 [delete] v33'15 uv13 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.269+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a8ba10 con 0x7ff6e8041440 2024-09-12T00:20:15.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(155 fud.buckets [call] v33'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T00:20:15.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a8ba10 con 0x7ff6e8041440 2024-09-12T00:20:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v33'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T00:20:15.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94637753154064 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a77cb0 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== watch-notify(notify (1) cookie 94637752882080 notify 141733920775 ret 0) ==== 212+0+0 (crc 0 0 0) 0x561291a57fa0 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94637752882080 notifier 4760 bl.length()=170 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff5c7fff640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff51c0032d0 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(157 notify.2 [notify cookie 94637753154064 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== watch-notify(notify_complete (2) cookie 94637753154064 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561291a31930 con 0x561291a41360 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 10 removing email index: 2024-09-12T00:20:15.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 10 removing user buckets index 2024-09-12T00:20:15.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.273+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6e8041440 2024-09-12T00:20:15.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(159 fud.buckets [delete] v33'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f76119c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T00:20:15.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94637753072816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291af38d0 con 0x7ff6e8041440 2024-09-12T00:20:15.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== watch-notify(notify (1) cookie 94637752888608 notify 141733920809 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7ff6ec0eb040 con 0x7ff6e8041440 2024-09-12T00:20:15.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94637752888608 notifier 4760 bl.length()=160 2024-09-12T00:20:15.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff5d8ff9640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff5b8003d70 con 0x7ff6e8041440 2024-09-12T00:20:15.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(160 notify.6 [notify cookie 94637753072816 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== watch-notify(notify_complete (2) cookie 94637753072816 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561291a31bc0 con 0x7ff6e8041440 2024-09-12T00:20:15.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f76119c0 10 removing user index: fud 2024-09-12T00:20:15.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.277+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a76a50 con 0x7ff6e8041440 2024-09-12T00:20:15.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 50 ==== osd_op_reply(162 fud [call,call,delete] v33'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f76119c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T00:20:15.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f76119c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T00:20:15.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94637753072816 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x561291a75a40 con 0x7ff6e8041440 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 51 ==== watch-notify(notify (1) cookie 94637752879408 notify 141733920810 ret 0) ==== 194+0+0 (crc 0 0 0) 0x561291a31bc0 con 0x7ff6e8041440 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94637752879408 notifier 4760 bl.length()=152 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 52 ==== osd_op_reply(163 notify.5 [notify cookie 94637753072816 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff5c7fff640 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff51c0032d0 con 0x7ff6e8041440 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 53 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.281+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 54 ==== watch-notify(notify_complete (2) cookie 94637753072816 notify 141733920810 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561291a58880 con 0x7ff6e8041440 2024-09-12T00:20:15.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff5abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:15.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637752895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ee20 con 0x561291a3c9b0 2024-09-12T00:20:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94637752895264] v33'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637752871776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ee20 con 0x7ff6f0021020 2024-09-12T00:20:15.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94637752871776] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f76119c0 20 remove_watcher() i=0 2024-09-12T00:20:15.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f76119c0 2 removed watcher, disabling cache 2024-09-12T00:20:15.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.285+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637752873984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a46b60 con 0x561291a3c9b0 2024-09-12T00:20:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 49 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94637752873984] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f76119c0 20 remove_watcher() i=1 2024-09-12T00:20:15.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637752882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ee20 con 0x561291a41360 2024-09-12T00:20:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f5918640 1 -- 172.21.15.66:0/3422768066 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94637752882080] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6f0079070 con 0x561291a41360 2024-09-12T00:20:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f76119c0 20 remove_watcher() i=2 2024-09-12T00:20:15.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.289+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637752884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a46b60 con 0x7ff6f0021020 2024-09-12T00:20:15.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f5117640 1 -- 172.21.15.66:0/3422768066 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94637752884784] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6e8044050 con 0x7ff6f0021020 2024-09-12T00:20:15.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f76119c0 20 remove_watcher() i=3 2024-09-12T00:20:15.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637752886992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a493a0 con 0x561291a3c9b0 2024-09-12T00:20:15.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.1 v2:172.21.15.66:6808/1373122057 50 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94637752886992] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x561291a3c9b0 2024-09-12T00:20:15.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f76119c0 20 remove_watcher() i=4 2024-09-12T00:20:15.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.293+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637752879408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a4ee20 con 0x7ff6e8041440 2024-09-12T00:20:15.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 55 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94637752879408] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f76119c0 20 remove_watcher() i=5 2024-09-12T00:20:15.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637752888608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a49e30 con 0x7ff6e8041440 2024-09-12T00:20:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 56 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94637752888608] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f76119c0 20 remove_watcher() i=6 2024-09-12T00:20:15.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.297+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637752892672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x561291a46b60 con 0x7ff6e8041440 2024-09-12T00:20:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 <== osd.0 v2:172.21.15.31:6800/3108862692 57 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94637752892672] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6ec0d60d0 con 0x7ff6e8041440 2024-09-12T00:20:15.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 20 remove_watcher() i=7 2024-09-12T00:20:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff6e8041440 msgr2=0x7ff6e80419e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff6e8041440 0x7ff6e80419e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561291a3c9b0 msgr2=0x561291a3ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x561291a3c9b0 0x561291a3ee70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff6f0021020 msgr2=0x7ff6f0028300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff6f0021020 0x7ff6f0028300 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a41360 msgr2=0x561291a43750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a41360 0x561291a43750 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5c0039a70 msgr2=0x7ff5c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5c0039a70 0x7ff5c003bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff6e804e900 tx=0x7ff6e8035000 comp rx=0 tx=0).stop 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f4916640 1 -- 172.21.15.66:0/3422768066 reap_dead start 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 msgr2=0x561291a313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0050280 tx=0x7ff6f0050090 comp rx=0 tx=0).stop 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 shutdown_connections 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/3422768066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a2af50 0x561291a313d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 >> 172.21.15.66:0/3422768066 conn(0x561291a26370 msgr2=0x561291a24580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 shutdown_connections 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/3422768066 wait complete. 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 msgr2=0x7ff5d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 0x7ff5d003bf30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8010ad0 tx=0x7ff6e8013cf0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 msgr2=0x561291a1daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x561291a03950 tx=0x7ff6f000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 shutdown_connections 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5d0039a70 0x7ff5d003bf30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/2774600112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561291a1d680 0x561291a1daa0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 >> 172.21.15.66:0/2774600112 conn(0x561291a13030 msgr2=0x561291a13410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 shutdown_connections 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/2774600112 wait complete. 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 msgr2=0x561291a09d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 0x561291a09d40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 msgr2=0x561291a0e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 0x561291a0e880 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 msgr2=0x7ff5dc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.301+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 0x7ff5dc03bf80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0ac000 tx=0x7ff6ec0a5000 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 msgr2=0x561291a02bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8000f90 tx=0x7ff6e8001260 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 shutdown_connections 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x561291a0c490 0x561291a0e880 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56129190b670 0x561291a09d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff5dc039ac0 0x7ff5dc03bf80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 --2- 172.21.15.66:0/4273656966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56129187d7b0 0x561291a02bd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 >> 172.21.15.66:0/4273656966 conn(0x561291903e90 msgr2=0x5612919f5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:15.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 shutdown_connections 2024-09-12T00:20:15.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:15.305+0000 7ff6f76119c0 1 -- 172.21.15.66:0/4273656966 wait complete. 2024-09-12T00:20:55.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-12T00:20:55.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-12T00:20:55.324 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-12T00:20:55.366 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:55.366 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:55.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.360+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.360+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409dafd9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56459399c370 0x56459399c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409dafd9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645938519c0 con 0x56459399f550 2024-09-12T00:20:55.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409dafd9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5645938a16d0 con 0x56459399c370 2024-09-12T00:20:55.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409b603640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56459399c370 0x56459399c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409ae02640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56459399f550 0x5645939a1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:51466/0 (socket says 172.21.15.66:51466) 2024-09-12T00:20:55.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409ae02640 1 -- 172.21.15.66:0/789606061 learned_addr learned my addr 172.21.15.66:0/789606061 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:55.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409b603640 1 -- 172.21.15.66:0/789606061 >> v1:172.21.15.31:6789/0 conn(0x56459399f550 legacy=0x5645939a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409b603640 1 -- 172.21.15.66:0/789606061 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593845ca0 con 0x56459399c370 2024-09-12T00:20:55.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.364+0000 7f409b603640 1 --2- 172.21.15.66:0/789606061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x56459399c750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f409400a420 tx=0x7f409401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b6d5e44c4e7aec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409a601640 1 -- 172.21.15.66:0/789606061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940af070 con 0x56459399c370 2024-09-12T00:20:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409a601640 1 -- 172.21.15.66:0/789606061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40940aa530 con 0x56459399c370 2024-09-12T00:20:55.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409a601640 1 -- 172.21.15.66:0/789606061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940aa850 con 0x56459399c370 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 -- 172.21.15.66:0/789606061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 msgr2=0x56459399c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/789606061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x56459399c750 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f409400a420 tx=0x7f409401afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 -- 172.21.15.66:0/789606061 shutdown_connections 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/789606061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x56459399c750 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 -- 172.21.15.66:0/789606061 >> 172.21.15.66:0/789606061 conn(0x564593997e90 msgr2=0x56459399a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 -- 172.21.15.66:0/789606061 shutdown_connections 2024-09-12T00:20:55.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.368+0000 7f409dafd9c0 1 -- 172.21.15.66:0/789606061 wait complete. 2024-09-12T00:20:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409dafd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409dafd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5645938a5680 con 0x56459399c370 2024-09-12T00:20:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409b603640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409b603640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56548/0 (socket says 172.21.15.66:56548) 2024-09-12T00:20:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.384+0000 7f409b603640 1 -- 172.21.15.66:0/3645010534 learned_addr learned my addr 172.21.15.66:0/3645010534 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 -- 172.21.15.66:0/3645010534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593820da0 con 0x56459399c370 2024-09-12T00:20:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 --2- 172.21.15.66:0/3645010534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f40940ad040 tx=0x7f40940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2172e609795534 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f3f8960a640 1 -- 172.21.15.66:0/3645010534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940af040 con 0x56459399c370 2024-09-12T00:20:55.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f3f8960a640 1 -- 172.21.15.66:0/3645010534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40940aaa60 con 0x56459399c370 2024-09-12T00:20:55.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f3f8960a640 1 -- 172.21.15.66:0/3645010534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940aad40 con 0x56459399c370 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- 172.21.15.66:0/3645010534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 msgr2=0x564593a87700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/3645010534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f40940ad040 tx=0x7f40940033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- 172.21.15.66:0/3645010534 shutdown_connections 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/3645010534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a87700 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- 172.21.15.66:0/3645010534 >> 172.21.15.66:0/3645010534 conn(0x564593997e90 msgr2=0x564593a83380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- 172.21.15.66:0/3645010534 shutdown_connections 2024-09-12T00:20:55.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- 172.21.15.66:0/3645010534 wait complete. 2024-09-12T00:20:55.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409dafd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564593847a50 con 0x56459399c370 2024-09-12T00:20:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56558/0 (socket says 172.21.15.66:56558) 2024-09-12T00:20:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 -- 172.21.15.66:0/1461457437 learned_addr learned my addr 172.21.15.66:0/1461457437 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593a8f150 con 0x56459399c370 2024-09-12T00:20:55.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.388+0000 7f409b603640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f409401b4b0 tx=0x7f4094017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 -- 172.21.15.66:0/1461457437 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940c5070 con 0x56459399c370 2024-09-12T00:20:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564593a8f3e0 con 0x56459399c370 2024-09-12T00:20:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 -- 172.21.15.66:0/1461457437 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40940c1690 con 0x56459399c370 2024-09-12T00:20:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 -- 172.21.15.66:0/1461457437 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40940c1970 con 0x56459399c370 2024-09-12T00:20:55.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564593a8fe10 con 0x56459399c370 2024-09-12T00:20:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 -- 172.21.15.66:0/1461457437 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f40940c8070 con 0x56459399c370 2024-09-12T00:20:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 0x7f3f8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f3f87e07640 1 -- 172.21.15.66:0/1461457437 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f40940bb070 con 0x56459399c370 2024-09-12T00:20:55.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409ae02640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 0x7f3f8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 0x564593a95d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593a962a0 con 0x56459399f550 2024-09-12T00:20:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409be04640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 0x564593a95d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409ae02640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 0x7f3f8003bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4090004180 tx=0x7f4090001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409be04640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 0x564593a95d60 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409be04640 1 -- 172.21.15.66:0/1461457437 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f408c0083f0 con 0x56459399f550 2024-09-12T00:20:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593a966e0 con 0x56459399f550 2024-09-12T00:20:55.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409be04640 1 -- 172.21.15.66:0/1461457437 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f408c0083f0 con 0x56459399f550 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 0x564593a9a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593a9afb0 con 0x564593a984f0 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.392+0000 7f409b603640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 0x564593a9a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409b603640 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 0x564593a9a8e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409b603640 1 -- 172.21.15.66:0/1461457437 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40940d1070 con 0x564593a984f0 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593a97390 con 0x56459399f550 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 -- 172.21.15.66:0/1461457437 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f408c0083f0 con 0x56459399f550 2024-09-12T00:20:55.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593a97870 con 0x564593a984f0 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409b603640 1 -- 172.21.15.66:0/1461457437 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40940d1070 con 0x564593a984f0 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5645938b2450 con 0x564593aa9720 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56566/0 (socket says 172.21.15.66:56566) 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 -- 172.21.15.66:0/2201343713 learned_addr learned my addr 172.21.15.66:0/2201343713 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 -- 172.21.15.66:0/2201343713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593aaa180 con 0x564593aa9720 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409be04640 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x564593a8fab0 tx=0x7f408c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f3f85602640 1 -- 172.21.15.66:0/2201343713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c015a10 con 0x564593aa9720 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f3f85602640 1 -- 172.21.15.66:0/2201343713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c015bb0 con 0x564593aa9720 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564593aaa9e0 con 0x564593aa9720 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.396+0000 7f3f85602640 1 -- 172.21.15.66:0/2201343713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c013430 con 0x564593aa9720 2024-09-12T00:20:55.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564593aaaf50 con 0x564593aa9720 2024-09-12T00:20:55.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f3f85602640 1 -- 172.21.15.66:0/2201343713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f408c0135d0 con 0x564593aa9720 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f3f85602640 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 0x7f3f7403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f3f85602640 1 -- 172.21.15.66:0/2201343713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f408c01b030 con 0x564593aa9720 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409b603640 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 0x7f3f7403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409b603640 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 0x7f3f7403bf80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40940aa000 tx=0x7f40940e5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409dafd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409dafd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564593a87e90 con 0x564593aba3c0 2024-09-12T00:20:55.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56574/0 (socket says 172.21.15.66:56574) 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409be04640 1 -- 172.21.15.66:0/2029159971 learned_addr learned my addr 172.21.15.66:0/2029159971 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409be04640 1 -- 172.21.15.66:0/2029159971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593abadb0 con 0x564593aba3c0 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.400+0000 7f409be04640 1 --2- 172.21.15.66:0/2029159971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f408c01f040 tx=0x7f408c01e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595480ed1067edbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7effd640 1 -- 172.21.15.66:0/2029159971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c04f070 con 0x564593aba3c0 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7effd640 1 -- 172.21.15.66:0/2029159971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c01f420 con 0x564593aba3c0 2024-09-12T00:20:55.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7effd640 1 -- 172.21.15.66:0/2029159971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c044150 con 0x564593aba3c0 2024-09-12T00:20:55.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2029159971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 msgr2=0x564593aba7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2029159971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f408c01f040 tx=0x7f408c01e930 comp rx=0 tx=0).stop 2024-09-12T00:20:55.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2029159971 shutdown_connections 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2029159971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593aba7c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2029159971 >> 172.21.15.66:0/2029159971 conn(0x564593ab13b0 msgr2=0x564593aaf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2029159971 shutdown_connections 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2029159971 wait complete. 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 Processor -- start 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- start start 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564593ab92f0 con 0x564593aba3c0 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409be04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56588/0 (socket says 172.21.15.66:56588) 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 learned_addr learned my addr 172.21.15.66:0/2494320810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564593ac0db0 con 0x564593aba3c0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409be04640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f408c051260 tx=0x7f408c051290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7d7fa640 1 -- 172.21.15.66:0/2494320810 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c04f040 con 0x564593aba3c0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564593ac1040 con 0x564593aba3c0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7d7fa640 1 -- 172.21.15.66:0/2494320810 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c01edc0 con 0x564593aba3c0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f3f7d7fa640 1 -- 172.21.15.66:0/2494320810 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c013e00 con 0x564593aba3c0 2024-09-12T00:20:55.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.404+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564593ac1040 con 0x564593aba3c0 2024-09-12T00:20:55.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f3f7d7fa640 1 -- 172.21.15.66:0/2494320810 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f408c027580 con 0x564593aba3c0 2024-09-12T00:20:55.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f3f7d7fa640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f64039a70 0x7f3f6403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f3f7d7fa640 1 -- 172.21.15.66:0/2494320810 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f408c032d70 con 0x564593aba3c0 2024-09-12T00:20:55.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409b603640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f64039a70 0x7f3f6403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564593acbbc0 0x564593ace080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ace7d0 con 0x564593acbbc0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564593acbbc0 0x564593ace080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409b603640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f64039a70 0x7f3f6403bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x564593a900b0 tx=0x7f40940eb420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564593acbbc0 0x564593ace080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f409000e640 con 0x564593acbbc0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 realm 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593acaf10 con 0x564593acbbc0 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f409000e640 con 0x564593acbbc0 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593acf2c0 con 0x564593acbbc0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f409000e640 con 0x564593acbbc0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593acfb90 con 0x564593acbbc0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f409000e640 con 0x564593acbbc0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593ad05b0 0x564593ad29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad3070 con 0x564593ad05b0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593ad05b0 0x564593ad29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593ad05b0 0x564593ad29a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 20 searching for the correct realm 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f408c03ab20 0x7f408c007a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.408+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409b603640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f408c03ab20 0x7f408c007a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409b603640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f408c03ab20 0x7f408c007a40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409b603640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f40940ca070 0x7f40940e2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f40940ca070 0x7f40940e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f40940ca070 0x7f40940e2660 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f409000e640 con 0x7f40940ca070 2024-09-12T00:20:55.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f409000e640 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.412+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.416+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x564593acbbc0 2024-09-12T00:20:55.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.420+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593ad05b0 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f40940ca070 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4090029040 con 0x7f40940ca070 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x564593acbbc0 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4940 con 0x7f408c03ab20 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:55.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad39c0 con 0x564593acbbc0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4260 con 0x564593acbbc0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad4d70 con 0x564593ad05b0 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 zone default found 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 4 Realm: () 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 zonegroup default 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.424+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad5110 con 0x7f40940ca070 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad6fb0 con 0x564593ad05b0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593ad7350 con 0x564593ad05b0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 started sync module instance, tier type = 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:55.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad63f0 con 0x7f408c03ab20 2024-09-12T00:20:55.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856830345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad7780 con 0x7f408c03ab20 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.428+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad7fd0 con 0x564593acbbc0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856830345024] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856830352160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad83f0 con 0x564593acbbc0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad8c40 con 0x564593ad05b0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856830354688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad8fd0 con 0x564593ad05b0 2024-09-12T00:20:55.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.432+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad9af0 con 0x7f408c03ab20 2024-09-12T00:20:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856830352160] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856830358976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad9ab0 con 0x7f408c03ab20 2024-09-12T00:20:55.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ada500 con 0x564593acbbc0 2024-09-12T00:20:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856830354688] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856830358976] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856830353216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ada050 con 0x564593acbbc0 2024-09-12T00:20:55.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.436+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adada0 con 0x7f40940ca070 2024-09-12T00:20:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.440+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856830353216] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.440+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.440+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856830356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adaac0 con 0x7f40940ca070 2024-09-12T00:20:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.440+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adb310 con 0x7f40940ca070 2024-09-12T00:20:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.440+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856830356000] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856830363424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adb150 con 0x7f40940ca070 2024-09-12T00:20:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adbc70 con 0x7f40940ca070 2024-09-12T00:20:55.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856830363424] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856830367552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adbc30 con 0x7f40940ca070 2024-09-12T00:20:55.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=0 2024-09-12T00:20:55.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=1 2024-09-12T00:20:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=2 2024-09-12T00:20:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=3 2024-09-12T00:20:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=4 2024-09-12T00:20:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=5 2024-09-12T00:20:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.444+0000 7f409dafd9c0 20 add_watcher() i=6 2024-09-12T00:20:55.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856830367552] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 add_watcher() i=7 2024-09-12T00:20:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593adf0c0 con 0x564593acbbc0 2024-09-12T00:20:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856830364576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593adc570 con 0x564593acbbc0 2024-09-12T00:20:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856830364576] v33'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f3f527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:55.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 5 note: GC not initialized 2024-09-12T00:20:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f3f517e2640 20 reqs_thread_entry: start 2024-09-12T00:20:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:55.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 Filter name: none 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f3f4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564593b02720 con 0x564593acbbc0 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:20:55.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:55.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.448+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593b02100 con 0x7f40940ca070 2024-09-12T00:20:55.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.452+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call] v33'34 uv34 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.452+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593b02100 con 0x7f40940ca070 2024-09-12T00:20:55.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(64 usage.10 [call] v33'35 uv34 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f3f527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856830364576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593b02100 con 0x564593acbbc0 2024-09-12T00:20:55.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94856830364576] v33'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856830345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593b02100 con 0x7f408c03ab20 2024-09-12T00:20:55.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94856830345024] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409dafd9c0 20 remove_watcher() i=0 2024-09-12T00:20:55.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409dafd9c0 2 removed watcher, disabling cache 2024-09-12T00:20:55.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.456+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856830352160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593b02100 con 0x564593acbbc0 2024-09-12T00:20:55.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.460+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94856830352160] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.460+0000 7f409dafd9c0 20 remove_watcher() i=1 2024-09-12T00:20:55.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.460+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856830354688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad7b20 con 0x564593ad05b0 2024-09-12T00:20:55.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.460+0000 7f409be04640 1 -- 172.21.15.66:0/2494320810 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94856830354688] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f408c037020 con 0x564593ad05b0 2024-09-12T00:20:55.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 20 remove_watcher() i=2 2024-09-12T00:20:55.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856830358976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad7b20 con 0x7f408c03ab20 2024-09-12T00:20:55.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409b603640 1 -- 172.21.15.66:0/2494320810 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94856830358976] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40940d1070 con 0x7f408c03ab20 2024-09-12T00:20:55.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 20 remove_watcher() i=3 2024-09-12T00:20:55.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856830353216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad95c0 con 0x564593acbbc0 2024-09-12T00:20:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94856830353216] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x564593acbbc0 2024-09-12T00:20:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 20 remove_watcher() i=4 2024-09-12T00:20:55.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.464+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856830356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad95c0 con 0x7f40940ca070 2024-09-12T00:20:55.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.468+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94856830356000] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.468+0000 7f409dafd9c0 20 remove_watcher() i=5 2024-09-12T00:20:55.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.468+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856830363424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ad95c0 con 0x7f40940ca070 2024-09-12T00:20:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94856830363424] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 20 remove_watcher() i=6 2024-09-12T00:20:55.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856830367552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564593ada720 con 0x7f40940ca070 2024-09-12T00:20:55.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94856830367552] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4090039040 con 0x7f40940ca070 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 20 remove_watcher() i=7 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f40940ca070 msgr2=0x7f40940e2660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f40940ca070 0x7f40940e2660 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564593acbbc0 msgr2=0x564593ace080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x564593acbbc0 0x564593ace080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f408c03ab20 msgr2=0x7f408c007a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f408c03ab20 0x7f408c007a40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593ad05b0 msgr2=0x564593ad29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593ad05b0 0x564593ad29a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f64039a70 msgr2=0x7f3f6403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f64039a70 0x7f3f6403bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x564593a900b0 tx=0x7f40940eb420 comp rx=0 tx=0).stop 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 msgr2=0x564593ac0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409ae02640 1 -- 172.21.15.66:0/2494320810 reap_dead start 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f408c051260 tx=0x7f408c051290 comp rx=0 tx=0).stop 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 shutdown_connections 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2494320810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aba3c0 0x564593ac0850 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 >> 172.21.15.66:0/2494320810 conn(0x564593ab13b0 msgr2=0x564593aaf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 shutdown_connections 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2494320810 wait complete. 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 msgr2=0x7f3f7403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 0x7f3f7403bf80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40940aa000 tx=0x7f40940e5040 comp rx=0 tx=0).stop 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 msgr2=0x564593aa9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x564593a8fab0 tx=0x7f408c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:55.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 shutdown_connections 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f74039ac0 0x7f3f7403bf80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/2201343713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564593aa9720 0x564593aa9b40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 >> 172.21.15.66:0/2201343713 conn(0x564593a9f0d0 msgr2=0x564593a9f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 shutdown_connections 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.472+0000 7f409dafd9c0 1 -- 172.21.15.66:0/2201343713 wait complete. 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 msgr2=0x564593a95d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 0x564593a95d60 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 msgr2=0x564593a9a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 0x564593a9a8e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 msgr2=0x7f3f8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 0x7f3f8003bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4090004180 tx=0x7f4090001340 comp rx=0 tx=0).stop 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 msgr2=0x564593a8ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f409401b4b0 tx=0x7f4094017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 shutdown_connections 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x564593a984f0 0x564593a9a8e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56459399f550 0x564593a95d60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3f80039a70 0x7f3f8003bf30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 --2- 172.21.15.66:0/1461457437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56459399c370 0x564593a8ebf0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 >> 172.21.15.66:0/1461457437 conn(0x564593997e90 msgr2=0x564593a81e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 shutdown_connections 2024-09-12T00:20:55.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.476+0000 7f409dafd9c0 1 -- 172.21.15.66:0/1461457437 wait complete. 2024-09-12T00:20:55.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T00:20:55.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T00:20:55.492 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T00:20:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:55.569 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1ce119b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56118df13770 0x56118dfa21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1ce119b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56118de539c0 con 0x56118dfa26e0 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1ce119b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56118dea36d0 con 0x56118df13770 2024-09-12T00:20:55.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cdeca1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56118df13770 0x56118dfa21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cde4a0640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56118dfa26e0 0x56118dfa4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:51480/0 (socket says 172.21.15.66:51480) 2024-09-12T00:20:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cdeca1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56118df13770 0x56118dfa21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56590/0 (socket says 172.21.15.66:56590) 2024-09-12T00:20:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cde4a0640 1 -- 172.21.15.66:0/632688544 learned_addr learned my addr 172.21.15.66:0/632688544 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cdeca1640 1 -- 172.21.15.66:0/632688544 >> v1:172.21.15.31:6789/0 conn(0x56118dfa26e0 legacy=0x56118dfa4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.564+0000 7f1cdeca1640 1 -- 172.21.15.66:0/632688544 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118de47ca0 con 0x56118df13770 2024-09-12T00:20:55.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/632688544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118dfa21a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a420 tx=0x7f1cd001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6987df5b08cc822 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1cddc9f640 1 -- 172.21.15.66:0/632688544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00b0070 con 0x56118df13770 2024-09-12T00:20:55.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1cddc9f640 1 -- 172.21.15.66:0/632688544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00a3dc0 con 0x56118df13770 2024-09-12T00:20:55.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1cddc9f640 1 -- 172.21.15.66:0/632688544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00ab570 con 0x56118df13770 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/632688544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 msgr2=0x56118dfa21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/632688544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118dfa21a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a420 tx=0x7f1cd001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/632688544 shutdown_connections 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/632688544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118dfa21a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/632688544 >> 172.21.15.66:0/632688544 conn(0x56118df99e90 msgr2=0x56118df9c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/632688544 shutdown_connections 2024-09-12T00:20:55.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.568+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/632688544 wait complete. 2024-09-12T00:20:55.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1ce119b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1ce119b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56118dea7680 con 0x56118df13770 2024-09-12T00:20:55.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1cdeca1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1cdeca1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56604/0 (socket says 172.21.15.66:56604) 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.584+0000 7f1cdeca1640 1 -- 172.21.15.66:0/2969156287 learned_addr learned my addr 172.21.15.66:0/2969156287 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 -- 172.21.15.66:0/2969156287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118de22da0 con 0x56118df13770 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/2969156287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00a3d90 tx=0x7f1cd00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc9deec1f6fe23c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1bcce09640 1 -- 172.21.15.66:0/2969156287 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00b0040 con 0x56118df13770 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1bcce09640 1 -- 172.21.15.66:0/2969156287 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00ab6b0 con 0x56118df13770 2024-09-12T00:20:55.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1bcce09640 1 -- 172.21.15.66:0/2969156287 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00ab990 con 0x56118df13770 2024-09-12T00:20:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/2969156287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 msgr2=0x56118e08a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/2969156287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00a3d90 tx=0x7f1cd00033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/2969156287 shutdown_connections 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/2969156287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e08a900 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/2969156287 >> 172.21.15.66:0/2969156287 conn(0x56118df99e90 msgr2=0x56118e0865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/2969156287 shutdown_connections 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/2969156287 wait complete. 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1ce119b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56118de49a50 con 0x56118df13770 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56612/0 (socket says 172.21.15.66:56612) 2024-09-12T00:20:55.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 -- 172.21.15.66:0/3380966050 learned_addr learned my addr 172.21.15.66:0/3380966050 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118e092300 con 0x56118df13770 2024-09-12T00:20:55.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0008030 tx=0x7f1cd0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.588+0000 7f1bcb606640 1 -- 172.21.15.66:0/3380966050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00b0040 con 0x56118df13770 2024-09-12T00:20:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56118e092590 con 0x56118df13770 2024-09-12T00:20:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1bcb606640 1 -- 172.21.15.66:0/3380966050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00b4770 con 0x56118df13770 2024-09-12T00:20:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1bcb606640 1 -- 172.21.15.66:0/3380966050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00b4a50 con 0x56118df13770 2024-09-12T00:20:55.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118e092fc0 con 0x56118df13770 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1bcb606640 1 -- 172.21.15.66:0/3380966050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cd00b4c80 con 0x56118df13770 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1bcb606640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 0x7f1bc403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1bcb606640 1 -- 172.21.15.66:0/3380966050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1cd00ea5c0 con 0x56118df13770 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 0x7f1bc403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 0x56118e098f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e099450 con 0x56118dfa26e0 2024-09-12T00:20:55.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 0x56118e098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 0x7f1bc403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8004180 tx=0x7f1cc8001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 0x56118e098f10 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/3380966050 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd80083f0 con 0x56118dfa26e0 2024-09-12T00:20:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0932f0 con 0x56118dfa26e0 2024-09-12T00:20:55.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/3380966050 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cd80083f0 con 0x56118dfa26e0 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 0x56118e09db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e09e1d0 con 0x56118e09b710 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 0x56118e09db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.592+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 0x56118e09db00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdeca1640 1 -- 172.21.15.66:0/3380966050 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1cd00bbd40 con 0x56118e09b710 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e09a5b0 con 0x56118dfa26e0 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/3380966050 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cd80083f0 con 0x56118dfa26e0 2024-09-12T00:20:55.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e09aa90 con 0x56118e09b710 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdeca1640 1 -- 172.21.15.66:0/3380966050 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cd00bbd40 con 0x56118e09b710 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56118deb4450 con 0x56118e0ac920 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56628/0 (socket says 172.21.15.66:56628) 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/588201900 learned_addr learned my addr 172.21.15.66:0/588201900 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/588201900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118e0ad380 con 0x56118e0ac920 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x56118e092dd0 tx=0x7f1cd800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1bc8e01640 1 -- 172.21.15.66:0/588201900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd801c020 con 0x56118e0ac920 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1bc8e01640 1 -- 172.21.15.66:0/588201900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8007d00 con 0x56118e0ac920 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56118e0adbe0 con 0x56118e0ac920 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1bc8e01640 1 -- 172.21.15.66:0/588201900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8018440 con 0x56118e0ac920 2024-09-12T00:20:55.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.596+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118e0ae150 con 0x56118e0ac920 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc8e01640 1 -- 172.21.15.66:0/588201900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cd801f020 con 0x56118e0ac920 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc8e01640 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 0x7f1bb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc8e01640 1 -- 172.21.15.66:0/588201900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1cd8051e70 con 0x56118e0ac920 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 0x7f1bb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 0x7f1bb803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00bbfd0 tx=0x7f1cd00b4f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56118e08b090 con 0x56118df9e160 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56634/0 (socket says 172.21.15.66:56634) 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/3551981060 learned_addr learned my addr 172.21.15.66:0/3551981060 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/3551981060 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118df9eaa0 con 0x56118df9e160 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/3551981060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8021fd0 tx=0x7f1cd8043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb924281507fd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc27fc640 1 -- 172.21.15.66:0/3551981060 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8021530 con 0x56118df9e160 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc27fc640 1 -- 172.21.15.66:0/3551981060 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8029350 con 0x56118df9e160 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1bc27fc640 1 -- 172.21.15.66:0/3551981060 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8029c70 con 0x56118df9e160 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3551981060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 msgr2=0x56118df9e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3551981060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8021fd0 tx=0x7f1cd8043110 comp rx=0 tx=0).stop 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3551981060 shutdown_connections 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3551981060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118df9e560 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3551981060 >> 172.21.15.66:0/3551981060 conn(0x56118e0b5610 msgr2=0x56118e0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3551981060 shutdown_connections 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.600+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3551981060 wait complete. 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 Processor -- start 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 -- start start 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56118df9f020 con 0x56118df9e160 2024-09-12T00:20:55.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdf4a2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56638/0 (socket says 172.21.15.66:56638) 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 learned_addr learned my addr 172.21.15.66:0/4257855331 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118e0c2e90 con 0x56118df9e160 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8021fd0 tx=0x7f1cd8050060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 -- 172.21.15.66:0/4257855331 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8039070 con 0x56118df9e160 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56118e0c3120 con 0x56118df9e160 2024-09-12T00:20:55.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 -- 172.21.15.66:0/4257855331 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8020a90 con 0x56118df9e160 2024-09-12T00:20:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 -- 172.21.15.66:0/4257855331 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8020d70 con 0x56118df9e160 2024-09-12T00:20:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118e0c3ad0 con 0x56118df9e160 2024-09-12T00:20:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 -- 172.21.15.66:0/4257855331 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cd8056070 con 0x56118df9e160 2024-09-12T00:20:55.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1ba8039a70 0x7f1ba803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1bc0ff9640 1 -- 172.21.15.66:0/4257855331 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1cd8031070 con 0x56118df9e160 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1ba8039a70 0x7f1ba803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118e0cdef0 0x56118e0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d0ad0 con 0x56118e0cdef0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.604+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118e0cdef0 0x56118e0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1ba8039a70 0x7f1ba803bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00d13f0 tx=0x7f1cd00dc000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118e0cdef0 0x56118e0d0380 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc800e640 con 0x56118e0cdef0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 realm 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0cd2a0 con 0x56118e0cdef0 2024-09-12T00:20:55.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc800e640 con 0x56118e0cdef0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d15d0 con 0x56118e0cdef0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc800e640 con 0x56118e0cdef0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d1ea0 con 0x56118e0cdef0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1cc800e640 con 0x56118e0cdef0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e0d2750 0x56118e0d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d5280 con 0x56118e0d2750 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e0d2750 0x56118e0d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e0d2750 0x56118e0d4b40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 20 searching for the correct realm 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1cd8058060 0x7f1cd8034a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1cd8058060 0x7f1cd8034a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1cd8058060 0x7f1cd8034a00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.608+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdeca1640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1cd00f7040 0x7f1cd00c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1cd00f7040 0x7f1cd00c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1cd00f7040 0x7f1cd00c6a20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc800e640 con 0x7f1cd00f7040 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc800e640 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.612+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.616+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x56118e0cdef0 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0d2750 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.620+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd00f7040 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cc8029040 con 0x7f1cd00f7040 2024-09-12T00:20:55.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x56118e0cdef0 2024-09-12T00:20:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6ba0 con 0x7f1cd8058060 2024-09-12T00:20:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d5c90 con 0x56118e0cdef0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6530 con 0x56118e0cdef0 2024-09-12T00:20:55.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d58d0 con 0x56118e0d2750 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 zone default found 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 4 Realm: () 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 zonegroup default 2024-09-12T00:20:55.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d6160 con 0x7f1cd00f7040 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d8f70 con 0x56118e0d2750 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d9500 con 0x56118e0d2750 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 started sync module instance, tier type = 2024-09-12T00:20:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.624+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d83e0 con 0x7f1cd8058060 2024-09-12T00:20:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94633397681968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d9940 con 0x7f1cd8058060 2024-09-12T00:20:55.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0da190 con 0x56118e0cdef0 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94633397681968] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94633397684176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0da190 con 0x56118e0cdef0 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.628+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dac90 con 0x56118e0d2750 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94633397684176] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94633397692288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dac50 con 0x56118e0d2750 2024-09-12T00:20:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d9d20 con 0x7f1cd8058060 2024-09-12T00:20:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94633397696208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dbfa0 con 0x7f1cd8058060 2024-09-12T00:20:55.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.632+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dc960 con 0x56118e0cdef0 2024-09-12T00:20:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94633397692288] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94633397696208] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94633397694640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dc960 con 0x56118e0cdef0 2024-09-12T00:20:55.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dd200 con 0x7f1cd00f7040 2024-09-12T00:20:55.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.636+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94633397694640] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94633397700032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dd010 con 0x7f1cd00f7040 2024-09-12T00:20:55.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dda80 con 0x7f1cd00f7040 2024-09-12T00:20:55.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94633397704048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0ddef0 con 0x7f1cd00f7040 2024-09-12T00:20:55.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0de9d0 con 0x7f1cd00f7040 2024-09-12T00:20:55.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.640+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94633397700032] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94633397704048] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94633397701216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dda40 con 0x7f1cd00f7040 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=0 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=1 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=2 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=3 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=4 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=5 2024-09-12T00:20:55.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=6 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94633397701216] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 20 add_watcher() i=7 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dda40 con 0x56118e0cdef0 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.644+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94633397708000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0dda40 con 0x56118e0cdef0 2024-09-12T00:20:55.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94633397708000] v33'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1b957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:55.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:55.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 5 note: GC not initialized 2024-09-12T00:20:55.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1b0ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:55.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:55.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 Filter name: none 2024-09-12T00:20:55.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1b0dffb640 20 reqs_thread_entry: start 2024-09-12T00:20:55.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e1049f0 con 0x56118e0cdef0 2024-09-12T00:20:55.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:55.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56118e105f40 con 0x7f1cd00f7040 2024-09-12T00:20:55.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.648+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv34 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1b957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94633397708000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0deda0 con 0x56118e0cdef0 2024-09-12T00:20:55.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94633397708000] v33'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94633397681968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0de4e0 con 0x7f1cd8058060 2024-09-12T00:20:55.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94633397681968] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1ce119b9c0 20 remove_watcher() i=0 2024-09-12T00:20:55.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1ce119b9c0 2 removed watcher, disabling cache 2024-09-12T00:20:55.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.652+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94633397684176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d7f30 con 0x56118e0cdef0 2024-09-12T00:20:55.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.656+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94633397684176] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.656+0000 7f1ce119b9c0 20 remove_watcher() i=1 2024-09-12T00:20:55.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.656+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94633397692288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d7f30 con 0x56118e0d2750 2024-09-12T00:20:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.656+0000 7f1cdf4a2640 1 -- 172.21.15.66:0/4257855331 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94633397692288] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd8055030 con 0x56118e0d2750 2024-09-12T00:20:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.656+0000 7f1ce119b9c0 20 remove_watcher() i=2 2024-09-12T00:20:55.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94633397696208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d7f30 con 0x7f1cd8058060 2024-09-12T00:20:55.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1cdeca1640 1 -- 172.21.15.66:0/4257855331 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94633397696208] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00d4040 con 0x7f1cd8058060 2024-09-12T00:20:55.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1ce119b9c0 20 remove_watcher() i=3 2024-09-12T00:20:55.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94633397694640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0db6d0 con 0x56118e0cdef0 2024-09-12T00:20:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94633397694640] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x56118e0cdef0 2024-09-12T00:20:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1ce119b9c0 20 remove_watcher() i=4 2024-09-12T00:20:55.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.660+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94633397700032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d7f30 con 0x7f1cd00f7040 2024-09-12T00:20:55.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.664+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94633397700032] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.664+0000 7f1ce119b9c0 20 remove_watcher() i=5 2024-09-12T00:20:55.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.664+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94633397704048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0db6d0 con 0x7f1cd00f7040 2024-09-12T00:20:55.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.664+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94633397704048] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8039040 con 0x7f1cd00f7040 2024-09-12T00:20:55.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 20 remove_watcher() i=6 2024-09-12T00:20:55.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94633397701216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56118e0d7f30 con 0x7f1cd00f7040 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94633397701216] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cc8045040 con 0x7f1cd00f7040 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 20 remove_watcher() i=7 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1cd00f7040 msgr2=0x7f1cd00c6a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1cd00f7040 0x7f1cd00c6a20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118e0cdef0 msgr2=0x56118e0d0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118e0cdef0 0x56118e0d0380 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1cd8058060 msgr2=0x7f1cd8034a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1cd8058060 0x7f1cd8034a00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e0d2750 msgr2=0x56118e0d4b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e0d2750 0x56118e0d4b40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1ba8039a70 msgr2=0x7f1ba803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1ba8039a70 0x7f1ba803bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00d13f0 tx=0x7f1cd00dc000 comp rx=0 tx=0).stop 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1cde4a0640 1 -- 172.21.15.66:0/4257855331 reap_dead start 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 msgr2=0x56118e0c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8021fd0 tx=0x7f1cd8050060 comp rx=0 tx=0).stop 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 shutdown_connections 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/4257855331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df9e160 0x56118e0c2930 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 >> 172.21.15.66:0/4257855331 conn(0x56118e0b5610 msgr2=0x56118e0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 shutdown_connections 2024-09-12T00:20:55.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/4257855331 wait complete. 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 msgr2=0x7f1bb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 0x7f1bb803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00bbfd0 tx=0x7f1cd00b4f70 comp rx=0 tx=0).stop 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 msgr2=0x56118e0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x56118e092dd0 tx=0x7f1cd800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 shutdown_connections 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bb8039a70 0x7f1bb803bf30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/588201900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118e0ac920 0x56118e0acd40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 >> 172.21.15.66:0/588201900 conn(0x56118e0a22d0 msgr2=0x56118e0a26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 shutdown_connections 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/588201900 wait complete. 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 msgr2=0x56118e098f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 0x56118e098f10 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 msgr2=0x56118e09db00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 0x56118e09db00 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 msgr2=0x7f1bc403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 0x7f1bc403bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8004180 tx=0x7f1cc8001340 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 msgr2=0x56118e091da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0008030 tx=0x7f1cd0017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 shutdown_connections 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56118e09b710 0x56118e09db00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56118dfa26e0 0x56118e098f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1bc4039a70 0x7f1bc403bf30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 --2- 172.21.15.66:0/3380966050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56118df13770 0x56118e091da0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.668+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 >> 172.21.15.66:0/3380966050 conn(0x56118df99e90 msgr2=0x56118e085030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.672+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 shutdown_connections 2024-09-12T00:20:55.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.672+0000 7f1ce119b9c0 1 -- 172.21.15.66:0/3380966050 wait complete. 2024-09-12T00:20:55.686 INFO:teuthology.orchestra.run.smithi066.stdout:{"entries":[],"summary":[]} 2024-09-12T00:20:55.687 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T00:20:55.687 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T00:20:55.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T00:20:55.687 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-12T00:20:55.766 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:55.766 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:55.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a268e09c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5558b029e370 0x5558b029e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a268e09c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558b01539c0 con 0x5558b02a1550 2024-09-12T00:20:55.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a268e09c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5558b01a36d0 con 0x5558b029e370 2024-09-12T00:20:55.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a243e6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5558b029e370 0x5558b029e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a243e6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5558b029e370 0x5558b029e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56648/0 (socket says 172.21.15.66:56648) 2024-09-12T00:20:55.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.760+0000 7f6a243e6640 1 -- 172.21.15.66:0/2241195945 learned_addr learned my addr 172.21.15.66:0/2241195945 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a243e6640 1 -- 172.21.15.66:0/2241195945 >> v1:172.21.15.31:6789/0 conn(0x5558b02a1550 legacy=0x5558b02a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a243e6640 1 -- 172.21.15.66:0/2241195945 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b0147ca0 con 0x5558b029e370 2024-09-12T00:20:55.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2241195945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b029e750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400a4e0 tx=0x7f6a1401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fde41b13211a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a233e4640 1 -- 172.21.15.66:0/2241195945 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140aa540 con 0x5558b029e370 2024-09-12T00:20:55.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a233e4640 1 -- 172.21.15.66:0/2241195945 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a140aa6e0 con 0x5558b029e370 2024-09-12T00:20:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.764+0000 7f6a233e4640 1 -- 172.21.15.66:0/2241195945 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140aaa40 con 0x5558b029e370 2024-09-12T00:20:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2241195945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 msgr2=0x5558b029e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2241195945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b029e750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400a4e0 tx=0x7f6a1401b090 comp rx=0 tx=0).stop 2024-09-12T00:20:55.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2241195945 shutdown_connections 2024-09-12T00:20:55.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2241195945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b029e750 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2241195945 >> 172.21.15.66:0/2241195945 conn(0x5558b0299e90 msgr2=0x5558b029c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2241195945 shutdown_connections 2024-09-12T00:20:55.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.768+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2241195945 wait complete. 2024-09-12T00:20:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5558b01a7680 con 0x5558b029e370 2024-09-12T00:20:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a243e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a243e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56662/0 (socket says 172.21.15.66:56662) 2024-09-12T00:20:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a243e6640 1 -- 172.21.15.66:0/1840631870 learned_addr learned my addr 172.21.15.66:0/1840631870 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a243e6640 1 -- 172.21.15.66:0/1840631870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b0122da0 con 0x5558b029e370 2024-09-12T00:20:55.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1840631870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6a14017ca0 tx=0x7f6a140033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564781ca0817417d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f691260c640 1 -- 172.21.15.66:0/1840631870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140b9030 con 0x5558b029e370 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f691260c640 1 -- 172.21.15.66:0/1840631870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a140aaa80 con 0x5558b029e370 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f691260c640 1 -- 172.21.15.66:0/1840631870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140aada0 con 0x5558b029e370 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1840631870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 msgr2=0x5558b0213280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1840631870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6a14017ca0 tx=0x7f6a140033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1840631870 shutdown_connections 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1840631870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0213280 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1840631870 >> 172.21.15.66:0/1840631870 conn(0x5558b0299e90 msgr2=0x5558b0385340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1840631870 shutdown_connections 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1840631870 wait complete. 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.784+0000 7f6a268e09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5558b0149a50 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a243e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a243e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56666/0 (socket says 172.21.15.66:56666) 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a243e6640 1 -- 172.21.15.66:0/1851427193 learned_addr learned my addr 172.21.15.66:0/1851427193 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a243e6640 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b0392270 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6a1401b930 tx=0x7f6a14017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 -- 172.21.15.66:0/1851427193 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140b9070 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b0392500 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 -- 172.21.15.66:0/1851427193 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a140c3030 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 -- 172.21.15.66:0/1851427193 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a140b5c40 con 0x5558b029e370 2024-09-12T00:20:55.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b0392e60 con 0x5558b029e370 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 -- 172.21.15.66:0/1851427193 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a140b3040 con 0x5558b029e370 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 0x7f690c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6910e09640 1 -- 172.21.15.66:0/1851427193 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f6a140ba070 con 0x5558b029e370 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a23be5640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 0x7f690c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 0x5558b0398e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0399370 con 0x5558b02a1550 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a24be7640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 0x5558b0398e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.788+0000 7f6a23be5640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 0x7f690c03bf30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001ec0 tx=0x7f6a0c001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 0x5558b0398e30 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 -- 172.21.15.66:0/1851427193 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a1c0083f0 con 0x5558b02a1550 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03931c0 con 0x5558b02a1550 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 -- 172.21.15.66:0/1851427193 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a1c0083f0 con 0x5558b02a1550 2024-09-12T00:20:55.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 0x5558b039da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b039e140 con 0x5558b039b610 2024-09-12T00:20:55.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 0x5558b039da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 0x5558b039da00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a243e6640 1 -- 172.21.15.66:0/1851427193 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a140cf070 con 0x5558b039b610 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b039a450 con 0x5558b02a1550 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 -- 172.21.15.66:0/1851427193 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a1c0083f0 con 0x5558b02a1550 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b039a8c0 con 0x5558b039b610 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a243e6640 1 -- 172.21.15.66:0/1851427193 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a140cf070 con 0x5558b039b610 2024-09-12T00:20:55.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a268e09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5558b01b4450 con 0x5558b03ac7d0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56682/0 (socket says 172.21.15.66:56682) 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.792+0000 7f6a24be7640 1 -- 172.21.15.66:0/1758451034 learned_addr learned my addr 172.21.15.66:0/1758451034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a24be7640 1 -- 172.21.15.66:0/1758451034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b03ad230 con 0x5558b03ac7d0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a24be7640 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x5558b0393050 tx=0x7f6a1c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 -- 172.21.15.66:0/1758451034 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c01c020 con 0x5558b03ac7d0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b03ada90 con 0x5558b03ac7d0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 -- 172.21.15.66:0/1758451034 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c007d00 con 0x5558b03ac7d0 2024-09-12T00:20:55.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 -- 172.21.15.66:0/1758451034 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c018440 con 0x5558b03ac7d0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b03ae000 con 0x5558b03ac7d0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 -- 172.21.15.66:0/1758451034 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a1c01f020 con 0x5558b03ac7d0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 0x7f68fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6909ffb640 1 -- 172.21.15.66:0/1758451034 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f6a1c051de0 con 0x5558b03ac7d0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 0x7f68fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a243e6640 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 0x7f68fc03bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6a140bdb50 tx=0x7f6a140b5ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a268e09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5558b0213a10 con 0x5558b03ba0e0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56690/0 (socket says 172.21.15.66:56690) 2024-09-12T00:20:55.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.796+0000 7f6a24be7640 1 -- 172.21.15.66:0/3909541382 learned_addr learned my addr 172.21.15.66:0/3909541382 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 -- 172.21.15.66:0/3909541382 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b03baad0 con 0x5558b03ba0e0 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 --2- 172.21.15.66:0/3909541382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c050130 tx=0x7f6a1c043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bb072fb0be0e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f69037fe640 1 -- 172.21.15.66:0/3909541382 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c021400 con 0x5558b03ba0e0 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f69037fe640 1 -- 172.21.15.66:0/3909541382 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c029350 con 0x5558b03ba0e0 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f69037fe640 1 -- 172.21.15.66:0/3909541382 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c0215a0 con 0x5558b03ba0e0 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/3909541382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 msgr2=0x5558b03ba4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/3909541382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c050130 tx=0x7f6a1c043110 comp rx=0 tx=0).stop 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/3909541382 shutdown_connections 2024-09-12T00:20:55.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/3909541382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03ba4e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/3909541382 >> 172.21.15.66:0/3909541382 conn(0x5558b03b5500 msgr2=0x5558b03b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/3909541382 shutdown_connections 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/3909541382 wait complete. 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 Processor -- start 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- start start 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5558b03b9030 con 0x5558b03ba0e0 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56694/0 (socket says 172.21.15.66:56694) 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 learned_addr learned my addr 172.21.15.66:0/2297195115 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:55.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b03c0ad0 con 0x5558b03ba0e0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a24be7640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c043150 tx=0x7f6a1c050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6901ffb640 1 -- 172.21.15.66:0/2297195115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c016e00 con 0x5558b03ba0e0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b03c0d60 con 0x5558b03ba0e0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6901ffb640 1 -- 172.21.15.66:0/2297195115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c028300 con 0x5558b03ba0e0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6901ffb640 1 -- 172.21.15.66:0/2297195115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c028620 con 0x5558b03ba0e0 2024-09-12T00:20:55.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.800+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b03c1710 con 0x5558b03ba0e0 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6901ffb640 1 -- 172.21.15.66:0/2297195115 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a1c016040 con 0x5558b03ba0e0 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6901ffb640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68f4039a70 0x7f68f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6901ffb640 1 -- 172.21.15.66:0/2297195115 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f6a1c031070 con 0x5558b03ba0e0 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68f4039a70 0x7f68f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b03cbb00 0x5558b03cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03ce6e0 con 0x5558b03cbb00 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b03cbb00 0x5558b03cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68f4039a70 0x7f68f403bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a140b5fa0 tx=0x7f6a140e7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b03cbb00 0x5558b03cdf90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a0c00d040 con 0x5558b03cbb00 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 realm 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03caeb0 con 0x5558b03cbb00 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a0c00d040 con 0x5558b03cbb00 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:55.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03cf1e0 con 0x5558b03cbb00 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a0c00d040 con 0x5558b03cbb00 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03cfab0 con 0x5558b03cbb00 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a0c00d040 con 0x5558b03cbb00 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b03d04d0 0x5558b03d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d3030 con 0x5558b03d04d0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.804+0000 7f6a24be7640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b03d04d0 0x5558b03d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a24be7640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b03d04d0 0x5558b03d28c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a268e09c0 20 searching for the correct realm 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a24be7640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6a1c021020 0x7f6a1c047a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6a1c021020 0x7f6a1c047a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6a1c021020 0x7f6a1c047a50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a243e6640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6a140f8040 0x7f6a140eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:55.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6a140f8040 0x7f6a140eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:55.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6a140f8040 0x7f6a140eb050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:55.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c00d040 con 0x7f6a140f8040 2024-09-12T00:20:55.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c00d040 con 0x5558b03cbb00 2024-09-12T00:20:55.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.808+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.812+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.816+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03d04d0 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a140f8040 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x5558b03cbb00 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4900 con 0x7f6a1c021020 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d3980 con 0x5558b03cbb00 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d41d0 con 0x5558b03cbb00 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.820+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d4d30 con 0x5558b03d04d0 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 zone default found 2024-09-12T00:20:55.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 4 Realm: () 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 zonegroup default 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d50d0 con 0x7f6a140f8040 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d6f70 con 0x5558b03d04d0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d7310 con 0x5558b03d04d0 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 started sync module instance, tier type = 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d6470 con 0x7f6a1c021020 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93839402297440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d60d0 con 0x7f6a1c021020 2024-09-12T00:20:55.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.824+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d7de0 con 0x5558b03cbb00 2024-09-12T00:20:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93839402297440] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93839402301744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d7d50 con 0x5558b03cbb00 2024-09-12T00:20:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d8bb0 con 0x5558b03d04d0 2024-09-12T00:20:55.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93839402305152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d8b70 con 0x5558b03d04d0 2024-09-12T00:20:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.828+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d9b10 con 0x7f6a1c021020 2024-09-12T00:20:55.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93839402301744] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93839402303952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03d9f00 con 0x7f6a1c021020 2024-09-12T00:20:55.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03da8c0 con 0x5558b03cbb00 2024-09-12T00:20:55.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93839402305152] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93839402303952] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93839402307488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03da410 con 0x5558b03cbb00 2024-09-12T00:20:55.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.832+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03db160 con 0x7f6a140f8040 2024-09-12T00:20:55.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93839402307488] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93839402309104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03dae20 con 0x7f6a140f8040 2024-09-12T00:20:55.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03db670 con 0x7f6a140f8040 2024-09-12T00:20:55.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93839402315568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03dba20 con 0x7f6a140f8040 2024-09-12T00:20:55.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.836+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03dc520 con 0x7f6a140f8040 2024-09-12T00:20:55.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93839402309104] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93839402319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03dc4e0 con 0x7f6a140f8040 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=0 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=1 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=2 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=3 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=4 2024-09-12T00:20:55.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=5 2024-09-12T00:20:55.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93839402315568] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=6 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93839402319888] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 20 add_watcher() i=7 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.840+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03db4b0 con 0x5558b03cbb00 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93839402316912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03dc940 con 0x5558b03cbb00 2024-09-12T00:20:55.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93839402316912] v33'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f68da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a268e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:55.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a268e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:55.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.844+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d80 con 0x5558b03cbb00 2024-09-12T00:20:55.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.848+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.848+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d40 con 0x7f6a140f8040 2024-09-12T00:20:55.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.848+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.848+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d40 con 0x5558b03d04d0 2024-09-12T00:20:55.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d40 con 0x5558b03cbb00 2024-09-12T00:20:55.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'239 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d40 con 0x7f6a1c021020 2024-09-12T00:20:55.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'81 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.852+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7d40 con 0x5558b03d04d0 2024-09-12T00:20:55.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.856+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.856+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9470 con 0x5558b03cbb00 2024-09-12T00:20:55.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.856+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.856+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e92a0 con 0x7f6a140f8040 2024-09-12T00:20:55.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.860+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.860+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9220 con 0x7f6a1c021020 2024-09-12T00:20:55.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.860+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.860+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9870 con 0x5558b03d04d0 2024-09-12T00:20:55.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.864+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.864+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x7f6a1c021020 2024-09-12T00:20:55.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.864+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'82 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.864+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x7f6a140f8040 2024-09-12T00:20:55.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.868+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'36 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.868+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x7f6a1c021020 2024-09-12T00:20:55.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.868+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.868+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x7f6a140f8040 2024-09-12T00:20:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.872+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'69 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.872+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x5558b03cbb00 2024-09-12T00:20:55.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.872+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'240 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.872+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e96d0 con 0x5558b03d04d0 2024-09-12T00:20:55.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.876+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'74 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.876+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9760 con 0x7f6a1c021020 2024-09-12T00:20:55.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.876+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'83 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.876+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9760 con 0x5558b03d04d0 2024-09-12T00:20:55.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.880+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.880+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9760 con 0x5558b03cbb00 2024-09-12T00:20:55.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.880+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.880+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9760 con 0x5558b03cbb00 2024-09-12T00:20:55.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.884+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'241 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.884+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9760 con 0x5558b03d04d0 2024-09-12T00:20:55.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.884+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'75 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.884+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9820 con 0x7f6a1c021020 2024-09-12T00:20:55.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9820 con 0x5558b03d04d0 2024-09-12T00:20:55.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9820 con 0x5558b03d04d0 2024-09-12T00:20:55.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.888+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9860 con 0x5558b03d04d0 2024-09-12T00:20:55.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.892+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.892+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9860 con 0x5558b03d04d0 2024-09-12T00:20:55.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.892+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'62 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.892+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e98a0 con 0x7f6a140f8040 2024-09-12T00:20:55.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.896+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.896+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e98e0 con 0x5558b03d04d0 2024-09-12T00:20:55.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.896+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.896+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e98e0 con 0x7f6a140f8040 2024-09-12T00:20:55.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.900+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.900+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e98e0 con 0x5558b03d04d0 2024-09-12T00:20:55.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.900+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'76 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.900+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e98e0 con 0x7f6a140f8040 2024-09-12T00:20:55.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.904+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.904+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e9920 con 0x7f6a1c021020 2024-09-12T00:20:55.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f68d97e2640 20 reqs_thread_entry: start 2024-09-12T00:20:55.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:55.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 Filter name: none 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f684affd640 20 reqs_thread_entry: start 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b03e7840 con 0x5558b03cbb00 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T00:20:55.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T00:20:55.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T00:20:55.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:55.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0407530 con 0x7f6a1c021020 2024-09-12T00:20:55.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 : miss 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:96 8.0 8:01b20aad:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04072a0 con 0x5558b03d04d0 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(96 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 info.flags=0x17 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 to cache LRU end 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:55.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T00:20:55.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 2024-09-12T00:20:55.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.908+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 4.d 4:b12c88e6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484760 con 0x5558b03d04d0 2024-09-12T00:20:55.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(97 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 4.6 4:6136a2da:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484760 con 0x5558b03d04d0 2024-09-12T00:20:55.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(98 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 4.0 4:01eb4836:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04847a0 con 0x5558b03d04d0 2024-09-12T00:20:55.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(99 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:100 4.29 4:950076ed:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04847a0 con 0x5558b03d04d0 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(100 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:101 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04847a0 con 0x7f6a140f8040 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(101 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [call out=429b] v0'0 uv7 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T00:20:55.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.912+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:102 4.e 4:70824f5d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x7f6a1c021020 2024-09-12T00:20:55.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(102 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:103 4.a 4:52db5cb8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x7f6a1c021020 2024-09-12T00:20:55.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(103 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:104 4.c 4:336ce2c1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x5558b03cbb00 2024-09-12T00:20:55.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(104 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c02a040 con 0x5558b03cbb00 2024-09-12T00:20:55.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:105 4.1b 4:d817dad7:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x7f6a1c021020 2024-09-12T00:20:55.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(105 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:106 4.24 4:263963b4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x7f6a140f8040 2024-09-12T00:20:55.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(106 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:107 4.0 4:03a24b76:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484de0 con 0x5558b03d04d0 2024-09-12T00:20:55.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(107 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 20 get_obj_state: octx=0x7f6a140d6040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5558b0482dd8 s->prefetch_data=0 2024-09-12T00:20:55.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.916+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:108 3.27s0 3:e6fd8630:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0483cc0 con 0x7f6a140f8040 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(108 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 10 manifest: total_size = 6 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 20 get_obj_state: setting s->obj_tag to 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.5922450804051778763 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 20 get_obj_state: octx=0x7f6a140d6040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5558b0482dd8 s->prefetch_data=0 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 20 prepare_atomic_modification: state is not atomic. state=0x5558b0482dd8 2024-09-12T00:20:55.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 20 bucket index object: :.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 2024-09-12T00:20:55.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:109 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484220 con 0x7f6a140f8040 2024-09-12T00:20:55.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(109 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.920+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 3.27s0 3:e6fd8630:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b0484220 con 0x7f6a140f8040 2024-09-12T00:20:55.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(110 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6a0c02a040 con 0x7f6a140f8040 2024-09-12T00:20:55.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c500 con 0x7f6a140f8040 2024-09-12T00:20:55.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:112 4.d 4:b12c88e6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c500 con 0x5558b03d04d0 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:113 4.6 4:6136a2da:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04830a0 con 0x5558b03d04d0 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(112 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:114 4.0 4:01eb4836:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c500 con 0x5558b03d04d0 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:115 4.29 4:950076ed:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0413310 con 0x5558b03d04d0 2024-09-12T00:20:55.931 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:116 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c500 con 0x7f6a140f8040 2024-09-12T00:20:55.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:117 4.e 4:70824f5d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04830e0 con 0x7f6a1c021020 2024-09-12T00:20:55.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:118 4.a 4:52db5cb8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04830e0 con 0x7f6a1c021020 2024-09-12T00:20:55.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:119 4.c 4:336ce2c1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041cd60 con 0x5558b03cbb00 2024-09-12T00:20:55.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(113 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:120 4.1b 4:d817dad7:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041fb90 con 0x7f6a1c021020 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(114 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(115 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:121 4.24 4:263963b4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x7f6a140f8040 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 4.0 4:03a24b76:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04112f0 con 0x5558b03d04d0 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(117 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(119 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(120 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.924+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(118 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(122 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(121 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(111 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [stat,call,call] v33'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6902ffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(116 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:20:55.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 4.d 4:b12c88e6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x5558b03d04d0 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:124 4.6 4:6136a2da:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041f540 con 0x5558b03d04d0 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:125 4.0 4:01eb4836:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04127e0 con 0x5558b03d04d0 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:126 4.29 4:950076ed:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x5558b03d04d0 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:127 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041c870 con 0x7f6a140f8040 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:128 4.e 4:70824f5d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04127e0 con 0x7f6a1c021020 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:129 4.a 4:52db5cb8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x7f6a1c021020 2024-09-12T00:20:55.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:130 4.c 4:336ce2c1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041c870 con 0x5558b03cbb00 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:131 4.1b 4:d817dad7:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x7f6a1c021020 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:132 4.24 4:263963b4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0482c40 con 0x7f6a140f8040 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(123 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(128 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(129 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(131 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8 [call out=89b] v0'0 uv11 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:133 4.0 4:03a24b76:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04112f0 con 0x5558b03d04d0 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(127 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(130 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(125 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(126 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== osd_op_reply(124 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(133 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(132 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.928+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c030 con 0x7f6a1c021020 2024-09-12T00:20:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(134 foo.buckets [call] v33'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.943 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b040c030 con 0x7f6a1c021020 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T00:20:55.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.932+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b0415710 con 0x7f6a1c021020 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(136 myfoo [call,call,delete] v33'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93839403000512 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b041f410 con 0x7f6a140f8040 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== watch-notify(notify (1) cookie 93839402315568 notify 141733920811 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5558b03e8430 con 0x7f6a140f8040 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f69037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 93839402315568 notifier 4781 bl.length()=149 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f69037fe640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68e8003d70 con 0x7f6a140f8040 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(137 notify.6 [notify cookie 93839403000512 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== watch-notify(notify_complete (2) cookie 93839403000512 notify 141733920811 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558b03c0d60 con 0x7f6a140f8040 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:139 8.0 8:01b20aad:root::.bucket.meta.myfoo%3a631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03d04d0 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(139 .bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 [call,call,delete] v33'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 from cache 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7, ofs0, ns] 2024-09-12T00:20:55.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.936+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93839402496528 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== watch-notify(notify (1) cookie 93839402315568 notify 141733920812 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5558b03c0d60 con 0x7f6a140f8040 2024-09-12T00:20:55.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6902ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920812 cookie 93839402315568 notifier 4781 bl.length()=206 2024-09-12T00:20:55.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(140 notify.6 [notify cookie 93839402496528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6902ffd640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68580032d0 con 0x7f6a140f8040 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== watch-notify(notify_complete (2) cookie 93839402496528 notify 141733920812 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558b03e18c0 con 0x7f6a140f8040 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:142 4.d 4:b12c88e6:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03d04d0 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:143 4.6 4:6136a2da:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b041f390 con 0x5558b03d04d0 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:144 4.0 4:01eb4836:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04117d0 con 0x5558b03d04d0 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:145 4.29 4:950076ed:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04120a0 con 0x5558b03d04d0 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:146 4.1e 4:78b53b0f:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b0405b80 con 0x7f6a140f8040 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:147 4.e 4:70824f5d:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:148 4.a 4:52db5cb8:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04117d0 con 0x7f6a1c021020 2024-09-12T00:20:55.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:149 4.c 4:336ce2c1:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b0405b80 con 0x5558b03cbb00 2024-09-12T00:20:55.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:150 4.1b 4:d817dad7:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:151 4.24 4:263963b4:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04117d0 con 0x7f6a140f8040 2024-09-12T00:20:55.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.940+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:152 4.0 4:03a24b76:::.dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03d04d0 2024-09-12T00:20:55.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(146 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.4 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== osd_op_reply(142 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.0 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(144 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.2 [delete] v33'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 47 ==== osd_op_reply(143 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.1 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(150 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.8 [delete] v33'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(148 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.6 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 48 ==== osd_op_reply(145 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.3 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(149 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.7 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(151 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.9 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 49 ==== osd_op_reply(152 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.10 [delete] v33'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(147 .dir.631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7.5 [delete] v33'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 : miss 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:153 6.8 6:1585e63d:::pubsub..bucket.myfoo%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b0405b80 con 0x5558b03d04d0 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 50 ==== osd_op_reply(153 pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 info.flags=0x0 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 10 adding default.rgw.log++pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 to cache LRU end 2024-09-12T00:20:55.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.944+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:154 6.8 6:1585e63d:::pubsub..bucket.myfoo%2f631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03d04d0 2024-09-12T00:20:55.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.948+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 51 ==== osd_op_reply(154 pubsub..bucket.myfoo/631e6d39-d415-492d-aa86-21cdd5f9473d.4229.7 [delete] v33'47 uv39 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.948+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.948+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(155 foo.buckets [call] v33'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.948+0000 7f6a268e09c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-12T00:20:55.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.948+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T00:20:55.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 93839402496480 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== watch-notify(notify (1) cookie 93839402303952 notify 141733920787 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5558b03e87b0 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f69037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 93839402303952 notifier 4781 bl.length()=170 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(157 notify.3 [notify cookie 93839402496480 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f69037fe640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68e8003d70 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== watch-notify(notify_complete (2) cookie 93839402496480 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6a14100060 con 0x7f6a1c021020 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a268e09c0 10 removing email index: foo@foo.com 2024-09-12T00:20:55.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.952+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(159 foo@foo.com [delete] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T00:20:55.960 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 93839402496480 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== watch-notify(notify (1) cookie 93839402303952 notify 141733920788 ret 0) ==== 204+0+0 (crc 0 0 0) 0x7f6a14100060 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6902ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 93839402303952 notifier 4781 bl.length()=162 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(160 notify.3 [notify cookie 93839402496480 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6902ffd640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68580032d0 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 42 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 43 ==== watch-notify(notify_complete (2) cookie 93839402496480 notify 141733920788 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558b0392e60 con 0x7f6a1c021020 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 10 removing user buckets index 2024-09-12T00:20:55.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 44 ==== osd_op_reply(162 foo.buckets [delete] v33'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-12T00:20:55.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.956+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93839402496480 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== watch-notify(notify (1) cookie 93839402309104 notify 141733920813 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5558b03e18c0 con 0x7f6a140f8040 2024-09-12T00:20:55.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6902ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920813 cookie 93839402309104 notifier 4781 bl.length()=160 2024-09-12T00:20:55.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(163 notify.5 [notify cookie 93839402496480 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6902ffd640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68580032d0 con 0x7f6a140f8040 2024-09-12T00:20:55.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== watch-notify(notify_complete (2) cookie 93839402496480 notify 141733920813 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558b03e15f0 con 0x7f6a140f8040 2024-09-12T00:20:55.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a268e09c0 10 removing user index: foo 2024-09-12T00:20:55.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(165 foo [call,call,delete] v33'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a268e09c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-12T00:20:55.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a268e09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T00:20:55.967 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 93839402496480 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== watch-notify(notify (1) cookie 93839402307488 notify 141733920798 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5558b03e15f0 con 0x5558b03cbb00 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f69037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 93839402307488 notifier 4781 bl.length()=152 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f69037fe640 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f68e8003d70 con 0x5558b03cbb00 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.960+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(166 notify.4 [notify cookie 93839402496480 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== watch-notify(notify_complete (2) cookie 93839402496480 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558b03e8120 con 0x5558b03cbb00 2024-09-12T00:20:55.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f68da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:55.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93839402316912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 93839402316912] v33'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.964+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93839402297440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.968+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 45 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 93839402297440] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.968+0000 7f6a268e09c0 20 remove_watcher() i=0 2024-09-12T00:20:55.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.968+0000 7f6a268e09c0 2 removed watcher, disabling cache 2024-09-12T00:20:55.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.968+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93839402301744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 93839402301744] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a268e09c0 20 remove_watcher() i=1 2024-09-12T00:20:55.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93839402305152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03d04d0 2024-09-12T00:20:55.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a24be7640 1 -- 172.21.15.66:0/2297195115 <== osd.3 v2:172.21.15.66:6816/2782209626 52 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 93839402305152] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a1c03b020 con 0x5558b03d04d0 2024-09-12T00:20:55.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a268e09c0 20 remove_watcher() i=2 2024-09-12T00:20:55.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.972+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93839402303952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a1c021020 2024-09-12T00:20:55.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a243e6640 1 -- 172.21.15.66:0/2297195115 <== osd.2 v2:172.21.15.66:6800/1272812173 46 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 93839402303952] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a140cf070 con 0x7f6a1c021020 2024-09-12T00:20:55.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a268e09c0 20 remove_watcher() i=3 2024-09-12T00:20:55.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93839402307488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x5558b03cbb00 2024-09-12T00:20:55.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 93839402307488] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x5558b03cbb00 2024-09-12T00:20:55.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a268e09c0 20 remove_watcher() i=4 2024-09-12T00:20:55.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.976+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93839402309104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 93839402309104] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a268e09c0 20 remove_watcher() i=5 2024-09-12T00:20:55.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93839402315568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 93839402315568] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a268e09c0 20 remove_watcher() i=6 2024-09-12T00:20:55.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.980+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93839402319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5558b04822c0 con 0x7f6a140f8040 2024-09-12T00:20:55.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 93839402319888] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a0c043040 con 0x7f6a140f8040 2024-09-12T00:20:55.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 20 remove_watcher() i=7 2024-09-12T00:20:55.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6a140f8040 msgr2=0x7f6a140eb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f6a140f8040 0x7f6a140eb050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b03cbb00 msgr2=0x5558b03cdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b03cbb00 0x5558b03cdf90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6a1c021020 msgr2=0x7f6a1c047a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f6a1c021020 0x7f6a1c047a50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b03d04d0 msgr2=0x5558b03d28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b03d04d0 0x5558b03d28c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68f4039a70 msgr2=0x7f68f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68f4039a70 0x7f68f403bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6a140b5fa0 tx=0x7f6a140e7000 comp rx=0 tx=0).stop 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 msgr2=0x5558b03c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a23be5640 1 -- 172.21.15.66:0/2297195115 reap_dead start 2024-09-12T00:20:55.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c043150 tx=0x7f6a1c050090 comp rx=0 tx=0).stop 2024-09-12T00:20:55.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 shutdown_connections 2024-09-12T00:20:55.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/2297195115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ba0e0 0x5558b03c0570 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 >> 172.21.15.66:0/2297195115 conn(0x5558b03b5500 msgr2=0x5558b03b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 shutdown_connections 2024-09-12T00:20:55.992 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/2297195115 wait complete. 2024-09-12T00:20:55.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 msgr2=0x7f68fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 0x7f68fc03bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6a140bdb50 tx=0x7f6a140b5ed0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 msgr2=0x5558b03acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x5558b0393050 tx=0x7f6a1c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:55.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 shutdown_connections 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f68fc039a70 0x7f68fc03bf30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1758451034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b03ac7d0 0x5558b03acbf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 >> 172.21.15.66:0/1758451034 conn(0x5558b03a2180 msgr2=0x5558b03a2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 shutdown_connections 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.984+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1758451034 wait complete. 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 msgr2=0x5558b0398e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 0x5558b0398e30 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 msgr2=0x5558b039da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 0x5558b039da00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 msgr2=0x7f690c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 0x7f690c03bf30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c001ec0 tx=0x7f6a0c001440 comp rx=0 tx=0).stop 2024-09-12T00:20:55.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 msgr2=0x5558b0391d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6a1401b930 tx=0x7f6a14017e30 comp rx=0 tx=0).stop 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 shutdown_connections 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5558b039b610 0x5558b039da00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5558b02a1550 0x5558b0398e30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f690c039a70 0x7f690c03bf30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 --2- 172.21.15.66:0/1851427193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5558b029e370 0x5558b0391d10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 >> 172.21.15.66:0/1851427193 conn(0x5558b0299e90 msgr2=0x5558b0383dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 shutdown_connections 2024-09-12T00:20:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:55.988+0000 7f6a268e09c0 1 -- 172.21.15.66:0/1851427193 wait complete. 2024-09-12T00:20:56.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T00:20:56.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T00:20:56.007 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T00:20:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.090 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.084+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.084+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.084+0000 7f5e4ebca9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5555a9214670 0x5555a9216a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.084+0000 7f5e4ebca9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555a90c69c0 con 0x5555a91867b0 2024-09-12T00:20:56.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.084+0000 7f5e4ebca9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5555a91166d0 con 0x5555a9214670 2024-09-12T00:20:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4becf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5555a9214670 0x5555a9216a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4c6d0640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5555a91867b0 0x5555a9212f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:51496/0 (socket says 172.21.15.66:51496) 2024-09-12T00:20:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4becf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5555a9214670 0x5555a9216a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56702/0 (socket says 172.21.15.66:56702) 2024-09-12T00:20:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/3548718962 learned_addr learned my addr 172.21.15.66:0/3548718962 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:56.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4becf640 1 -- 172.21.15.66:0/3548718962 >> v1:172.21.15.31:6789/0 conn(0x5555a91867b0 legacy=0x5555a9212f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4becf640 1 -- 172.21.15.66:0/3548718962 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a90baca0 con 0x5555a9214670 2024-09-12T00:20:56.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4becf640 1 --2- 172.21.15.66:0/3548718962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9214670 0x5555a9216a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400a480 tx=0x7f5e3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e372a2cc68752e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4b6ce640 1 -- 172.21.15.66:0/3548718962 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e340af070 con 0x5555a9214670 2024-09-12T00:20:56.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4b6ce640 1 -- 172.21.15.66:0/3548718962 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e340aa530 con 0x5555a9214670 2024-09-12T00:20:56.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4b6ce640 1 -- 172.21.15.66:0/3548718962 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e340aa830 con 0x5555a9214670 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/3548718962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9214670 msgr2=0x5555a9216a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/3548718962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9214670 0x5555a9216a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400a480 tx=0x7f5e3401b280 comp rx=0 tx=0).stop 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/3548718962 shutdown_connections 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.088+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/3548718962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9214670 0x5555a9216a90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.092+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/3548718962 >> 172.21.15.66:0/3548718962 conn(0x5555a920ce90 msgr2=0x5555a920f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.092+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/3548718962 shutdown_connections 2024-09-12T00:20:56.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.092+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/3548718962 wait complete. 2024-09-12T00:20:56.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555a911a680 con 0x5555a91867b0 2024-09-12T00:20:56.113 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4c6d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4c6d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56718/0 (socket says 172.21.15.66:56718) 2024-09-12T00:20:56.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1276399882 learned_addr learned my addr 172.21.15.66:0/1276399882 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1276399882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a9095da0 con 0x5555a91867b0 2024-09-12T00:20:56.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1276399882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c001810 tx=0x7f5e3c001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1eb96e37c79434 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5d3a60c640 1 -- 172.21.15.66:0/1276399882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c004530 con 0x5555a91867b0 2024-09-12T00:20:56.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5d3a60c640 1 -- 172.21.15.66:0/1276399882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0046d0 con 0x5555a91867b0 2024-09-12T00:20:56.115 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5d3a60c640 1 -- 172.21.15.66:0/1276399882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c0049f0 con 0x5555a91867b0 2024-09-12T00:20:56.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1276399882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 msgr2=0x5555a9304510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1276399882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c001810 tx=0x7f5e3c001cd0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1276399882 shutdown_connections 2024-09-12T00:20:56.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1276399882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a9304510 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1276399882 >> 172.21.15.66:0/1276399882 conn(0x5555a920ce90 msgr2=0x5555a9300150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1276399882 shutdown_connections 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.108+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1276399882 wait complete. 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555a90bca50 con 0x5555a91867b0 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4c6d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4c6d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56732/0 (socket says 172.21.15.66:56732) 2024-09-12T00:20:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1716000803 learned_addr learned my addr 172.21.15.66:0/1716000803 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a930c0e0 con 0x5555a91867b0 2024-09-12T00:20:56.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000f90 tx=0x7f5e3c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 -- 172.21.15.66:0/1716000803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c013820 con 0x5555a91867b0 2024-09-12T00:20:56.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a930c370 con 0x5555a91867b0 2024-09-12T00:20:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 -- 172.21.15.66:0/1716000803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0139c0 con 0x5555a91867b0 2024-09-12T00:20:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 -- 172.21.15.66:0/1716000803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c013ce0 con 0x5555a91867b0 2024-09-12T00:20:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a930cd20 con 0x5555a91867b0 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 -- 172.21.15.66:0/1716000803 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5e3c010070 con 0x5555a91867b0 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 0x7f5d3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5d38e09640 1 -- 172.21.15.66:0/1716000803 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5e3c018070 con 0x5555a91867b0 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.112+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 0x7f5d3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 0x5555a9312cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9313230 con 0x5555a9214670 2024-09-12T00:20:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 0x5555a9312cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 0x7f5d3403bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e340ac000 tx=0x7f5e340a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 0x5555a9312cf0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1716000803 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e440083f0 con 0x5555a9214670 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9313660 con 0x5555a9214670 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1716000803 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e440083f0 con 0x5555a9214670 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 0x5555a9317860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9317f30 con 0x5555a9315470 2024-09-12T00:20:56.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 0x5555a9317860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 0x5555a9317860 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1716000803 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e3c01b030 con 0x5555a9315470 2024-09-12T00:20:56.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9314310 con 0x5555a9214670 2024-09-12T00:20:56.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1716000803 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e440083f0 con 0x5555a9214670 2024-09-12T00:20:56.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a93147f0 con 0x5555a9315470 2024-09-12T00:20:56.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1716000803 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e3c01b030 con 0x5555a9315470 2024-09-12T00:20:56.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.116+0000 7f5e4ebca9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555a9127450 con 0x5555a9326680 2024-09-12T00:20:56.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56748/0 (socket says 172.21.15.66:56748) 2024-09-12T00:20:56.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1616266419 learned_addr learned my addr 172.21.15.66:0/1616266419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1616266419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a93270e0 con 0x5555a9326680 2024-09-12T00:20:56.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x5555a930ca40 tx=0x7f5e4400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 -- 172.21.15.66:0/1616266419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e4401c020 con 0x5555a9326680 2024-09-12T00:20:56.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 -- 172.21.15.66:0/1616266419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e44007d00 con 0x5555a9326680 2024-09-12T00:20:56.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a9327940 con 0x5555a9326680 2024-09-12T00:20:56.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 -- 172.21.15.66:0/1616266419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44018440 con 0x5555a9326680 2024-09-12T00:20:56.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a9327eb0 con 0x5555a9326680 2024-09-12T00:20:56.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 -- 172.21.15.66:0/1616266419 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5e4401f020 con 0x5555a9326680 2024-09-12T00:20:56.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 0x7f5d2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5d31ffb640 1 -- 172.21.15.66:0/1616266419 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5e44051d90 con 0x5555a9326680 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 0x7f5d2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 0x7f5d2403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02afd0 tx=0x7f5e3c04e9d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ebca9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555a9304d60 con 0x5555a9334010 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56756/0 (socket says 172.21.15.66:56756) 2024-09-12T00:20:56.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.120+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1654200074 learned_addr learned my addr 172.21.15.66:0/1654200074 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1654200074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a9334a00 con 0x5555a9334010 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1654200074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e44021fd0 tx=0x7f5e440168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc6b69aaae32e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d2b7fe640 1 -- 172.21.15.66:0/1654200074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44021400 con 0x5555a9334010 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d2b7fe640 1 -- 172.21.15.66:0/1654200074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e44029350 con 0x5555a9334010 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d2b7fe640 1 -- 172.21.15.66:0/1654200074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e440215a0 con 0x5555a9334010 2024-09-12T00:20:56.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1654200074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 msgr2=0x5555a9334410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1654200074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5e44021fd0 tx=0x7f5e440168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1654200074 shutdown_connections 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1654200074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a9334410 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1654200074 >> 172.21.15.66:0/1654200074 conn(0x5555a932f430 msgr2=0x5555a932d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1654200074 shutdown_connections 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1654200074 wait complete. 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 Processor -- start 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- start start 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5555a9332f60 con 0x5555a9334010 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56758/0 (socket says 172.21.15.66:56758) 2024-09-12T00:20:56.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 learned_addr learned my addr 172.21.15.66:0/1193438224 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a933a9f0 con 0x5555a9334010 2024-09-12T00:20:56.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5e44021fd0 tx=0x7f5e44050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d29ffb640 1 -- 172.21.15.66:0/1193438224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e44016e00 con 0x5555a9334010 2024-09-12T00:20:56.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d29ffb640 1 -- 172.21.15.66:0/1193438224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e44028bd0 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a933ac80 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5d29ffb640 1 -- 172.21.15.66:0/1193438224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e440203b0 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.124+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a933b630 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5d29ffb640 1 -- 172.21.15.66:0/1193438224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5e44016040 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5d29ffb640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d1c039a70 0x7f5d1c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5d29ffb640 1 -- 172.21.15.66:0/1193438224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5e44032070 con 0x5555a9334010 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d1c039a70 0x7f5d1c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9345a60 0x5555a9347ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9348640 con 0x5555a9345a60 2024-09-12T00:20:56.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9345a60 0x5555a9347ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d1c039a70 0x7f5d1c03bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0104d0 tx=0x7f5e3c021000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9345a60 0x5555a9347ef0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 realm 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9348a10 con 0x5555a9345a60 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a93492e0 con 0x5555a9345a60 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9349680 con 0x5555a9345a60 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a934a170 0x5555a934c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a934ccc0 con 0x5555a934a170 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.128+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a934a170 0x5555a934c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a934a170 0x5555a934c560 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ebca9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ebca9c0 20 searching for the correct realm 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ced1640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5e44021020 0x7f5e4402a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5e44021020 0x7f5e4402a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5e44021020 0x7f5e4402a3e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4c6d0640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5e3c04d070 0x7f5e3c011940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5e3c04d070 0x7f5e3c011940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5e3c04d070 0x7f5e3c011940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.132+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.145 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.136+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.140+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a934a170 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e3c04d070 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x5555a9345a60 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5555a934e5c0 con 0x7f5e44021020 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:56.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a934d6b0 con 0x5555a9345a60 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a934df50 con 0x5555a9345a60 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a934d2f0 con 0x5555a934a170 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.144+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 zone default found 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 4 Realm: () 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 zonegroup default 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a934db80 con 0x7f5e3c04d070 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a93509c0 con 0x5555a934a170 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a9350e30 con 0x5555a934a170 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 started sync module instance, tier type = 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:56.157 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a934fe30 con 0x7f5e44021020 2024-09-12T00:20:56.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.158 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826399402368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9351270 con 0x7f5e44021020 2024-09-12T00:20:56.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.148+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9351ac0 con 0x5555a9345a60 2024-09-12T00:20:56.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826399402368] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826399408752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9351b40 con 0x5555a9345a60 2024-09-12T00:20:56.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9352390 con 0x5555a934a170 2024-09-12T00:20:56.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826399411280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9352700 con 0x5555a934a170 2024-09-12T00:20:56.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9353200 con 0x7f5e44021020 2024-09-12T00:20:56.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.152+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826399408752] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826399415536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a93531c0 con 0x7f5e44021020 2024-09-12T00:20:56.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9353be0 con 0x5555a9345a60 2024-09-12T00:20:56.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826399411280] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826399415536] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826399409808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9353ba0 con 0x5555a9345a60 2024-09-12T00:20:56.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.156+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9354480 con 0x7f5e3c04d070 2024-09-12T00:20:56.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826399409808] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826399418064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9354050 con 0x7f5e3c04d070 2024-09-12T00:20:56.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9354a10 con 0x7f5e3c04d070 2024-09-12T00:20:56.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826399418064] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826399419568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9354a10 con 0x7f5e3c04d070 2024-09-12T00:20:56.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.160+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a93553d0 con 0x7f5e3c04d070 2024-09-12T00:20:56.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826399419568] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826399422064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a93553d0 con 0x7f5e3c04d070 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=0 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=1 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=2 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=3 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=4 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=5 2024-09-12T00:20:56.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.164+0000 7f5e4ebca9c0 20 add_watcher() i=6 2024-09-12T00:20:56.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826399422064] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340b2040 con 0x7f5e3c04d070 2024-09-12T00:20:56.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 add_watcher() i=7 2024-09-12T00:20:56.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:56.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a93586f0 con 0x5555a9345a60 2024-09-12T00:20:56.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e340b2040 con 0x5555a9345a60 2024-09-12T00:20:56.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826399424656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9355960 con 0x5555a9345a60 2024-09-12T00:20:56.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826399424656] v33'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x5555a9345a60 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5d027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 5 note: GC not initialized 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5d017e2640 20 reqs_thread_entry: start 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:56.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 Filter name: none 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5c72ffd640 20 reqs_thread_entry: start 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5555a937b8d0 con 0x5555a9345a60 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x5555a9345a60 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.168+0000 7f5e4ebca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:56.176 INFO:teuthology.orchestra.run.smithi066.stderr:could not fetch user info: no user info saved 2024-09-12T00:20:56.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5d027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:56.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826399424656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a937b890 con 0x5555a9345a60 2024-09-12T00:20:56.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93826399424656] v33'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x5555a9345a60 2024-09-12T00:20:56.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826399402368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x7f5e44021020 2024-09-12T00:20:56.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93826399402368] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4ebca9c0 20 remove_watcher() i=0 2024-09-12T00:20:56.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4ebca9c0 2 removed watcher, disabling cache 2024-09-12T00:20:56.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.172+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826399408752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x5555a9345a60 2024-09-12T00:20:56.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93826399408752] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x5555a9345a60 2024-09-12T00:20:56.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4ebca9c0 20 remove_watcher() i=1 2024-09-12T00:20:56.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826399411280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x5555a934a170 2024-09-12T00:20:56.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4ced1640 1 -- 172.21.15.66:0/1193438224 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93826399411280] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e4403c020 con 0x5555a934a170 2024-09-12T00:20:56.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4ebca9c0 20 remove_watcher() i=2 2024-09-12T00:20:56.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.176+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826399415536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x7f5e44021020 2024-09-12T00:20:56.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4c6d0640 1 -- 172.21.15.66:0/1193438224 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93826399415536] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e3c01b030 con 0x7f5e44021020 2024-09-12T00:20:56.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4ebca9c0 20 remove_watcher() i=3 2024-09-12T00:20:56.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826399409808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x5555a9345a60 2024-09-12T00:20:56.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93826399409808] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x5555a9345a60 2024-09-12T00:20:56.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4ebca9c0 20 remove_watcher() i=4 2024-09-12T00:20:56.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.180+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826399418064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x7f5e3c04d070 2024-09-12T00:20:56.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93826399418064] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x7f5e3c04d070 2024-09-12T00:20:56.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4ebca9c0 20 remove_watcher() i=5 2024-09-12T00:20:56.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826399419568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x7f5e3c04d070 2024-09-12T00:20:56.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93826399419568] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x7f5e3c04d070 2024-09-12T00:20:56.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4ebca9c0 20 remove_watcher() i=6 2024-09-12T00:20:56.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.184+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826399422064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5555a9379700 con 0x7f5e3c04d070 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93826399422064] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e340d6040 con 0x7f5e3c04d070 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 20 remove_watcher() i=7 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5e3c04d070 msgr2=0x7f5e3c011940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f5e3c04d070 0x7f5e3c011940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9345a60 msgr2=0x5555a9347ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9345a60 0x5555a9347ef0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5e44021020 msgr2=0x7f5e4402a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5e44021020 0x7f5e4402a3e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a934a170 msgr2=0x5555a934c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a934a170 0x5555a934c560 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d1c039a70 msgr2=0x7f5d1c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d1c039a70 0x7f5d1c03bf30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0104d0 tx=0x7f5e3c021000 comp rx=0 tx=0).stop 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4becf640 1 -- 172.21.15.66:0/1193438224 reap_dead start 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 msgr2=0x5555a933a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5e44021fd0 tx=0x7f5e44050040 comp rx=0 tx=0).stop 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 shutdown_connections 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1193438224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9334010 0x5555a933a490 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 >> 172.21.15.66:0/1193438224 conn(0x5555a932f430 msgr2=0x5555a932d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 shutdown_connections 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1193438224 wait complete. 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 msgr2=0x7f5d2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 0x7f5d2403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c02afd0 tx=0x7f5e3c04e9d0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 msgr2=0x5555a9326aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x5555a930ca40 tx=0x7f5e4400bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 shutdown_connections 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d24039a70 0x7f5d2403bf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1616266419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a9326680 0x5555a9326aa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 >> 172.21.15.66:0/1616266419 conn(0x5555a931c030 msgr2=0x5555a931c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 shutdown_connections 2024-09-12T00:20:56.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1616266419 wait complete. 2024-09-12T00:20:56.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 msgr2=0x5555a9312cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 0x5555a9312cf0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 msgr2=0x5555a9317860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 0x5555a9317860 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 msgr2=0x7f5d3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 0x7f5d3403bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e340ac000 tx=0x7f5e340a5000 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 msgr2=0x5555a930bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c000f90 tx=0x7f5e3c001260 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 shutdown_connections 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5555a9315470 0x5555a9317860 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5555a9214670 0x5555a9312cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5d34039a70 0x7f5d3403bf30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 --2- 172.21.15.66:0/1716000803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555a91867b0 0x5555a930bb80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.188+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 >> 172.21.15.66:0/1716000803 conn(0x5555a920ce90 msgr2=0x5555a92febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.192+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 shutdown_connections 2024-09-12T00:20:56.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.192+0000 7f5e4ebca9c0 1 -- 172.21.15.66:0/1716000803 wait complete. 2024-09-12T00:20:56.207 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T00:20:56.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-12T00:20:56.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-12T00:20:56.207 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-12T00:20:56.292 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.292 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0ebb1e19c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b9d16f990 0x562b9d16fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0ebb1e19c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b9d0ad9c0 con 0x562b9d16e390 2024-09-12T00:20:56.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0ebb1e19c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x562b9d0fd6d0 con 0x562b9d16f990 2024-09-12T00:20:56.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb8ce7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b9d16f990 0x562b9d16fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb8ce7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562b9d16f990 0x562b9d16fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56774/0 (socket says 172.21.15.66:56774) 2024-09-12T00:20:56.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb3fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x562b9d16e390 0x562b9d16e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:51498/0 (socket says 172.21.15.66:51498) 2024-09-12T00:20:56.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/3924983201 learned_addr learned my addr 172.21.15.66:0/3924983201 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/3924983201 >> v1:172.21.15.31:6789/0 conn(0x562b9d16e390 legacy=0x562b9d16e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.288+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/3924983201 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d0a1ca0 con 0x562b9d16f990 2024-09-12T00:20:56.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/3924983201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16f990 0x562b9d16fd70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a5c0 tx=0x7f0eac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243bb51b86f014ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0eb37fe640 1 -- 172.21.15.66:0/3924983201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0a6070 con 0x562b9d16f990 2024-09-12T00:20:56.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0eb37fe640 1 -- 172.21.15.66:0/3924983201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac0af070 con 0x562b9d16f990 2024-09-12T00:20:56.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0eb37fe640 1 -- 172.21.15.66:0/3924983201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0aa5c0 con 0x562b9d16f990 2024-09-12T00:20:56.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3924983201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16f990 msgr2=0x562b9d16fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3924983201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16f990 0x562b9d16fd70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a5c0 tx=0x7f0eac01b340 comp rx=0 tx=0).stop 2024-09-12T00:20:56.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3924983201 shutdown_connections 2024-09-12T00:20:56.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3924983201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16f990 0x562b9d16fd70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3924983201 >> 172.21.15.66:0/3924983201 conn(0x562b9d1f5080 msgr2=0x562b9d1f74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3924983201 shutdown_connections 2024-09-12T00:20:56.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.292+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3924983201 wait complete. 2024-09-12T00:20:56.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.308+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.308+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.308+0000 7f0ebb1e19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.308+0000 7f0ebb1e19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b9d101680 con 0x562b9d16e390 2024-09-12T00:20:56.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:56778/0 (socket says 172.21.15.66:56778) 2024-09-12T00:20:56.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/4010679180 learned_addr learned my addr 172.21.15.66:0/4010679180 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/4010679180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d07cda0 con 0x562b9d16e390 2024-09-12T00:20:56.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/4010679180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0eac018f70 tx=0x7f0eac002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b79c398a04bee31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0da6e05640 1 -- 172.21.15.66:0/4010679180 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0aa840 con 0x562b9d16e390 2024-09-12T00:20:56.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0da6e05640 1 -- 172.21.15.66:0/4010679180 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac0aaa00 con 0x562b9d16e390 2024-09-12T00:20:56.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0da6e05640 1 -- 172.21.15.66:0/4010679180 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0aad20 con 0x562b9d16e390 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4010679180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 msgr2=0x562b9d2e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4010679180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0eac018f70 tx=0x7f0eac002fc0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4010679180 shutdown_connections 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4010679180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2e6ed0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4010679180 >> 172.21.15.66:0/4010679180 conn(0x562b9d1f5080 msgr2=0x562b9d2e2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4010679180 shutdown_connections 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4010679180 wait complete. 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0ebb1e19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b9d0a3a50 con 0x562b9d16e390 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35414/0 (socket says 172.21.15.66:35414) 2024-09-12T00:20:56.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.312+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/1627783365 learned_addr learned my addr 172.21.15.66:0/1627783365 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/1627783365 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d2ee960 con 0x562b9d16e390 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01b170 tx=0x562b9d16f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 -- 172.21.15.66:0/1627783365 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0cb020 con 0x562b9d16e390 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b9d2eebf0 con 0x562b9d16e390 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 -- 172.21.15.66:0/1627783365 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac0abea0 con 0x562b9d16e390 2024-09-12T00:20:56.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 -- 172.21.15.66:0/1627783365 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0c67a0 con 0x562b9d16e390 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9d2ef550 con 0x562b9d16e390 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b9d10e450 con 0x562b9d2fb8a0 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 -- 172.21.15.66:0/1627783365 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0eac0ce020 con 0x562b9d16e390 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb94e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb94e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35424/0 (socket says 172.21.15.66:35424) 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb94e8640 1 -- 172.21.15.66:0/2617643098 learned_addr learned my addr 172.21.15.66:0/2617643098 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 0x7f0da003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0da5602640 1 -- 172.21.15.66:0/1627783365 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0eac0eba20 con 0x562b9d16e390 2024-09-12T00:20:56.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 0x7f0da003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb94e8640 1 -- 172.21.15.66:0/2617643098 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d2fc270 con 0x562b9d2fb8a0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/2617643098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400a430 tx=0x7f0eb400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bce5800e0afba87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 0x7f0da003bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0c7c10 tx=0x7f0eac0c6e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0d9effd640 1 -- 172.21.15.66:0/2617643098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb400f6e0 con 0x562b9d2fb8a0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0d9effd640 1 -- 172.21.15.66:0/2617643098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb4015070 con 0x562b9d2fb8a0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0d9effd640 1 -- 172.21.15.66:0/2617643098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb400fa10 con 0x562b9d2fb8a0 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/2617643098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 msgr2=0x562b9d2fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/2617643098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400a430 tx=0x7f0eb400a8f0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/2617643098 shutdown_connections 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/2617643098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d2fbca0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/2617643098 >> 172.21.15.66:0/2617643098 conn(0x562b9d2f6a70 msgr2=0x562b9d2f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/2617643098 shutdown_connections 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.316+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/2617643098 wait complete. 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b9d2fc620 con 0x562b9d2fb8a0 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0eb94e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0eb94e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35436/0 (socket says 172.21.15.66:35436) 2024-09-12T00:20:56.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0eb94e8640 1 -- 172.21.15.66:0/4079879027 learned_addr learned my addr 172.21.15.66:0/4079879027 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0eb94e8640 1 -- 172.21.15.66:0/4079879027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d302e10 con 0x562b9d2fb8a0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400adf0 tx=0x7f0eb4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0d9d7fa640 1 -- 172.21.15.66:0/4079879027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4010a10 con 0x562b9d2fb8a0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b9d3030a0 con 0x562b9d2fb8a0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0d9d7fa640 1 -- 172.21.15.66:0/4079879027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb4020070 con 0x562b9d2fb8a0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0d9d7fa640 1 -- 172.21.15.66:0/4079879027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4010d40 con 0x562b9d2fb8a0 2024-09-12T00:20:56.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9d303a50 con 0x562b9d2fb8a0 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0d9d7fa640 1 -- 172.21.15.66:0/4079879027 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0eb401b420 con 0x562b9d2fb8a0 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 Processor -- start 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0ebb1e19c0 1 -- start start 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.320+0000 7f0d9d7fa640 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 0x7f0d9003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d9d7fa640 1 -- 172.21.15.66:0/4079879027 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0eb4050d50 con 0x562b9d2fb8a0 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562b9d2e7640 con 0x562b9d31c170 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 0x7f0d9003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb8ce7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35450/0 (socket says 172.21.15.66:35450) 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/3534392587 learned_addr learned my addr 172.21.15.66:0/3534392587 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 0x7f0d9003bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40104b0 tx=0x7f0eb4049040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/3534392587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9d31cb60 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0bc540 tx=0x7f0eac0e9c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 -- 172.21.15.66:0/3534392587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0bcbb0 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 -- 172.21.15.66:0/3534392587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac0f0070 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b9d31d430 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 -- 172.21.15.66:0/3534392587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac0bce80 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9d31d430 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 -- 172.21.15.66:0/3534392587 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0eac0a6750 con 0x562b9d31c170 2024-09-12T00:20:56.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 0x7f0cf003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0d7d7e2640 1 -- 172.21.15.66:0/3534392587 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0eac0e9e00 con 0x562b9d31c170 2024-09-12T00:20:56.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb3fff640 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 0x7f0cf003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0cfeffd640 20 reqs_thread_entry: start 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 0x562b9d323e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562b9d324520 con 0x562b9d321990 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb3fff640 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 0x7f0cf003be90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4001dc0 tx=0x7f0ea4001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.324+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 0x562b9d323e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0eb94e8640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 0x562b9d323e50 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0eb94e8640 1 -- 172.21.15.66:0/1627783365 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0eb400e070 con 0x562b9d321990 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 0x562b9d328730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:2 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562b9d328e00 con 0x562b9d326340 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 0x562b9d328730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0eb8ce7640 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 0x562b9d328730 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0eb8ce7640 1 -- 172.21.15.66:0/1627783365 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(2 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0eac0eb600 con 0x562b9d326340 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 msgr2=0x7f0d9003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 0x7f0d9003bf30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40104b0 tx=0x7f0eb4049040 comp rx=0 tx=0).stop 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 msgr2=0x562b9d3028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400adf0 tx=0x7f0eb4003380 comp rx=0 tx=0).stop 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 shutdown_connections 2024-09-12T00:20:56.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d90039a70 0x7f0d9003bf30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/4079879027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d2fb8a0 0x562b9d3028b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 >> 172.21.15.66:0/4079879027 conn(0x562b9d2f6a70 msgr2=0x562b9d2f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 shutdown_connections 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/4079879027 wait complete. 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 msgr2=0x7f0cf003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 0x7f0cf003be90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4001dc0 tx=0x7f0ea4001320 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 msgr2=0x562b9d31c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0bc540 tx=0x7f0eac0e9c50 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 shutdown_connections 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0cf00399d0 0x7f0cf003be90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/3534392587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d31c170 0x562b9d31c590 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 >> 172.21.15.66:0/3534392587 conn(0x562b9d311770 msgr2=0x562b9d311b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 shutdown_connections 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/3534392587 wait complete. 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 msgr2=0x562b9d323e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 0x562b9d323e50 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 msgr2=0x562b9d328730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 0x562b9d328730 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 msgr2=0x7f0da003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 0x7f0da003bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0c7c10 tx=0x7f0eac0c6e00 comp rx=0 tx=0).stop 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 msgr2=0x562b9d2ee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01b170 tx=0x562b9d16f2d0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 shutdown_connections 2024-09-12T00:20:56.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562b9d326340 0x562b9d328730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562b9d321990 0x562b9d323e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0da0039a70 0x7f0da003bf30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 --2- 172.21.15.66:0/1627783365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562b9d16e390 0x562b9d2ee400 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.328+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 >> 172.21.15.66:0/1627783365 conn(0x562b9d1f5080 msgr2=0x562b9d2e1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.332+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 shutdown_connections 2024-09-12T00:20:56.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.332+0000 7f0ebb1e19c0 1 -- 172.21.15.66:0/1627783365 wait complete. 2024-09-12T00:20:56.347 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:20:56.347 DEBUG:tasks.util.rgw: json result: {'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:20:56.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-12T00:20:56.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-12T00:20:56.348 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-12T00:20:56.429 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.429 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c5761c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b06ee35750 0x55b06ee35b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c5761c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b06ece79c0 con 0x55b06ee38890 2024-09-12T00:20:56.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c5761c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55b06ed376d0 con 0x55b06ee35750 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c55122640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b06ee35750 0x55b06ee35b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c55122640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55b06ee35750 0x55b06ee35b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35466/0 (socket says 172.21.15.66:35466) 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c55122640 1 -- 172.21.15.66:0/3205730417 learned_addr learned my addr 172.21.15.66:0/3205730417 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c54921640 1 --1- 172.21.15.66:0/3205730417 >> v1:172.21.15.31:6789/0 conn(0x55b06ee38890 0x55b06ee3ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41820/0 (socket says 172.21.15.66:41820) 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c55122640 1 -- 172.21.15.66:0/3205730417 >> v1:172.21.15.31:6789/0 conn(0x55b06ee38890 legacy=0x55b06ee3ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.424+0000 7f9c55122640 1 -- 172.21.15.66:0/3205730417 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ecdbca0 con 0x55b06ee35750 2024-09-12T00:20:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c55122640 1 --2- 172.21.15.66:0/3205730417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ee35b30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a5c0 tx=0x7f9c4801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7258a3cc69733f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c47fff640 1 -- 172.21.15.66:0/3205730417 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480a6070 con 0x55b06ee35750 2024-09-12T00:20:56.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c47fff640 1 -- 172.21.15.66:0/3205730417 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480af070 con 0x55b06ee35750 2024-09-12T00:20:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c47fff640 1 -- 172.21.15.66:0/3205730417 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480aa5c0 con 0x55b06ee35750 2024-09-12T00:20:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3205730417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 msgr2=0x55b06ee35b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3205730417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ee35b30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800a5c0 tx=0x7f9c4801b340 comp rx=0 tx=0).stop 2024-09-12T00:20:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3205730417 shutdown_connections 2024-09-12T00:20:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3205730417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ee35b30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3205730417 >> 172.21.15.66:0/3205730417 conn(0x55b06eda9060 msgr2=0x55b06eda9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3205730417 shutdown_connections 2024-09-12T00:20:56.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.428+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3205730417 wait complete. 2024-09-12T00:20:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c5761c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c5761c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b06ed3b680 con 0x55b06ee35750 2024-09-12T00:20:56.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35478/0 (socket says 172.21.15.66:35478) 2024-09-12T00:20:56.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c55122640 1 -- 172.21.15.66:0/2776291839 learned_addr learned my addr 172.21.15.66:0/2776291839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c55122640 1 -- 172.21.15.66:0/2776291839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ecb6da0 con 0x55b06ee35750 2024-09-12T00:20:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.444+0000 7f9c55122640 1 --2- 172.21.15.66:0/2776291839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9c48018f70 tx=0x7f9c48003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80a89d99798ef57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b43606640 1 -- 172.21.15.66:0/2776291839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480aa8b0 con 0x55b06ee35750 2024-09-12T00:20:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b43606640 1 -- 172.21.15.66:0/2776291839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480aaa50 con 0x55b06ee35750 2024-09-12T00:20:56.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b43606640 1 -- 172.21.15.66:0/2776291839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480aad30 con 0x55b06ee35750 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2776291839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 msgr2=0x55b06ef209c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/2776291839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9c48018f70 tx=0x7f9c48003030 comp rx=0 tx=0).stop 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2776291839 shutdown_connections 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/2776291839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef209c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2776291839 >> 172.21.15.66:0/2776291839 conn(0x55b06eda9060 msgr2=0x55b06ef1c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2776291839 shutdown_connections 2024-09-12T00:20:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2776291839 wait complete. 2024-09-12T00:20:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b06ecdda50 con 0x55b06ee35750 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef27ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35490/0 (socket says 172.21.15.66:35490) 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 learned_addr learned my addr 172.21.15.66:0/3060918318 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ef28430 con 0x55b06ee35750 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef27ed0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9c48018f70 tx=0x7f9c480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b41e03640 1 -- 172.21.15.66:0/3060918318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480c6690 con 0x55b06ee35750 2024-09-12T00:20:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b06ef286c0 con 0x55b06ee35750 2024-09-12T00:20:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b41e03640 1 -- 172.21.15.66:0/3060918318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480c6830 con 0x55b06ee35750 2024-09-12T00:20:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9b41e03640 1 -- 172.21.15.66:0/3060918318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480c6b10 con 0x55b06ee35750 2024-09-12T00:20:56.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.448+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b06ef29070 con 0x55b06ee35750 2024-09-12T00:20:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b06ed48450 con 0x55b06ef34b50 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b41e03640 1 -- 172.21.15.66:0/3060918318 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c480ce030 con 0x55b06ee35750 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35504/0 (socket says 172.21.15.66:35504) 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 -- 172.21.15.66:0/2930722637 learned_addr learned my addr 172.21.15.66:0/2930722637 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b41e03640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b3c039a70 0x7f9b3c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b41e03640 1 -- 172.21.15.66:0/3060918318 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f9c480cc020 con 0x55b06ee35750 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b3c039a70 0x7f9b3c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 -- 172.21.15.66:0/2930722637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ef35540 con 0x55b06ef34b50 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b3c039a70 0x7f9b3c03bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c4801b360 tx=0x7f9c480b3f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 --2- 172.21.15.66:0/2930722637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000a430 tx=0x7f9c5000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8741788d999f147 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b3b7fe640 1 -- 172.21.15.66:0/2930722637 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c5000f6e0 con 0x55b06ef34b50 2024-09-12T00:20:56.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b3b7fe640 1 -- 172.21.15.66:0/2930722637 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50015070 con 0x55b06ef34b50 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9b3b7fe640 1 -- 172.21.15.66:0/2930722637 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c5000fa10 con 0x55b06ef34b50 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2930722637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 msgr2=0x55b06ef34f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/2930722637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000a430 tx=0x7f9c5000a8f0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2930722637 shutdown_connections 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/2930722637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef34f50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2930722637 >> 172.21.15.66:0/2930722637 conn(0x55b06ee38890 msgr2=0x55b06ef30590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2930722637 shutdown_connections 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/2930722637 wait complete. 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c5761c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b06ef35d30 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35512/0 (socket says 172.21.15.66:35512) 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.452+0000 7f9c55923640 1 -- 172.21.15.66:0/1800899527 learned_addr learned my addr 172.21.15.66:0/1800899527 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55923640 1 -- 172.21.15.66:0/1800899527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ef3c530 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55923640 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000adf0 tx=0x7f9c50003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 -- 172.21.15.66:0/1800899527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50010a10 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 -- 172.21.15.66:0/1800899527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50020070 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b06ef3c7c0 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 -- 172.21.15.66:0/1800899527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c50010d40 con 0x55b06ef34b50 2024-09-12T00:20:56.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b06ef3d170 con 0x55b06ef34b50 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 -- 172.21.15.66:0/1800899527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c5001b420 con 0x55b06ef34b50 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 Processor -- start 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 0x7f9b2c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9b39ffb640 1 -- 172.21.15.66:0/1800899527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f9c50050d70 con 0x55b06ef34b50 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 -- start start 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55923640 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 0x7f9b2c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c5761c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b06ef21130 con 0x55b06ef558d0 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55923640 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 0x7f9b2c03bf80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c50010fd0 tx=0x7f9c50031040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55122640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35522/0 (socket says 172.21.15.66:35522) 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.456+0000 7f9c55122640 1 -- 172.21.15.66:0/3782241470 learned_addr learned my addr 172.21.15.66:0/3782241470 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55122640 1 -- 172.21.15.66:0/3782241470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b06ef56330 con 0x55b06ef558d0 2024-09-12T00:20:56.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55122640 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c480e9f80 tx=0x7f9c480bcf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 -- 172.21.15.66:0/3782241470 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480b7ea0 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 -- 172.21.15.66:0/3782241470 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480b39e0 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b06ef56ae0 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 -- 172.21.15.66:0/3782241470 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c480d0ba0 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b06ef57050 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 -- 172.21.15.66:0/3782241470 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9c480bc580 con 0x55b06ef558d0 2024-09-12T00:20:56.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 0x7f9a9803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9b19fe3640 1 -- 172.21.15.66:0/3782241470 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f9c480f5d30 con 0x55b06ef558d0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c54921640 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 0x7f9a9803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9a937fe640 20 reqs_thread_entry: start 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b06ef5b2c0 0x55b06ef5d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef5ddd0 con 0x55b06ef5b2c0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c54921640 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 0x7f9a9803be90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c001dc0 tx=0x7f9c4c001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55923640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b06ef5b2c0 0x55b06ef5d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55923640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b06ef5b2c0 0x55b06ef5d750 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef5e680 con 0x55b06ef5b2c0 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.460+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b06ef5ff90 0x55b06ef623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62b50 con 0x55b06ef5ff90 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b06ef5ff90 0x55b06ef623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b06ef5ff90 0x55b06ef623c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef6db50 con 0x55b06ef5b2c0 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:NOTICE: set zone's realm_id= 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c48009040 0x7f9c480da830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c48009040 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c54921640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c48009040 0x7f9c480da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c54921640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c48009040 0x7f9c480da830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c54921640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c4c00e8d0 0x7f9c4c00d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55923640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c4c00e8d0 0x7f9c4c00d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.464+0000 7f9c55923640 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c4c00e8d0 0x7f9c4c00d320 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c48009040 2024-09-12T00:20:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c48009040 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c48009040 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(17 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.468+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c48009040 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5b2c0 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.472+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x55b06ef5ff90 2024-09-12T00:20:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef62f80 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f9c5005a040 con 0x7f9c48009040 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f9c5005a040 con 0x55b06ef5ff90 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f9c5005a040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c50040040 con 0x7f9c4c00e8d0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f9c5005a040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f9c5005a040 con 0x7f9c48009040 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c54921640 1 -- 172.21.15.66:0/3060918318 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c4c00f600 con 0x7f9c48009040 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.476+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef6c4d0 con 0x55b06ef5b2c0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:38 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef693e0 con 0x55b06ef5ff90 2024-09-12T00:20:56.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(38 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:39 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef6b120 con 0x55b06ef5ff90 2024-09-12T00:20:56.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c55122640 1 -- 172.21.15.66:0/3060918318 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(39 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [create,call,writefull 0~1155] v33'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f9c480e1030 con 0x55b06ef5ff90 2024-09-12T00:20:56.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.480+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef686a0 con 0x55b06ef5b2c0 2024-09-12T00:20:56.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b06ef6b9a0 con 0x55b06ef5b2c0 2024-09-12T00:20:56.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f9c50040040 con 0x55b06ef5b2c0 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 msgr2=0x7f9b2c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 0x7f9b2c03bf80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c50010fd0 tx=0x7f9c50031040 comp rx=0 tx=0).stop 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.484+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 msgr2=0x55b06ef3bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000adf0 tx=0x7f9c50003380 comp rx=0 tx=0).stop 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 shutdown_connections 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b2c039ac0 0x7f9b2c03bf80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/1800899527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef34b50 0x55b06ef3bfd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 >> 172.21.15.66:0/1800899527 conn(0x55b06ee38890 msgr2=0x55b06ef300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 shutdown_connections 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/1800899527 wait complete. 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 msgr2=0x7f9a9803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 0x7f9a9803be90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c001dc0 tx=0x7f9c4c001320 comp rx=0 tx=0).stop 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 msgr2=0x55b06ef55cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c480e9f80 tx=0x7f9c480bcf60 comp rx=0 tx=0).stop 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 shutdown_connections 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9a980399d0 0x7f9a9803be90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3782241470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ef558d0 0x55b06ef55cf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 >> 172.21.15.66:0/3782241470 conn(0x55b06ef4af00 msgr2=0x55b06ef4b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 shutdown_connections 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3782241470 wait complete. 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c4c00e8d0 msgr2=0x7f9c4c00d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f9c4c00e8d0 0x7f9c4c00d320 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b06ef5b2c0 msgr2=0x55b06ef5d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55b06ef5b2c0 0x55b06ef5d750 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c48009040 msgr2=0x7f9c480da830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f9c48009040 0x7f9c480da830 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b06ef5ff90 msgr2=0x55b06ef623c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55b06ef5ff90 0x55b06ef623c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b3c039a70 msgr2=0x7f9b3c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9b3c039a70 0x7f9b3c03bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c4801b360 tx=0x7f9c480b3f30 comp rx=0 tx=0).stop 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 msgr2=0x55b06ef27ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 --2- 172.21.15.66:0/3060918318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b06ee35750 0x55b06ef27ed0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9c48018f70 tx=0x7f9c480180e0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 reap_dead start 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c55923640 1 -- 172.21.15.66:0/3060918318 reap_dead start 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 shutdown_connections 2024-09-12T00:20:56.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 >> 172.21.15.66:0/3060918318 conn(0x55b06eda9060 msgr2=0x55b06ef1b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 shutdown_connections 2024-09-12T00:20:56.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.488+0000 7f9c5761c9c0 1 -- 172.21.15.66:0/3060918318 wait complete. 2024-09-12T00:20:56.504 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:20:56.504 DEBUG:tasks.util.rgw: json result: {'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:20:56.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-12T00:20:56.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-12T00:20:56.505 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-12T00:20:56.578 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.578 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0334bc9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563b5802f040 0x563b5802f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0334bc9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b57f6c9c0 con 0x563b5802da40 2024-09-12T00:20:56.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0334bc9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x563b57fbc6d0 con 0x563b5802f040 2024-09-12T00:20:56.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff030fc2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x563b5802f040 0x563b5802f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0307c1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x563b5802da40 0x563b5802de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41834/0 (socket says 172.21.15.66:41834) 2024-09-12T00:20:56.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.572+0000 7ff0307c1640 1 -- 172.21.15.66:0/2747842477 learned_addr learned my addr 172.21.15.66:0/2747842477 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:56.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff030fc2640 1 -- 172.21.15.66:0/2747842477 >> v1:172.21.15.31:6789/0 conn(0x563b5802da40 legacy=0x563b5802de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff030fc2640 1 -- 172.21.15.66:0/2747842477 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b57f60ca0 con 0x563b5802f040 2024-09-12T00:20:56.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff030fc2640 1 --2- 172.21.15.66:0/2747842477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802f040 0x563b5802f420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff02000a420 tx=0x7ff02001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ee4a4448e38ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff02ffc0640 1 -- 172.21.15.66:0/2747842477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200af070 con 0x563b5802f040 2024-09-12T00:20:56.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff02ffc0640 1 -- 172.21.15.66:0/2747842477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200aa530 con 0x563b5802f040 2024-09-12T00:20:56.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff02ffc0640 1 -- 172.21.15.66:0/2747842477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200aa850 con 0x563b5802f040 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/2747842477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802f040 msgr2=0x563b5802f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/2747842477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802f040 0x563b5802f420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff02000a420 tx=0x7ff02001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/2747842477 shutdown_connections 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/2747842477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802f040 0x563b5802f420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/2747842477 >> 172.21.15.66:0/2747842477 conn(0x563b580b4020 msgr2=0x563b580b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/2747842477 shutdown_connections 2024-09-12T00:20:56.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.576+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/2747842477 wait complete. 2024-09-12T00:20:56.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.592+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.592+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b57fc0680 con 0x563b5802da40 2024-09-12T00:20:56.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35550/0 (socket says 172.21.15.66:35550) 2024-09-12T00:20:56.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 -- 172.21.15.66:0/1280563130 learned_addr learned my addr 172.21.15.66:0/1280563130 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 -- 172.21.15.66:0/1280563130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b57f3bda0 con 0x563b5802da40 2024-09-12T00:20:56.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 --2- 172.21.15.66:0/1280563130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0200aa500 tx=0x7ff020003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1804e4bf73070d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7fef1ee0d640 1 -- 172.21.15.66:0/1280563130 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200af040 con 0x563b5802da40 2024-09-12T00:20:56.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7fef1ee0d640 1 -- 172.21.15.66:0/1280563130 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200aba90 con 0x563b5802da40 2024-09-12T00:20:56.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7fef1ee0d640 1 -- 172.21.15.66:0/1280563130 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200abd70 con 0x563b5802da40 2024-09-12T00:20:56.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1280563130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 msgr2=0x563b581a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1280563130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff0200aa500 tx=0x7ff020003340 comp rx=0 tx=0).stop 2024-09-12T00:20:56.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1280563130 shutdown_connections 2024-09-12T00:20:56.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1280563130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581a5d00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1280563130 >> 172.21.15.66:0/1280563130 conn(0x563b580b4020 msgr2=0x563b581a19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1280563130 shutdown_connections 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1280563130 wait complete. 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff0334bc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b57f62a50 con 0x563b5802da40 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35566/0 (socket says 172.21.15.66:35566) 2024-09-12T00:20:56.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.596+0000 7ff030fc2640 1 -- 172.21.15.66:0/3986278792 learned_addr learned my addr 172.21.15.66:0/3986278792 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff030fc2640 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b581ad800 con 0x563b5802da40 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff030fc2640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff0200aa500 tx=0x563b5802e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 -- 172.21.15.66:0/3986278792 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200af040 con 0x563b5802da40 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b581ada90 con 0x563b5802da40 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 -- 172.21.15.66:0/3986278792 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200b3760 con 0x563b5802da40 2024-09-12T00:20:56.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 -- 172.21.15.66:0/3986278792 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200b3a40 con 0x563b5802da40 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b581ae3f0 con 0x563b5802da40 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b57fcd450 con 0x563b581b9ef0 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0317c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0317c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35576/0 (socket says 172.21.15.66:35576) 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0317c3640 1 -- 172.21.15.66:0/1978098676 learned_addr learned my addr 172.21.15.66:0/1978098676 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 -- 172.21.15.66:0/3986278792 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0200b3cb0 con 0x563b5802da40 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 0x7fef1803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef1d60a640 1 -- 172.21.15.66:0/3986278792 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff0200eab00 con 0x563b5802da40 2024-09-12T00:20:56.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0317c3640 1 -- 172.21.15.66:0/1978098676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b581ba8e0 con 0x563b581b9ef0 2024-09-12T00:20:56.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff030fc2640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 0x7fef1803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0317c3640 1 --2- 172.21.15.66:0/1978098676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff02800a440 tx=0x7ff02800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e38d1592fb8b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff030fc2640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 0x7fef1803bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff020005710 tx=0x7ff0200c8040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef16ffd640 1 -- 172.21.15.66:0/1978098676 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028008850 con 0x563b581b9ef0 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef16ffd640 1 -- 172.21.15.66:0/1978098676 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028008a10 con 0x563b581b9ef0 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7fef16ffd640 1 -- 172.21.15.66:0/1978098676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028008d30 con 0x563b581b9ef0 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1978098676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 msgr2=0x563b581ba2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1978098676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff02800a440 tx=0x7ff02800a900 comp rx=0 tx=0).stop 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1978098676 shutdown_connections 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1978098676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581ba2f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1978098676 >> 172.21.15.66:0/1978098676 conn(0x563b5802f040 msgr2=0x563b581b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.600+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1978098676 shutdown_connections 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1978098676 wait complete. 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b581bb0d0 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0317c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0317c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35578/0 (socket says 172.21.15.66:35578) 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0317c3640 1 -- 172.21.15.66:0/312958548 learned_addr learned my addr 172.21.15.66:0/312958548 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0317c3640 1 -- 172.21.15.66:0/312958548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b581c17f0 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0317c3640 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x563b581badf0 tx=0x7ff028003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 -- 172.21.15.66:0/312958548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028013a70 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b581c1a80 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 -- 172.21.15.66:0/312958548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028023070 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 -- 172.21.15.66:0/312958548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff028013d80 con 0x563b581b9ef0 2024-09-12T00:20:56.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b581c2430 con 0x563b581b9ef0 2024-09-12T00:20:56.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 -- 172.21.15.66:0/312958548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff028028460 con 0x563b581b9ef0 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7ff0334bc9c0 1 Processor -- start 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.604+0000 7fef157fa640 1 -- 172.21.15.66:0/312958548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff028050780 con 0x563b581b9ef0 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0317c3640 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 -- start start 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b581a6470 con 0x563b581dabc0 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0317c3640 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 0x7fef0803bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff02801df90 tx=0x7ff02801dea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff030fc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35592/0 (socket says 172.21.15.66:35592) 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff030fc2640 1 -- 172.21.15.66:0/1968716937 learned_addr learned my addr 172.21.15.66:0/1968716937 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff030fc2640 1 -- 172.21.15.66:0/1968716937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b581db620 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff030fc2640 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b9040 tx=0x7ff0200056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 -- 172.21.15.66:0/1968716937 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200e0030 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 -- 172.21.15.66:0/1968716937 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200b28b0 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b581dde00 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 -- 172.21.15.66:0/1968716937 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0200b2370 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b581dde00 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 -- 172.21.15.66:0/1968716937 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0200e3030 con 0x563b581dabc0 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 0x7fee6c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7feef57e2640 1 -- 172.21.15.66:0/1968716937 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff0200e1070 con 0x563b581dabc0 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0307c1640 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 0x7fee6c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7fee76ffd640 20 reqs_thread_entry: start 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 0x563b581e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b581e2e60 con 0x563b581e0350 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0307c1640 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 0x7fee6c03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff018001d00 tx=0x7ff018001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.608+0000 7ff0317c3640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 0x563b581e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0317c3640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 0x563b581e27e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0317c3640 1 -- 172.21.15.66:0/3986278792 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff02801e7a0 con 0x563b581e0350 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b581e3710 con 0x563b581e0350 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0317c3640 1 -- 172.21.15.66:0/3986278792 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff02801e7a0 con 0x563b581e0350 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 0x563b581e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563b581e7bd0 con 0x563b581e4fd0 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff030fc2640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 0x563b581e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff030fc2640 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 0x563b581e7440 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff030fc2640 1 -- 172.21.15.66:0/3986278792 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7ff0200cd070 con 0x563b581e4fd0 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 msgr2=0x7fef0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 0x7fef0803bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff02801df90 tx=0x7ff02801dea0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 msgr2=0x563b581c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x563b581badf0 tx=0x7ff028003000 comp rx=0 tx=0).stop 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 shutdown_connections 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef08039a70 0x7fef0803bf30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/312958548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581b9ef0 0x563b581c1290 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 >> 172.21.15.66:0/312958548 conn(0x563b5802f040 msgr2=0x563b581b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 shutdown_connections 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/312958548 wait complete. 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 msgr2=0x7fee6c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 0x7fee6c03bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff018001d00 tx=0x7ff018001260 comp rx=0 tx=0).stop 2024-09-12T00:20:56.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 msgr2=0x563b581dafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b9040 tx=0x7ff0200056a0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 shutdown_connections 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fee6c039a70 0x7fee6c03bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/1968716937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b581dabc0 0x563b581dafe0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 >> 172.21.15.66:0/1968716937 conn(0x563b581d0200 msgr2=0x563b581d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 shutdown_connections 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/1968716937 wait complete. 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 msgr2=0x563b581e27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 0x563b581e27e0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 msgr2=0x563b581e7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 0x563b581e7440 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 msgr2=0x7fef1803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 0x7fef1803bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff020005710 tx=0x7ff0200c8040 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 msgr2=0x563b581ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff0200aa500 tx=0x563b5802e980 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 shutdown_connections 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x563b581e4fd0 0x563b581e7440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x563b581e0350 0x563b581e27e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fef18039a70 0x7fef1803bf30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.612+0000 7ff0334bc9c0 1 --2- 172.21.15.66:0/3986278792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b5802da40 0x563b581ad2a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.616+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 >> 172.21.15.66:0/3986278792 conn(0x563b580b4020 msgr2=0x563b581a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.616+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 shutdown_connections 2024-09-12T00:20:56.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.616+0000 7ff0334bc9c0 1 -- 172.21.15.66:0/3986278792 wait complete. 2024-09-12T00:20:56.630 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:20:56.630 DEBUG:tasks.util.rgw: json result: {'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:20:56.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T00:20:56.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T00:20:56.631 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T00:20:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd9b77d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5631256e88b0 0x5631256eaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd9b77d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631255969c0 con 0x5631256e47b0 2024-09-12T00:20:56.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd9b77d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5631255e66d0 con 0x5631256e88b0 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd98a82640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5631256e88b0 0x5631256eaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd99283640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5631256e47b0 0x5631256e4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41848/0 (socket says 172.21.15.66:41848) 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd99283640 1 -- 172.21.15.66:0/4039819358 learned_addr learned my addr 172.21.15.66:0/4039819358 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.700+0000 7fbd93fff640 1 -- 172.21.15.66:0/4039819358 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792332064 0 0) 0x5631255969c0 con 0x5631256e47b0 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd93fff640 1 -- 172.21.15.66:0/4039819358 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd88001e20 con 0x5631256e47b0 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd98a82640 1 -- 172.21.15.66:0/4039819358 >> v1:172.21.15.31:6789/0 conn(0x5631256e47b0 legacy=0x5631256e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd98a82640 1 -- 172.21.15.66:0/4039819358 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56312558aca0 con 0x5631256e88b0 2024-09-12T00:20:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd98a82640 1 --2- 172.21.15.66:0/4039819358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e88b0 0x5631256eaca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400a480 tx=0x7fbd8401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6b7ed478fd3bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd93fff640 1 -- 172.21.15.66:0/4039819358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd840aa570 con 0x5631256e88b0 2024-09-12T00:20:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd93fff640 1 -- 172.21.15.66:0/4039819358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd840af070 con 0x5631256e88b0 2024-09-12T00:20:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd93fff640 1 -- 172.21.15.66:0/4039819358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd840aa860 con 0x5631256e88b0 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4039819358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e88b0 msgr2=0x5631256eaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/4039819358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e88b0 0x5631256eaca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400a480 tx=0x7fbd8401b310 comp rx=0 tx=0).stop 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4039819358 shutdown_connections 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/4039819358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e88b0 0x5631256eaca0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4039819358 >> 172.21.15.66:0/4039819358 conn(0x563125658060 msgr2=0x563125658470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4039819358 shutdown_connections 2024-09-12T00:20:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.704+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4039819358 wait complete. 2024-09-12T00:20:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.720+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.720+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.720+0000 7fbd9b77d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.720+0000 7fbd9b77d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5631255ea680 con 0x5631256e47b0 2024-09-12T00:20:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.720+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35606/0 (socket says 172.21.15.66:35606) 2024-09-12T00:20:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 -- 172.21.15.66:0/595373633 learned_addr learned my addr 172.21.15.66:0/595373633 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 -- 172.21.15.66:0/595373633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125565da0 con 0x5631256e47b0 2024-09-12T00:20:56.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 --2- 172.21.15.66:0/595373633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001e40 tx=0x7fbd8c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb91df33dd7a792 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbc87606640 1 -- 172.21.15.66:0/595373633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c012020 con 0x5631256e47b0 2024-09-12T00:20:56.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbc87606640 1 -- 172.21.15.66:0/595373633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c00e690 con 0x5631256e47b0 2024-09-12T00:20:56.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbc87606640 1 -- 172.21.15.66:0/595373633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c00e9b0 con 0x5631256e47b0 2024-09-12T00:20:56.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/595373633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 msgr2=0x5631257cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/595373633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c001e40 tx=0x7fbd8c00b790 comp rx=0 tx=0).stop 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/595373633 shutdown_connections 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/595373633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257cf930 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/595373633 >> 172.21.15.66:0/595373633 conn(0x563125658060 msgr2=0x5631257cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/595373633 shutdown_connections 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/595373633 wait complete. 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd9b77d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56312558ca50 con 0x5631256e47b0 2024-09-12T00:20:56.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35610/0 (socket says 172.21.15.66:35610) 2024-09-12T00:20:56.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.724+0000 7fbd99283640 1 -- 172.21.15.66:0/2696725221 learned_addr learned my addr 172.21.15.66:0/2696725221 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99283640 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631257d7510 con 0x5631256e47b0 2024-09-12T00:20:56.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99283640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c004180 tx=0x7fbd8c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 -- 172.21.15.66:0/2696725221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c012030 con 0x5631256e47b0 2024-09-12T00:20:56.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 -- 172.21.15.66:0/2696725221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c01a7a0 con 0x5631256e47b0 2024-09-12T00:20:56.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631257d77a0 con 0x5631256e47b0 2024-09-12T00:20:56.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 -- 172.21.15.66:0/2696725221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c01aa80 con 0x5631256e47b0 2024-09-12T00:20:56.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631257d8150 con 0x5631256e47b0 2024-09-12T00:20:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd9b77d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5631255f7450 con 0x5631257e3c30 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99a84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99a84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35624/0 (socket says 172.21.15.66:35624) 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99a84640 1 -- 172.21.15.66:0/4142762170 learned_addr learned my addr 172.21.15.66:0/4142762170 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 -- 172.21.15.66:0/2696725221 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd8c015020 con 0x5631256e47b0 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 0x7fbc8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc85e03640 1 -- 172.21.15.66:0/2696725221 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbd8c020070 con 0x5631256e47b0 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99a84640 1 -- 172.21.15.66:0/4142762170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631257e4620 con 0x5631257e3c30 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99283640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 0x7fbc8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99a84640 1 --2- 172.21.15.66:0/4142762170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400a430 tx=0x7fbd9400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b77aef8af46c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbd99283640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 0x7fbc8003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c022700 tx=0x7fbd8c022590 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc7f7fe640 1 -- 172.21.15.66:0/4142762170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd9400f6e0 con 0x5631257e3c30 2024-09-12T00:20:56.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc7f7fe640 1 -- 172.21.15.66:0/4142762170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd94015070 con 0x5631257e3c30 2024-09-12T00:20:56.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.728+0000 7fbc7f7fe640 1 -- 172.21.15.66:0/4142762170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd9400fa10 con 0x5631257e3c30 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4142762170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 msgr2=0x5631257e4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/4142762170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400a430 tx=0x7fbd9400a8f0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4142762170 shutdown_connections 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/4142762170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257e4030 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4142762170 >> 172.21.15.66:0/4142762170 conn(0x5631256e88b0 msgr2=0x5631257df670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4142762170 shutdown_connections 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/4142762170 wait complete. 2024-09-12T00:20:56.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5631257e4e10 con 0x5631257e3c30 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd99a84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd99a84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35638/0 (socket says 172.21.15.66:35638) 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd99a84640 1 -- 172.21.15.66:0/3945298297 learned_addr learned my addr 172.21.15.66:0/3945298297 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd99a84640 1 -- 172.21.15.66:0/3945298297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631257eb550 con 0x5631257e3c30 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd99a84640 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400adf0 tx=0x7fbd94003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbc7dffb640 1 -- 172.21.15.66:0/3945298297 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd94010a10 con 0x5631257e3c30 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631257eb7e0 con 0x5631257e3c30 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbc7dffb640 1 -- 172.21.15.66:0/3945298297 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd94020070 con 0x5631257e3c30 2024-09-12T00:20:56.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631257ec190 con 0x5631257e3c30 2024-09-12T00:20:56.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbc7dffb640 1 -- 172.21.15.66:0/3945298297 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd94010d00 con 0x5631257e3c30 2024-09-12T00:20:56.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbd9b77d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.732+0000 7fbc7dffb640 1 -- 172.21.15.66:0/3945298297 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd94025470 con 0x5631257e3c30 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc7dffb640 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 0x7fbc7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99a84640 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 0x7fbc7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 Processor -- start 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc7dffb640 1 -- 172.21.15.66:0/3945298297 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbd94051160 con 0x5631257e3c30 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 -- start start 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5631257d0160 con 0x5631258048f0 2024-09-12T00:20:56.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99a84640 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 0x7fbc7003bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbd94005aa0 tx=0x7fbd940259e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35642/0 (socket says 172.21.15.66:35642) 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99283640 1 -- 172.21.15.66:0/1799118015 learned_addr learned my addr 172.21.15.66:0/1799118015 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99283640 1 -- 172.21.15.66:0/1799118015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563125805350 con 0x5631258048f0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd99283640 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c01a6a0 tx=0x7fbd8c016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc5dfe3640 1 -- 172.21.15.66:0/1799118015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c03c070 con 0x5631258048f0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563125805b00 con 0x5631258048f0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc5dfe3640 1 -- 172.21.15.66:0/1799118015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c018430 con 0x5631258048f0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc5dfe3640 1 -- 172.21.15.66:0/1799118015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8c02aa50 con 0x5631258048f0 2024-09-12T00:20:56.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563125806070 con 0x5631258048f0 2024-09-12T00:20:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc5dfe3640 1 -- 172.21.15.66:0/1799118015 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd8c03f070 con 0x5631258048f0 2024-09-12T00:20:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.736+0000 7fbc5dfe3640 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 0x7fbbdc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbc5dfe3640 1 -- 172.21.15.66:0/1799118015 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbd8c005050 con 0x5631258048f0 2024-09-12T00:20:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd98a82640 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 0x7fbbdc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbbd77fe640 20 reqs_thread_entry: start 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 0x56312580c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56312580ce40 con 0x56312580a300 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd98a82640 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 0x7fbbdc03bf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd840ae000 tx=0x7fbd840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99a84640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 0x56312580c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99a84640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 0x56312580c790 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99a84640 1 -- 172.21.15.66:0/2696725221 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd94046040 con 0x56312580a300 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 0x563125811000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:2 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5631258116f0 con 0x56312580ec10 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99283640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 0x563125811000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99283640 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 0x563125811000 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd99283640 1 -- 172.21.15.66:0/2696725221 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(2 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fbd8c03e030 con 0x56312580ec10 2024-09-12T00:20:56.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.740+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563125816b90 con 0x56312580ec10 2024-09-12T00:20:56.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd99283640 1 -- 172.21.15.66:0/2696725221 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [stat,call,call,writefull 0~993] v33'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fbd8c03e030 con 0x56312580ec10 2024-09-12T00:20:56.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 msgr2=0x7fbc7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 0x7fbc7003bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbd94005aa0 tx=0x7fbd940259e0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 msgr2=0x5631257eaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400adf0 tx=0x7fbd94003380 comp rx=0 tx=0).stop 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 shutdown_connections 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc70039a70 0x7fbc7003bf30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/3945298297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631257e3c30 0x5631257eaff0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 >> 172.21.15.66:0/3945298297 conn(0x5631256e88b0 msgr2=0x5631257df1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 shutdown_connections 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/3945298297 wait complete. 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 msgr2=0x7fbbdc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 0x7fbbdc03bf30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbd840ae000 tx=0x7fbd840a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 msgr2=0x563125804d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c01a6a0 tx=0x7fbd8c016b00 comp rx=0 tx=0).stop 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 shutdown_connections 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbbdc039a70 0x7fbbdc03bf30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/1799118015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631258048f0 0x563125804d10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 >> 172.21.15.66:0/1799118015 conn(0x5631257f9f20 msgr2=0x5631257fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 shutdown_connections 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/1799118015 wait complete. 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 msgr2=0x56312580c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 0x56312580c790 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 msgr2=0x563125811000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 0x563125811000 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 msgr2=0x7fbc8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 0x7fbc8003bf30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c022700 tx=0x7fbd8c022590 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 msgr2=0x5631257d6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c004180 tx=0x7fbd8c0040f0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 shutdown_connections 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56312580ec10 0x563125811000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56312580a300 0x56312580c790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbc80039a70 0x7fbc8003bf30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 --2- 172.21.15.66:0/2696725221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5631256e47b0 0x5631257d6fb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 >> 172.21.15.66:0/2696725221 conn(0x563125658060 msgr2=0x5631257ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 shutdown_connections 2024-09-12T00:20:56.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.744+0000 7fbd9b77d9c0 1 -- 172.21.15.66:0/2696725221 wait complete. 2024-09-12T00:20:56.762 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:20:56.762 DEBUG:tasks.util.rgw: json result: {'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:20:56.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-12T00:20:56.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-12T00:20:56.762 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-12T00:20:56.838 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.838 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b53a69c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5651d1248770 0x5651d124ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b53a69c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651d10f69c0 con 0x5651d1244c60 2024-09-12T00:20:56.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b53a69c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5651d11466d0 con 0x5651d1248770 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b2eac640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5651d1244c60 0x5651d1247050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41854/0 (socket says 172.21.15.66:41854) 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b26ab640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5651d1248770 0x5651d124ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.832+0000 7fb6b2eac640 1 -- 172.21.15.66:0/1125625140 learned_addr learned my addr 172.21.15.66:0/1125625140 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b1eaa640 1 -- 172.21.15.66:0/1125625140 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72568836 0 0) 0x5651d10f69c0 con 0x5651d1244c60 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b1eaa640 1 -- 172.21.15.66:0/1125625140 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a0001e20 con 0x5651d1244c60 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b26ab640 1 -- 172.21.15.66:0/1125625140 >> v1:172.21.15.31:6789/0 conn(0x5651d1244c60 legacy=0x5651d1247050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b26ab640 1 -- 172.21.15.66:0/1125625140 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d10eaca0 con 0x5651d1248770 2024-09-12T00:20:56.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b26ab640 1 --2- 172.21.15.66:0/1125625140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1248770 0x5651d124ab60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00a480 tx=0x7fb69c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dd2443cf7d0ada server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b1eaa640 1 -- 172.21.15.66:0/1125625140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c0b0070 con 0x5651d1248770 2024-09-12T00:20:56.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b1eaa640 1 -- 172.21.15.66:0/1125625140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c0ab540 con 0x5651d1248770 2024-09-12T00:20:56.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b1eaa640 1 -- 172.21.15.66:0/1125625140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c0ab820 con 0x5651d1248770 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1125625140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1248770 msgr2=0x5651d124ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/1125625140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1248770 0x5651d124ab60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00a480 tx=0x7fb69c01b280 comp rx=0 tx=0).stop 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1125625140 shutdown_connections 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/1125625140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1248770 0x5651d124ab60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1125625140 >> 172.21.15.66:0/1125625140 conn(0x5651d11b7ff0 msgr2=0x5651d11b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1125625140 shutdown_connections 2024-09-12T00:20:56.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.836+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1125625140 wait complete. 2024-09-12T00:20:56.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b53a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b53a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651d114a680 con 0x5651d1244c60 2024-09-12T00:20:56.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35660/0 (socket says 172.21.15.66:35660) 2024-09-12T00:20:56.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.852+0000 7fb6b2eac640 1 -- 172.21.15.66:0/1771510934 learned_addr learned my addr 172.21.15.66:0/1771510934 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 -- 172.21.15.66:0/1771510934 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d10c5da0 con 0x5651d1244c60 2024-09-12T00:20:56.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/1771510934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40016a0 tx=0x7fb6a4001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70de8ac201571e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb5a0e09640 1 -- 172.21.15.66:0/1771510934 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4004530 con 0x5651d1244c60 2024-09-12T00:20:56.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb5a0e09640 1 -- 172.21.15.66:0/1771510934 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40046d0 con 0x5651d1244c60 2024-09-12T00:20:56.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb5a0e09640 1 -- 172.21.15.66:0/1771510934 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a40049f0 con 0x5651d1244c60 2024-09-12T00:20:56.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1771510934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 msgr2=0x5651d132f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/1771510934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40016a0 tx=0x7fb6a4001b60 comp rx=0 tx=0).stop 2024-09-12T00:20:56.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1771510934 shutdown_connections 2024-09-12T00:20:56.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/1771510934 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d132f7f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1771510934 >> 172.21.15.66:0/1771510934 conn(0x5651d11b7ff0 msgr2=0x5651d132b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1771510934 shutdown_connections 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/1771510934 wait complete. 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651d10eca50 con 0x5651d1244c60 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35662/0 (socket says 172.21.15.66:35662) 2024-09-12T00:20:56.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 -- 172.21.15.66:0/3319759759 learned_addr learned my addr 172.21.15.66:0/3319759759 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d13373b0 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x5651d13307e0 tx=0x7fb6a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb59f606640 1 -- 172.21.15.66:0/3319759759 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4013760 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d1337640 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb59f606640 1 -- 172.21.15.66:0/3319759759 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a4013900 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb59f606640 1 -- 172.21.15.66:0/3319759759 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4013c00 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.856+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d1337ff0 con 0x5651d1244c60 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651d1157450 con 0x5651d1343af0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35670/0 (socket says 172.21.15.66:35670) 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 -- 172.21.15.66:0/2751596196 learned_addr learned my addr 172.21.15.66:0/2751596196 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59f606640 1 -- 172.21.15.66:0/3319759759 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb6a4010070 con 0x5651d1244c60 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59f606640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 0x7fb59803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59f606640 1 -- 172.21.15.66:0/3319759759 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb6a4018070 con 0x5651d1244c60 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 -- 172.21.15.66:0/2751596196 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d13444e0 con 0x5651d1343af0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 0x7fb59803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/2751596196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00a440 tx=0x7fb6ac00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e57581057513d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 0x7fb59803bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6a401e750 tx=0x7fb6a401e6c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59d602640 1 -- 172.21.15.66:0/2751596196 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac008850 con 0x5651d1343af0 2024-09-12T00:20:56.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59d602640 1 -- 172.21.15.66:0/2751596196 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac008a10 con 0x5651d1343af0 2024-09-12T00:20:56.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb59d602640 1 -- 172.21.15.66:0/2751596196 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac008d30 con 0x5651d1343af0 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2751596196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 msgr2=0x5651d1343ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2751596196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00a440 tx=0x7fb6ac00a900 comp rx=0 tx=0).stop 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2751596196 shutdown_connections 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2751596196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d1343ef0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2751596196 >> 172.21.15.66:0/2751596196 conn(0x5651d1248770 msgr2=0x5651d133f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2751596196 shutdown_connections 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2751596196 wait complete. 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b53a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651d1344cd0 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35682/0 (socket says 172.21.15.66:35682) 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.860+0000 7fb6b36ad640 1 -- 172.21.15.66:0/4131695653 learned_addr learned my addr 172.21.15.66:0/4131695653 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b36ad640 1 -- 172.21.15.66:0/4131695653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d134b5a0 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5651d13449f0 tx=0x7fb6ac003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 -- 172.21.15.66:0/4131695653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac013a70 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 -- 172.21.15.66:0/4131695653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac023070 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d134b830 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 -- 172.21.15.66:0/4131695653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac013d80 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d134c1e0 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 -- 172.21.15.66:0/4131695653 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb6ac028460 con 0x5651d1343af0 2024-09-12T00:20:56.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 0x7fb58c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 Processor -- start 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb5977fe640 1 -- 172.21.15.66:0/4131695653 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb6ac0507e0 con 0x5651d1343af0 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 0x7fb58c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 -- start start 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b53a69c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651d1330020 con 0x5651d1364850 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 0x7fb58c03bf80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac028e20 tx=0x7fb6ac028db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b2eac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35684/0 (socket says 172.21.15.66:35684) 2024-09-12T00:20:56.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b2eac640 1 -- 172.21.15.66:0/2211090698 learned_addr learned my addr 172.21.15.66:0/2211090698 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.864+0000 7fb6b2eac640 1 -- 172.21.15.66:0/2211090698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d13652b0 con 0x5651d1364850 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb6a404e9d0 tx=0x7fb6a404eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 -- 172.21.15.66:0/2211090698 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4010d30 con 0x5651d1364850 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 -- 172.21.15.66:0/2211090698 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a4039070 con 0x5651d1364850 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651d1365ab0 con 0x5651d1364850 2024-09-12T00:20:56.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 -- 172.21.15.66:0/2211090698 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4012ce0 con 0x5651d1364850 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d1365ab0 con 0x5651d1364850 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 -- 172.21.15.66:0/2211090698 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb6a4029d10 con 0x5651d1364850 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 0x7fb4f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5777e6640 1 -- 172.21.15.66:0/2211090698 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fb6a4045a00 con 0x5651d1364850 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b26ab640 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 0x7fb4f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb5757e2640 20 reqs_thread_entry: start 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 0x5651d136c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651d136cb40 con 0x5651d136a030 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b26ab640 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 0x7fb4f403bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0ad000 tx=0x7fb69c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 0x5651d136c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b36ad640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 0x5651d136c4c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.877 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b36ad640 1 -- 172.21.15.66:0/3319759759 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6ac01e420 con 0x5651d136a030 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651d136d3f0 con 0x5651d136a030 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b36ad640 1 -- 172.21.15.66:0/3319759759 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6ac01e420 con 0x5651d136a030 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 0x5651d1371150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651d13718e0 con 0x5651d136ed00 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.868+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 0x5651d1371150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b2eac640 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 0x5651d1371150 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b2eac640 1 -- 172.21.15.66:0/3319759759 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6a401b030 con 0x5651d136ed00 2024-09-12T00:20:56.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 msgr2=0x7fb58c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 0x7fb58c03bf80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac028e20 tx=0x7fb6ac028db0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 msgr2=0x5651d134b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5651d13449f0 tx=0x7fb6ac003000 comp rx=0 tx=0).stop 2024-09-12T00:20:56.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 shutdown_connections 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb58c039ac0 0x7fb58c03bf80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/4131695653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1343af0 0x5651d134b040 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 >> 172.21.15.66:0/4131695653 conn(0x5651d1248770 msgr2=0x5651d133f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 shutdown_connections 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/4131695653 wait complete. 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 msgr2=0x7fb4f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 0x7fb4f403bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0ad000 tx=0x7fb69c0a5040 comp rx=0 tx=0).stop 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 msgr2=0x5651d1364c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb6a404e9d0 tx=0x7fb6a404eeb0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 shutdown_connections 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb4f4039a70 0x7fb4f403bf30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/2211090698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1364850 0x5651d1364c70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 >> 172.21.15.66:0/2211090698 conn(0x5651d1359eb0 msgr2=0x5651d135a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 shutdown_connections 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/2211090698 wait complete. 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 msgr2=0x5651d136c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 0x5651d136c4c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 msgr2=0x5651d1371150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 0x5651d1371150 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 msgr2=0x7fb59803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 0x7fb59803bf30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6a401e750 tx=0x7fb6a401e6c0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 msgr2=0x5651d1336e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x5651d13307e0 tx=0x7fb6a4004470 comp rx=0 tx=0).stop 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 shutdown_connections 2024-09-12T00:20:56.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5651d136ed00 0x5651d1371150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5651d136a030 0x5651d136c4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fb598039a70 0x7fb59803bf30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 --2- 172.21.15.66:0/3319759759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651d1244c60 0x5651d1336e50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 >> 172.21.15.66:0/3319759759 conn(0x5651d11b7ff0 msgr2=0x5651d1329f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 shutdown_connections 2024-09-12T00:20:56.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.872+0000 7fb6b53a69c0 1 -- 172.21.15.66:0/3319759759 wait complete. 2024-09-12T00:20:56.889 INFO:teuthology.orchestra.run.smithi066.stdout:{"id":"0f94cb3c-a22e-48d3-91ff-0e4df7c90757","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"631e6d39-d415-492d-aa86-21cdd5f9473d","zones":[{"id":"631e6d39-d415-492d-aa86-21cdd5f9473d","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-12T00:20:56.889 DEBUG:tasks.util.rgw: json result: {'id': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'zones': [{'id': '631e6d39-d415-492d-aa86-21cdd5f9473d', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-12T00:20:56.892 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-12T00:20:56.914 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T00:20:56.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T00:20:56.915 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-12T00:20:56.980 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:56.980 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:56.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:56.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:56.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee584e89c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558381567740 0x5583815f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:56.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee584e89c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583814a79c0 con 0x5583815f6630 2024-09-12T00:20:56.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee584e89c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5583814f76d0 con 0x558381567740 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee55fee640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558381567740 0x5583815f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee55fee640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x558381567740 0x5583815f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35686/0 (socket says 172.21.15.66:35686) 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee557ed640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5583815f6630 0x5583815f8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41866/0 (socket says 172.21.15.66:41866) 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee55fee640 1 -- 172.21.15.66:0/2197393627 learned_addr learned my addr 172.21.15.66:0/2197393627 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee55fee640 1 -- 172.21.15.66:0/2197393627 >> v1:172.21.15.31:6789/0 conn(0x5583815f6630 legacy=0x5583815f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.976+0000 7fee55fee640 1 -- 172.21.15.66:0/2197393627 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838149bca0 con 0x558381567740 2024-09-12T00:20:56.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee55fee640 1 --2- 172.21.15.66:0/2197393627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583815f60f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a5c0 tx=0x7fee4001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82ab5e0f76d6fba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee54fec640 1 -- 172.21.15.66:0/2197393627 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400b1070 con 0x558381567740 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee54fec640 1 -- 172.21.15.66:0/2197393627 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee400a8070 con 0x558381567740 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee54fec640 1 -- 172.21.15.66:0/2197393627 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400ac5b0 con 0x558381567740 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 -- 172.21.15.66:0/2197393627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 msgr2=0x5583815f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 --2- 172.21.15.66:0/2197393627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583815f60f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a5c0 tx=0x7fee4001b340 comp rx=0 tx=0).stop 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 -- 172.21.15.66:0/2197393627 shutdown_connections 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 --2- 172.21.15.66:0/2197393627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583815f60f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:56.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 -- 172.21.15.66:0/2197393627 >> 172.21.15.66:0/2197393627 conn(0x5583815ede20 msgr2=0x5583815f0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:56.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 -- 172.21.15.66:0/2197393627 shutdown_connections 2024-09-12T00:20:56.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.980+0000 7fee584e89c0 1 -- 172.21.15.66:0/2197393627 wait complete. 2024-09-12T00:20:57.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:57.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:57.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583814fb680 con 0x558381567740 2024-09-12T00:20:57.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35700/0 (socket says 172.21.15.66:35700) 2024-09-12T00:20:57.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 -- 172.21.15.66:0/4166490124 learned_addr learned my addr 172.21.15.66:0/4166490124 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 -- 172.21.15.66:0/4166490124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558381476da0 con 0x558381567740 2024-09-12T00:20:57.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 --2- 172.21.15.66:0/4166490124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fee40017f50 tx=0x7fee40003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f473761abed3c1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fed43e07640 1 -- 172.21.15.66:0/4166490124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400b1040 con 0x558381567740 2024-09-12T00:20:57.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fed43e07640 1 -- 172.21.15.66:0/4166490124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee400ac7a0 con 0x558381567740 2024-09-12T00:20:57.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fed43e07640 1 -- 172.21.15.66:0/4166490124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400acaa0 con 0x558381567740 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- 172.21.15.66:0/4166490124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 msgr2=0x5583816dea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 --2- 172.21.15.66:0/4166490124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fee40017f50 tx=0x7fee40003030 comp rx=0 tx=0).stop 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- 172.21.15.66:0/4166490124 shutdown_connections 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 --2- 172.21.15.66:0/4166490124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816dea40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- 172.21.15.66:0/4166490124 >> 172.21.15.66:0/4166490124 conn(0x5583815ede20 msgr2=0x5583816da6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- 172.21.15.66:0/4166490124 shutdown_connections 2024-09-12T00:20:57.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- 172.21.15.66:0/4166490124 wait complete. 2024-09-12T00:20:57.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:57.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:57.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee584e89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55838149da50 con 0x558381567740 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35702/0 (socket says 172.21.15.66:35702) 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:56.996+0000 7fee55fee640 1 -- 172.21.15.66:0/1170427242 learned_addr learned my addr 172.21.15.66:0/1170427242 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee55fee640 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583816e65d0 con 0x558381567740 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee55fee640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee4001b380 tx=0x7fee400180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 -- 172.21.15.66:0/1170427242 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400b1050 con 0x558381567740 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583816e6860 con 0x558381567740 2024-09-12T00:20:57.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 -- 172.21.15.66:0/1170427242 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee400b7710 con 0x558381567740 2024-09-12T00:20:57.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 -- 172.21.15.66:0/1170427242 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee400b79f0 con 0x558381567740 2024-09-12T00:20:57.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583816e7290 con 0x558381567740 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 -- 172.21.15.66:0/1170427242 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee400aa070 con 0x558381567740 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 0x7fed3c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fed42604640 1 -- 172.21.15.66:0/1170427242 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee400eb100 con 0x558381567740 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee557ed640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 0x7fed3c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 0x5583816ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583816ed720 con 0x5583815f6630 2024-09-12T00:20:57.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee567ef640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 0x5583816ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee557ed640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 0x7fed3c03bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee480016b0 tx=0x7fee480066c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee567ef640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 0x5583816ed1e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee567ef640 1 -- 172.21.15.66:0/1170427242 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee500083f0 con 0x5583815f6630 2024-09-12T00:20:57.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.000+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583816edb40 con 0x5583815f6630 2024-09-12T00:20:57.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 -- 172.21.15.66:0/1170427242 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee500083f0 con 0x5583815f6630 2024-09-12T00:20:57.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 0x5583816f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583816f2430 con 0x5583816ef950 2024-09-12T00:20:57.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee55fee640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 0x5583816f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee55fee640 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 0x5583816f1d40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee55fee640 1 -- 172.21.15.66:0/1170427242 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee400be070 con 0x5583816ef950 2024-09-12T00:20:57.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583816ee7f0 con 0x5583815f6630 2024-09-12T00:20:57.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 -- 172.21.15.66:0/1170427242 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee500083f0 con 0x5583815f6630 2024-09-12T00:20:57.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583816eecd0 con 0x5583816ef950 2024-09-12T00:20:57.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee55fee640 1 -- 172.21.15.66:0/1170427242 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee400be070 con 0x5583816ef950 2024-09-12T00:20:57.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:57.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:57.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558381508450 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35712/0 (socket says 172.21.15.66:35712) 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 -- 172.21.15.66:0/3262516249 learned_addr learned my addr 172.21.15.66:0/3262516249 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 -- 172.21.15.66:0/3262516249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558381701600 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee567ef640 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5583816e6ab0 tx=0x7fee5000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fed3b7fe640 1 -- 172.21.15.66:0/3262516249 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee5001c020 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fed3b7fe640 1 -- 172.21.15.66:0/3262516249 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50007d20 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558381701e60 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fed3b7fe640 1 -- 172.21.15.66:0/3262516249 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee50018440 con 0x558381700ba0 2024-09-12T00:20:57.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.004+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583817023d0 con 0x558381700ba0 2024-09-12T00:20:57.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed3b7fe640 1 -- 172.21.15.66:0/3262516249 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee5001f020 con 0x558381700ba0 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed3b7fe640 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 0x7fed3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed3b7fe640 1 -- 172.21.15.66:0/3262516249 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee50051e30 con 0x558381700ba0 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee55fee640 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 0x7fed3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee55fee640 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 0x7fed3003bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5583816e7560 tx=0x7fee400c0ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583816df210 con 0x5583815f20b0 2024-09-12T00:20:57.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35714/0 (socket says 172.21.15.66:35714) 2024-09-12T00:20:57.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee567ef640 1 -- 172.21.15.66:0/3156274762 learned_addr learned my addr 172.21.15.66:0/3156274762 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee567ef640 1 -- 172.21.15.66:0/3156274762 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583815f2aa0 con 0x5583815f20b0 2024-09-12T00:20:57.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee567ef640 1 --2- 172.21.15.66:0/3156274762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fee500500c0 tx=0x7fee50016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24e32a8ae8a3601 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed397fa640 1 -- 172.21.15.66:0/3156274762 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee50021530 con 0x5583815f20b0 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed397fa640 1 -- 172.21.15.66:0/3156274762 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50018b50 con 0x5583815f20b0 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fed397fa640 1 -- 172.21.15.66:0/3156274762 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee50029350 con 0x5583815f20b0 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 -- 172.21.15.66:0/3156274762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 msgr2=0x5583815f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3156274762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fee500500c0 tx=0x7fee50016970 comp rx=0 tx=0).stop 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 -- 172.21.15.66:0/3156274762 shutdown_connections 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3156274762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x5583815f24b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.008+0000 7fee584e89c0 1 -- 172.21.15.66:0/3156274762 >> 172.21.15.66:0/3156274762 conn(0x558381709910 msgr2=0x558381707b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- 172.21.15.66:0/3156274762 shutdown_connections 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- 172.21.15.66:0/3156274762 wait complete. 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 Processor -- start 2024-09-12T00:20:57.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- start start 2024-09-12T00:20:57.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583815f3140 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee567ef640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35716/0 (socket says 172.21.15.66:35716) 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 learned_addr learned my addr 172.21.15.66:0/831885057 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558381717170 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee567ef640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fee50018fd0 tx=0x7fee50050020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 -- 172.21.15.66:0/831885057 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee50016b10 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 -- 172.21.15.66:0/831885057 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50029c70 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558381717400 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 -- 172.21.15.66:0/831885057 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee500296e0 con 0x5583815f20b0 2024-09-12T00:20:57.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558381717db0 con 0x5583815f20b0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 -- 172.21.15.66:0/831885057 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee50040030 con 0x5583815f20b0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed20039a70 0x7fed2003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fed277fe640 1 -- 172.21.15.66:0/831885057 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fee50032070 con 0x5583815f20b0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.012+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed20039a70 0x7fed2003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583817220f0 0x558381724580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558381724cd0 con 0x5583817220f0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583817220f0 0x558381724580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed20039a70 0x7fed2003bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee40003050 tx=0x7fee400d6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583817220f0 0x558381724580 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 realm 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583817214a0 con 0x5583817220f0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583817257d0 con 0x5583817220f0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583817260a0 con 0x5583817220f0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558381726ac0 0x558381728eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558381729580 con 0x558381726ac0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558381726ac0 0x558381728eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558381726ac0 0x558381728eb0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 20 searching for the correct realm 2024-09-12T00:20:57.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x558381726ac0 2024-09-12T00:20:57.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee50021020 0x7fee50020a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee50021020 2024-09-12T00:20:57.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee50021020 0x7fee50020a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee50021020 0x7fee50020a50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee40009040 0x7fee400e2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.016+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee40009040 2024-09-12T00:20:57.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee40009040 0x7fee400e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee40009040 0x7fee400e2230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee40009040 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee50021020 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x558381726ac0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x5583817220f0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.020+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee50021020 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x5583817220f0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee50021020 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x558381726ac0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x558381726ac0 2024-09-12T00:20:57.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55838172ae50 con 0x7fee40009040 2024-09-12T00:20:57.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x5583817220f0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x5583817220f0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.024+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee40009040 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee50021020 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x5583817220f0 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee40009040 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x558381726ac0 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee40009040 2024-09-12T00:20:57.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee50021020 2024-09-12T00:20:57.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x558381726ac0 2024-09-12T00:20:57.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.028+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee40009040 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x5583817220f0 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fee4802e040 con 0x7fee50021020 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:57.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558381729f00 con 0x5583817220f0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838172a7a0 con 0x5583817220f0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838172b280 con 0x558381726ac0 2024-09-12T00:20:57.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 zone default found 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 4 Realm: () 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 zonegroup default 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838172b620 con 0x7fee40009040 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838172d430 con 0x558381726ac0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838172d840 con 0x558381726ac0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 started sync module instance, tier type = 2024-09-12T00:20:57.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:57.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.032+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172c8d0 con 0x7fee50021020 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023300858912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172d840 con 0x7fee50021020 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172e090 con 0x5583817220f0 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023300858912] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023300864992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172e000 con 0x5583817220f0 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.036+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172ee20 con 0x558381726ac0 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023300868400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172ed50 con 0x558381726ac0 2024-09-12T00:20:57.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172fd30 con 0x7fee50021020 2024-09-12T00:20:57.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023300864992] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023300867200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381730120 con 0x7fee50021020 2024-09-12T00:20:57.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381730ae0 con 0x5583817220f0 2024-09-12T00:20:57.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023300868400] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.040+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023300867200] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023300870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381730ae0 con 0x5583817220f0 2024-09-12T00:20:57.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381731380 con 0x7fee40009040 2024-09-12T00:20:57.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023300870672] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023300876096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583817310d0 con 0x7fee40009040 2024-09-12T00:20:57.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.044+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381731bc0 con 0x7fee40009040 2024-09-12T00:20:57.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.048+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.048+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023300876096] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.048+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023300877152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381731b80 con 0x7fee40009040 2024-09-12T00:20:57.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.048+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381732580 con 0x7fee40009040 2024-09-12T00:20:57.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.048+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023300877152] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023300880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381732540 con 0x7fee40009040 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=0 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=1 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=2 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=3 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=4 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=5 2024-09-12T00:20:57.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=6 2024-09-12T00:20:57.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023300880016] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 20 add_watcher() i=7 2024-09-12T00:20:57.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:57.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583817359a0 con 0x5583817220f0 2024-09-12T00:20:57.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.052+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023300883040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381732ec0 con 0x5583817220f0 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023300883040] v33'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fed077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 5 note: GC not initialized 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fed067fc640 20 reqs_thread_entry: start 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:57.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 Filter name: none 2024-09-12T00:20:57.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fec77fff640 20 reqs_thread_entry: start 2024-09-12T00:20:57.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:57.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583817590b0 con 0x7fee40009040 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-12T00:20:57.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558381757750 con 0x5583817220f0 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T00:20:57.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.056+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838175c6a0 con 0x7fee40009040 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94023301052048 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838175cf70 con 0x5583817220f0 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== watch-notify(notify (1) cookie 94023300870672 notify 141733920799 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5583817583e0 con 0x5583817220f0 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fed397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94023300870672 notifier 4830 bl.length()=649 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fed397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:57.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fed397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify cookie 94023301052048 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fed397fa640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fed18003eb0 con 0x5583817220f0 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== watch-notify(notify_complete (2) cookie 94023301052048 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558381757b40 con 0x5583817220f0 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838175ab30 con 0x5583817220f0 2024-09-12T00:20:57.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v33'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T00:20:57.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T00:20:57.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.060+0000 7fee584e89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-12T00:20:57.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94023301052048 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55838175cf70 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== watch-notify(notify (1) cookie 94023300868400 notify 141733920776 ret 0) ==== 219+0+0 (crc 0 0 0) 0x558381717400 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fed38ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94023300868400 notifier 4830 bl.length()=177 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fed38ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fed38ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(68 notify.2 [notify cookie 94023301052048 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fed38ff9640 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fec80003410 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== watch-notify(notify_complete (2) cookie 94023301052048 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558381717170 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.069 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:57.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fed077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023300883040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381756d50 con 0x5583817220f0 2024-09-12T00:20:57.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94023300883040] v33'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.064+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023300858912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381756d50 con 0x7fee50021020 2024-09-12T00:20:57.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94023300858912] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee584e89c0 20 remove_watcher() i=0 2024-09-12T00:20:57.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee584e89c0 2 removed watcher, disabling cache 2024-09-12T00:20:57.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023300864992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381756d50 con 0x5583817220f0 2024-09-12T00:20:57.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94023300864992] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee584e89c0 20 remove_watcher() i=1 2024-09-12T00:20:57.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.068+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023300868400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172dbe0 con 0x558381726ac0 2024-09-12T00:20:57.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee567ef640 1 -- 172.21.15.66:0/831885057 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94023300868400] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee5003c020 con 0x558381726ac0 2024-09-12T00:20:57.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee584e89c0 20 remove_watcher() i=2 2024-09-12T00:20:57.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023300867200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381756d50 con 0x7fee50021020 2024-09-12T00:20:57.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee55fee640 1 -- 172.21.15.66:0/831885057 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94023300867200] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee400be070 con 0x7fee50021020 2024-09-12T00:20:57.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee584e89c0 20 remove_watcher() i=3 2024-09-12T00:20:57.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.072+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023300870672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172e930 con 0x5583817220f0 2024-09-12T00:20:57.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94023300870672] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x5583817220f0 2024-09-12T00:20:57.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee584e89c0 20 remove_watcher() i=4 2024-09-12T00:20:57.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023300876096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172dbe0 con 0x7fee40009040 2024-09-12T00:20:57.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94023300876096] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee584e89c0 20 remove_watcher() i=5 2024-09-12T00:20:57.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.076+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023300877152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55838172e480 con 0x7fee40009040 2024-09-12T00:20:57.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94023300877152] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 20 remove_watcher() i=6 2024-09-12T00:20:57.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023300880016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558381756d50 con 0x7fee40009040 2024-09-12T00:20:57.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94023300880016] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee4800f070 con 0x7fee40009040 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 20 remove_watcher() i=7 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee40009040 msgr2=0x7fee400e2230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fee40009040 0x7fee400e2230 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583817220f0 msgr2=0x558381724580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583817220f0 0x558381724580 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee50021020 msgr2=0x7fee50020a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fee50021020 0x7fee50020a50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558381726ac0 msgr2=0x558381728eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x558381726ac0 0x558381728eb0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed20039a70 msgr2=0x7fed2003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed20039a70 0x7fed2003bf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee40003050 tx=0x7fee400d6000 comp rx=0 tx=0).stop 2024-09-12T00:20:57.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 msgr2=0x558381716c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fee50018fd0 tx=0x7fee50050020 comp rx=0 tx=0).stop 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee557ed640 1 -- 172.21.15.66:0/831885057 reap_dead start 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 shutdown_connections 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/831885057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583815f20b0 0x558381716c10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 >> 172.21.15.66:0/831885057 conn(0x558381709910 msgr2=0x558381707b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 shutdown_connections 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/831885057 wait complete. 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 msgr2=0x7fed3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 0x7fed3003bf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x5583816e7560 tx=0x7fee400c0ea0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 msgr2=0x558381700fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5583816e6ab0 tx=0x7fee5000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.080+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 shutdown_connections 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed30039a70 0x7fed3003bf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/3262516249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381700ba0 0x558381700fc0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 >> 172.21.15.66:0/3262516249 conn(0x5583816f6550 msgr2=0x5583816f6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 shutdown_connections 2024-09-12T00:20:57.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/3262516249 wait complete. 2024-09-12T00:20:57.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 msgr2=0x5583816ed1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 0x5583816ed1e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 msgr2=0x5583816f1d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 0x5583816f1d40 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 msgr2=0x7fed3c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 0x7fed3c03bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fee480016b0 tx=0x7fee480066c0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 msgr2=0x5583816e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fee4001b380 tx=0x7fee400180e0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 shutdown_connections 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5583816ef950 0x5583816f1d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5583815f6630 0x5583816ed1e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fed3c039a70 0x7fed3c03bf30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 --2- 172.21.15.66:0/1170427242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558381567740 0x5583816e6070 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 >> 172.21.15.66:0/1170427242 conn(0x5583815ede20 msgr2=0x5583816d9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 shutdown_connections 2024-09-12T00:20:57.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.084+0000 7fee584e89c0 1 -- 172.21.15.66:0/1170427242 wait complete. 2024-09-12T00:20:57.100 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.100 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.100 ERROR:root:0 2024-09-12T00:20:57.102 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:57.117 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000074e9af0d6022429-0066e233e9-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:20:57.118 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-12T00:20:57.141 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:57.142 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-12T00:20:57.174 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-12T00:20:57.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-12T00:20:57.218 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T00:20:57.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T00:20:57.242 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-12T00:20:57.242 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:57.255 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:57.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-12T00:20:57.269 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:57.269 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:57.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:57.269 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-12T00:20:57.312 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:57.312 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f56a14189c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c72525770 0x560c72525b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f56a14189c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c723d79c0 con 0x560c725288b0 2024-09-12T00:20:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f56a14189c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560c724276d0 con 0x560c72525770 2024-09-12T00:20:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f569ef1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c72525770 0x560c72525b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f569e71d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560c725288b0 0x560c7252aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41872/0 (socket says 172.21.15.66:41872) 2024-09-12T00:20:57.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f569e71d640 1 -- 172.21.15.66:0/3088657706 learned_addr learned my addr 172.21.15.66:0/3088657706 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:57.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f569ef1e640 1 -- 172.21.15.66:0/3088657706 >> v1:172.21.15.31:6789/0 conn(0x560c725288b0 legacy=0x560c7252aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.308+0000 7f569ef1e640 1 -- 172.21.15.66:0/3088657706 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c723cbca0 con 0x560c72525770 2024-09-12T00:20:57.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f569ef1e640 1 --2- 172.21.15.66:0/3088657706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72525b50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f569000a420 tx=0x7f569001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b8a3e49b4a73d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f569df1c640 1 -- 172.21.15.66:0/3088657706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900af070 con 0x560c72525770 2024-09-12T00:20:57.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f569df1c640 1 -- 172.21.15.66:0/3088657706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56900aa530 con 0x560c72525770 2024-09-12T00:20:57.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f569df1c640 1 -- 172.21.15.66:0/3088657706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900aa850 con 0x560c72525770 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 -- 172.21.15.66:0/3088657706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 msgr2=0x560c72525b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 --2- 172.21.15.66:0/3088657706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72525b50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f569000a420 tx=0x7f569001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 -- 172.21.15.66:0/3088657706 shutdown_connections 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 --2- 172.21.15.66:0/3088657706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72525b50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 -- 172.21.15.66:0/3088657706 >> 172.21.15.66:0/3088657706 conn(0x560c72499080 msgr2=0x560c72499490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 -- 172.21.15.66:0/3088657706 shutdown_connections 2024-09-12T00:20:57.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.312+0000 7f56a14189c0 1 -- 172.21.15.66:0/3088657706 wait complete. 2024-09-12T00:20:57.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f56a14189c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f56a14189c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c7242b680 con 0x560c72525770 2024-09-12T00:20:57.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f569ef1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f569ef1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35728/0 (socket says 172.21.15.66:35728) 2024-09-12T00:20:57.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f569ef1e640 1 -- 172.21.15.66:0/3775753809 learned_addr learned my addr 172.21.15.66:0/3775753809 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.328+0000 7f569ef1e640 1 -- 172.21.15.66:0/3775753809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c723a6da0 con 0x560c72525770 2024-09-12T00:20:57.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 --2- 172.21.15.66:0/3775753809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f56900ad040 tx=0x7f56900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7bbc11a302a595 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558ce09640 1 -- 172.21.15.66:0/3775753809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900af040 con 0x560c72525770 2024-09-12T00:20:57.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558ce09640 1 -- 172.21.15.66:0/3775753809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56900aaa60 con 0x560c72525770 2024-09-12T00:20:57.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558ce09640 1 -- 172.21.15.66:0/3775753809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900aad40 con 0x560c72525770 2024-09-12T00:20:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/3775753809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 msgr2=0x560c72610a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 --2- 172.21.15.66:0/3775753809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f56900ad040 tx=0x7f56900033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/3775753809 shutdown_connections 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 --2- 172.21.15.66:0/3775753809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72610a80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/3775753809 >> 172.21.15.66:0/3775753809 conn(0x560c72499080 msgr2=0x560c7260c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/3775753809 shutdown_connections 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/3775753809 wait complete. 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c723cda50 con 0x560c72525770 2024-09-12T00:20:57.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35736/0 (socket says 172.21.15.66:35736) 2024-09-12T00:20:57.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 -- 172.21.15.66:0/4010121427 learned_addr learned my addr 172.21.15.66:0/4010121427 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c72618580 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f569ef1e640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f569001b4b0 tx=0x7f5690017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558b606640 1 -- 172.21.15.66:0/4010121427 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900c5070 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558b606640 1 -- 172.21.15.66:0/4010121427 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56900c17c0 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c72618810 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f558b606640 1 -- 172.21.15.66:0/4010121427 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56900c1aa0 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.332+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c72619240 con 0x560c72525770 2024-09-12T00:20:57.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f558b606640 1 -- 172.21.15.66:0/4010121427 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f56900c8070 con 0x560c72525770 2024-09-12T00:20:57.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f558b606640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 0x7f558403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f558b606640 1 -- 172.21.15.66:0/4010121427 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f56900bb070 con 0x560c72525770 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569e71d640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 0x7f558403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 0x560c7261f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7261f6d0 con 0x560c725288b0 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569f71f640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 0x560c7261f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569e71d640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 0x7f558403bf80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5688004180 tx=0x7f5688001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569f71f640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 0x560c7261f190 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569f71f640 1 -- 172.21.15.66:0/4010121427 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56980083f0 con 0x560c725288b0 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72619580 con 0x560c725288b0 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569f71f640 1 -- 172.21.15.66:0/4010121427 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56980083f0 con 0x560c725288b0 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 0x560c72623d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72624450 con 0x560c72621990 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569ef1e640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 0x560c72623d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569ef1e640 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 0x560c72623d80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f569ef1e640 1 -- 172.21.15.66:0/4010121427 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56900d1070 con 0x560c72621990 2024-09-12T00:20:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.336+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72620800 con 0x560c725288b0 2024-09-12T00:20:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 -- 172.21.15.66:0/4010121427 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56980083f0 con 0x560c725288b0 2024-09-12T00:20:57.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72620ce0 con 0x560c72621990 2024-09-12T00:20:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569ef1e640 1 -- 172.21.15.66:0/4010121427 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56900d1070 con 0x560c72621990 2024-09-12T00:20:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c72438450 con 0x560c72632b60 2024-09-12T00:20:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35738/0 (socket says 172.21.15.66:35738) 2024-09-12T00:20:57.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 -- 172.21.15.66:0/2911793454 learned_addr learned my addr 172.21.15.66:0/2911793454 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 -- 172.21.15.66:0/2911793454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c726335c0 con 0x560c72632b60 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f569f71f640 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x560c72619050 tx=0x7f569800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f5588e01640 1 -- 172.21.15.66:0/2911793454 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f569801c020 con 0x560c72632b60 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f5588e01640 1 -- 172.21.15.66:0/2911793454 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698007d00 con 0x560c72632b60 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c72633e20 con 0x560c72632b60 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f5588e01640 1 -- 172.21.15.66:0/2911793454 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698018440 con 0x560c72632b60 2024-09-12T00:20:57.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.340+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c72634390 con 0x560c72632b60 2024-09-12T00:20:57.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f5588e01640 1 -- 172.21.15.66:0/2911793454 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f569801f020 con 0x560c72632b60 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f5588e01640 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 0x7f557803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f5588e01640 1 -- 172.21.15.66:0/2911793454 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5698051d20 con 0x560c72632b60 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 0x7f557803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 0x7f557803bf80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900e9ab0 tx=0x7f56900e5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c726111f0 con 0x560c7263f4e0 2024-09-12T00:20:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35754/0 (socket says 172.21.15.66:35754) 2024-09-12T00:20:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569f71f640 1 -- 172.21.15.66:0/899807345 learned_addr learned my addr 172.21.15.66:0/899807345 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569f71f640 1 -- 172.21.15.66:0/899807345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c7263fe90 con 0x560c7263f4e0 2024-09-12T00:20:57.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f569f71f640 1 --2- 172.21.15.66:0/899807345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5698021fd0 tx=0x7f56980168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c68997fdcc98fda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f55827fc640 1 -- 172.21.15.66:0/899807345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698021400 con 0x560c7263f4e0 2024-09-12T00:20:57.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f55827fc640 1 -- 172.21.15.66:0/899807345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698051040 con 0x560c7263f4e0 2024-09-12T00:20:57.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f55827fc640 1 -- 172.21.15.66:0/899807345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698029350 con 0x560c7263f4e0 2024-09-12T00:20:57.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- 172.21.15.66:0/899807345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 msgr2=0x560c7263f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 --2- 172.21.15.66:0/899807345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5698021fd0 tx=0x7f56980168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- 172.21.15.66:0/899807345 shutdown_connections 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 --2- 172.21.15.66:0/899807345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c7263f8c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- 172.21.15.66:0/899807345 >> 172.21.15.66:0/899807345 conn(0x560c7263b910 msgr2=0x560c72639b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- 172.21.15.66:0/899807345 shutdown_connections 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- 172.21.15.66:0/899807345 wait complete. 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 Processor -- start 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.344+0000 7f56a14189c0 1 -- start start 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c726404f0 con 0x560c7263f4e0 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35762/0 (socket says 172.21.15.66:35762) 2024-09-12T00:20:57.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 learned_addr learned my addr 172.21.15.66:0/2692317241 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c72646f20 con 0x560c7263f4e0 2024-09-12T00:20:57.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569f71f640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5698021fd0 tx=0x7f569804ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 -- 172.21.15.66:0/2692317241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698029da0 con 0x560c7263f4e0 2024-09-12T00:20:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 -- 172.21.15.66:0/2692317241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5698051050 con 0x560c7263f4e0 2024-09-12T00:20:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c726471b0 con 0x560c7263f4e0 2024-09-12T00:20:57.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 -- 172.21.15.66:0/2692317241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5698020b90 con 0x560c7263f4e0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c72647b60 con 0x560c7263f4e0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 -- 172.21.15.66:0/2692317241 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5698016040 con 0x560c7263f4e0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5568039ac0 0x7f556803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f5580ff9640 1 -- 172.21.15.66:0/2692317241 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f5698032070 con 0x560c7263f4e0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5568039ac0 0x7f556803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c72651f30 0x560c726543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72654b40 con 0x560c72651f30 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569e71d640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c72651f30 0x560c726543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.348+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5568039ac0 0x7f556803bf80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f56900b48f0 tx=0x7f56900d7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569e71d640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c72651f30 0x560c726543f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568800e640 con 0x560c72651f30 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 realm 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72651280 con 0x560c72651f30 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568800e640 con 0x560c72651f30 2024-09-12T00:20:57.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72655640 con 0x560c72651f30 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f568800e640 con 0x560c72651f30 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72655f10 con 0x560c72651f30 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f568800e640 con 0x560c72651f30 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72656930 0x560c72658d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c726593f0 con 0x560c72656930 2024-09-12T00:20:57.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72656930 0x560c72658d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72656930 0x560c72658d20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 20 searching for the correct realm 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5698021020 0x7f5698051200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5698021020 0x7f5698051200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5698021020 0x7f5698051200 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569ef1e640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f56900ca070 0x7f56900a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.352+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f56900ca070 0x7f56900a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f56900ca070 0x7f56900a93a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568800e640 con 0x7f56900ca070 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f568800e640 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.356+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.360+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x560c72651f30 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72656930 2024-09-12T00:20:57.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.364+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f56900ca070 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5688029040 con 0x7f56900ca070 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x560c72651f30 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c7265acc0 con 0x7f5698021020 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:57.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72659d70 con 0x560c72651f30 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7265a610 con 0x560c72651f30 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7265b0f0 con 0x560c72656930 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 zone default found 2024-09-12T00:20:57.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 4 Realm: () 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 zonegroup default 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7265b490 con 0x7f56900ca070 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7265d2a0 con 0x560c72656930 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7265d6e0 con 0x560c72656930 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 started sync module instance, tier type = 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.368+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265c710 con 0x7f5698021020 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94611458867808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265d6e0 con 0x7f5698021020 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265df30 con 0x560c72651f30 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94611458867808] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94611458873984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265dea0 con 0x560c72651f30 2024-09-12T00:20:57.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.372+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265ecc0 con 0x560c72656930 2024-09-12T00:20:57.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94611458877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265ebf0 con 0x560c72656930 2024-09-12T00:20:57.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265fbc0 con 0x7f5698021020 2024-09-12T00:20:57.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94611458873984] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94611458876192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265fb80 con 0x7f5698021020 2024-09-12T00:20:57.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c726605d0 con 0x560c72651f30 2024-09-12T00:20:57.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.376+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94611458877392] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.380+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94611458876192] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.380+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.380+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94611458883872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265fb80 con 0x560c72651f30 2024-09-12T00:20:57.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.380+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72660540 con 0x7f56900ca070 2024-09-12T00:20:57.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94611458883872] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94611458881504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c726609f0 con 0x7f56900ca070 2024-09-12T00:20:57.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c726613b0 con 0x7f56900ca070 2024-09-12T00:20:57.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94611458881504] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94611458884928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72661590 con 0x7f56900ca070 2024-09-12T00:20:57.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.384+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72661de0 con 0x7f56900ca070 2024-09-12T00:20:57.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94611458884928] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94611458888176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72661c00 con 0x7f56900ca070 2024-09-12T00:20:57.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=0 2024-09-12T00:20:57.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=1 2024-09-12T00:20:57.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=2 2024-09-12T00:20:57.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=3 2024-09-12T00:20:57.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=4 2024-09-12T00:20:57.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=5 2024-09-12T00:20:57.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=6 2024-09-12T00:20:57.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94611458888176] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 20 add_watcher() i=7 2024-09-12T00:20:57.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:57.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72665170 con 0x560c72651f30 2024-09-12T00:20:57.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.388+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94611458889360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72662630 con 0x560c72651f30 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94611458889360] v33'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f55557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 5 note: GC not initialized 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f54cffff640 20 reqs_thread_entry: start 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 Filter name: none 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f54cdffb640 20 reqs_thread_entry: start 2024-09-12T00:20:57.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:57.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c72688860 con 0x7f56900ca070 2024-09-12T00:20:57.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T00:20:57.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:57.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:57.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.392+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7268f500 con 0x7f56900ca070 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f56a14189c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f56a14189c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f56a14189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94611459075952 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c7268ac10 con 0x560c72651f30 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94611458883872 notify 141733920801 ret 0) ==== 678+0+0 (crc 0 0 0) 0x560c723d79c0 con 0x560c72651f30 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f55827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94611458883872 notifier 4837 bl.length()=636 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f55827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f55827fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:57.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94611459075952 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f55827fc640 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5564003eb0 con 0x560c72651f30 2024-09-12T00:20:57.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.396+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94611459075952 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f568803d8c0 con 0x560c72651f30 2024-09-12T00:20:57.404 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f55557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94611458889360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72686560 con 0x560c72651f30 2024-09-12T00:20:57.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94611458889360] v33'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94611458867808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72686560 con 0x7f5698021020 2024-09-12T00:20:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94611458867808] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f56a14189c0 20 remove_watcher() i=0 2024-09-12T00:20:57.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f56a14189c0 2 removed watcher, disabling cache 2024-09-12T00:20:57.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.400+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94611458873984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72686560 con 0x560c72651f30 2024-09-12T00:20:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.404+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94611458873984] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.404+0000 7f56a14189c0 20 remove_watcher() i=1 2024-09-12T00:20:57.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.404+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94611458877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265da80 con 0x560c72656930 2024-09-12T00:20:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f569f71f640 1 -- 172.21.15.66:0/2692317241 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94611458877392] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f569803c020 con 0x560c72656930 2024-09-12T00:20:57.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f56a14189c0 20 remove_watcher() i=2 2024-09-12T00:20:57.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94611458876192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72686560 con 0x7f5698021020 2024-09-12T00:20:57.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f569ef1e640 1 -- 172.21.15.66:0/2692317241 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94611458876192] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56900f2040 con 0x7f5698021020 2024-09-12T00:20:57.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f56a14189c0 20 remove_watcher() i=3 2024-09-12T00:20:57.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.408+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94611458883872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265e7d0 con 0x560c72651f30 2024-09-12T00:20:57.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94611458883872] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x560c72651f30 2024-09-12T00:20:57.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f56a14189c0 20 remove_watcher() i=4 2024-09-12T00:20:57.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94611458881504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265da80 con 0x7f56900ca070 2024-09-12T00:20:57.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94611458881504] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f56a14189c0 20 remove_watcher() i=5 2024-09-12T00:20:57.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.412+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94611458884928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c72686560 con 0x7f56900ca070 2024-09-12T00:20:57.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94611458884928] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 20 remove_watcher() i=6 2024-09-12T00:20:57.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94611458888176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c7265da80 con 0x7f56900ca070 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94611458888176] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5688039040 con 0x7f56900ca070 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 20 remove_watcher() i=7 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f56900ca070 msgr2=0x7f56900a93a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f56900ca070 0x7f56900a93a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c72651f30 msgr2=0x560c726543f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c72651f30 0x560c726543f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5698021020 msgr2=0x7f5698051200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f5698021020 0x7f5698051200 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72656930 msgr2=0x560c72658d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72656930 0x560c72658d20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5568039ac0 msgr2=0x7f556803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5568039ac0 0x7f556803bf80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f56900b48f0 tx=0x7f56900d7040 comp rx=0 tx=0).stop 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 msgr2=0x560c726469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f569e71d640 1 -- 172.21.15.66:0/2692317241 reap_dead start 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5698021fd0 tx=0x7f569804ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 shutdown_connections 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2692317241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c7263f4e0 0x560c726469c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 >> 172.21.15.66:0/2692317241 conn(0x560c7263b910 msgr2=0x560c72639b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 shutdown_connections 2024-09-12T00:20:57.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.416+0000 7f56a14189c0 1 -- 172.21.15.66:0/2692317241 wait complete. 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 msgr2=0x7f557803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 0x7f557803bf80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900e9ab0 tx=0x7f56900e5040 comp rx=0 tx=0).stop 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 msgr2=0x560c72632f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x560c72619050 tx=0x7f569800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 shutdown_connections 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5578039ac0 0x7f557803bf80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/2911793454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72632b60 0x560c72632f80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 >> 172.21.15.66:0/2911793454 conn(0x560c72628510 msgr2=0x560c726288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 shutdown_connections 2024-09-12T00:20:57.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/2911793454 wait complete. 2024-09-12T00:20:57.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 msgr2=0x560c7261f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 0x560c7261f190 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 msgr2=0x560c72623d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 0x560c72623d80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 msgr2=0x7f558403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 0x7f558403bf80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5688004180 tx=0x7f5688001340 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 msgr2=0x560c72618020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f569001b4b0 tx=0x7f5690017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 shutdown_connections 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c72621990 0x560c72623d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c725288b0 0x560c7261f190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f5584039ac0 0x7f558403bf80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 --2- 172.21.15.66:0/4010121427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c72525770 0x560c72618020 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 >> 172.21.15.66:0/4010121427 conn(0x560c72499080 msgr2=0x560c7260b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 shutdown_connections 2024-09-12T00:20:57.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.420+0000 7f56a14189c0 1 -- 172.21.15.66:0/4010121427 wait complete. 2024-09-12T00:20:57.437 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.437 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.437 ERROR:root:0 2024-09-12T00:20:57.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T00:20:57.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T00:20:57.437 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-12T00:20:57.529 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:57.529 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:57.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1889fdf9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c6b65f810 0x560c6b661c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1889fdf9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c6b50f9c0 con 0x560c6b5cf740 2024-09-12T00:20:57.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1889fdf9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x560c6b55f6d0 con 0x560c6b65f810 2024-09-12T00:20:57.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f18872e4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c6b65f810 0x560c6b661c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1887ae5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x560c6b5cf740 0x560c6b65e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41874/0 (socket says 172.21.15.66:41874) 2024-09-12T00:20:57.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f1887ae5640 1 -- 172.21.15.66:0/1296052337 learned_addr learned my addr 172.21.15.66:0/1296052337 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:57.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f18872e4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x560c6b65f810 0x560c6b661c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35764/0 (socket says 172.21.15.66:35764) 2024-09-12T00:20:57.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f18872e4640 1 -- 172.21.15.66:0/1296052337 >> v1:172.21.15.31:6789/0 conn(0x560c6b5cf740 legacy=0x560c6b65e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.524+0000 7f18872e4640 1 -- 172.21.15.66:0/1296052337 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b503ca0 con 0x560c6b65f810 2024-09-12T00:20:57.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f18872e4640 1 --2- 172.21.15.66:0/1296052337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b65f810 0x560c6b661c00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f187000a420 tx=0x7f187001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e04114d620961ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f1886ae3640 1 -- 172.21.15.66:0/1296052337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18700b0070 con 0x560c6b65f810 2024-09-12T00:20:57.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f1886ae3640 1 -- 172.21.15.66:0/1296052337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18700a3dc0 con 0x560c6b65f810 2024-09-12T00:20:57.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f1886ae3640 1 -- 172.21.15.66:0/1296052337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18700ab570 con 0x560c6b65f810 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1296052337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b65f810 msgr2=0x560c6b661c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.528+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/1296052337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b65f810 0x560c6b661c00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f187000a420 tx=0x7f187001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.532+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1296052337 shutdown_connections 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.532+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/1296052337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b65f810 0x560c6b661c00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.532+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1296052337 >> 172.21.15.66:0/1296052337 conn(0x560c6b655e20 msgr2=0x560c6b658240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.532+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1296052337 shutdown_connections 2024-09-12T00:20:57.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.532+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1296052337 wait complete. 2024-09-12T00:20:57.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.544+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.544+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c6b563680 con 0x560c6b5cf740 2024-09-12T00:20:57.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35774/0 (socket says 172.21.15.66:35774) 2024-09-12T00:20:57.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 -- 172.21.15.66:0/2511052943 learned_addr learned my addr 172.21.15.66:0/2511052943 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 -- 172.21.15.66:0/2511052943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b4deda0 con 0x560c6b5cf740 2024-09-12T00:20:57.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 --2- 172.21.15.66:0/2511052943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1878001e00 tx=0x7f187800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b444327b019f3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1775e0b640 1 -- 172.21.15.66:0/2511052943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1878012020 con 0x560c6b5cf740 2024-09-12T00:20:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1775e0b640 1 -- 172.21.15.66:0/2511052943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187800e690 con 0x560c6b5cf740 2024-09-12T00:20:57.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1775e0b640 1 -- 172.21.15.66:0/2511052943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187800ea10 con 0x560c6b5cf740 2024-09-12T00:20:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2511052943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 msgr2=0x560c6b65b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2511052943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1878001e00 tx=0x7f187800b6d0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2511052943 shutdown_connections 2024-09-12T00:20:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2511052943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b65b5f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2511052943 >> 172.21.15.66:0/2511052943 conn(0x560c6b655e20 msgr2=0x560c6b742560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2511052943 shutdown_connections 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2511052943 wait complete. 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1889fdf9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c6b505a50 con 0x560c6b5cf740 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35782/0 (socket says 172.21.15.66:35782) 2024-09-12T00:20:57.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.548+0000 7f1887ae5640 1 -- 172.21.15.66:0/3672672874 learned_addr learned my addr 172.21.15.66:0/3672672874 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1887ae5640 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b7506d0 con 0x560c6b5cf740 2024-09-12T00:20:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1887ae5640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x560c6b65b1b0 tx=0x7f1878000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 -- 172.21.15.66:0/3672672874 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1878012030 con 0x560c6b5cf740 2024-09-12T00:20:57.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c6b750960 con 0x560c6b5cf740 2024-09-12T00:20:57.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 -- 172.21.15.66:0/3672672874 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187801a750 con 0x560c6b5cf740 2024-09-12T00:20:57.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 -- 172.21.15.66:0/3672672874 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f187801aa50 con 0x560c6b5cf740 2024-09-12T00:20:57.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6b751310 con 0x560c6b5cf740 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 -- 172.21.15.66:0/3672672874 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1878015020 con 0x560c6b5cf740 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 0x7f177003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f176ffff640 1 -- 172.21.15.66:0/3672672874 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1878020030 con 0x560c6b5cf740 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f18872e4640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 0x7f177003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 0x560c6b7572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b757820 con 0x560c6b65f810 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f18882e6640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 0x560c6b7572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f18872e4640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 0x7f177003bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f18700ad000 tx=0x7f18700a5070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f18882e6640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 0x560c6b7572e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f18882e6640 1 -- 172.21.15.66:0/3672672874 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18800083f0 con 0x560c6b65f810 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.552+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b757c70 con 0x560c6b65f810 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 -- 172.21.15.66:0/3672672874 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18800083f0 con 0x560c6b65f810 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 0x560c6b75be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b75c540 con 0x560c6b759a80 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1887ae5640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 0x560c6b75be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1887ae5640 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 0x560c6b75be70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1887ae5640 1 -- 172.21.15.66:0/3672672874 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1878008030 con 0x560c6b759a80 2024-09-12T00:20:57.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b758920 con 0x560c6b65f810 2024-09-12T00:20:57.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 -- 172.21.15.66:0/3672672874 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18800083f0 con 0x560c6b65f810 2024-09-12T00:20:57.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b758e00 con 0x560c6b759a80 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1887ae5640 1 -- 172.21.15.66:0/3672672874 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1878008030 con 0x560c6b759a80 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f1889fdf9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c6b570450 con 0x560c6b76acb0 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35788/0 (socket says 172.21.15.66:35788) 2024-09-12T00:20:57.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 -- 172.21.15.66:0/2022175487 learned_addr learned my addr 172.21.15.66:0/2022175487 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 -- 172.21.15.66:0/2022175487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b76b710 con 0x560c6b76acb0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.556+0000 7f18882e6640 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x560c6b7511a0 tx=0x7f188000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 -- 172.21.15.66:0/2022175487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188001c020 con 0x560c6b76acb0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 -- 172.21.15.66:0/2022175487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880007d00 con 0x560c6b76acb0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 -- 172.21.15.66:0/2022175487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880018440 con 0x560c6b76acb0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c6b76bf70 con 0x560c6b76acb0 2024-09-12T00:20:57.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6b76c4e0 con 0x560c6b76acb0 2024-09-12T00:20:57.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 -- 172.21.15.66:0/2022175487 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f188001f020 con 0x560c6b76acb0 2024-09-12T00:20:57.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 0x7f176003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f176d7fa640 1 -- 172.21.15.66:0/2022175487 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1880051de0 con 0x560c6b76acb0 2024-09-12T00:20:57.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1887ae5640 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 0x7f176003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1887ae5640 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 0x7f176003bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f187804ece0 tx=0x7f187802c950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f1889fdf9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c6b65be40 con 0x560c6b778620 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35798/0 (socket says 172.21.15.66:35798) 2024-09-12T00:20:57.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f18882e6640 1 -- 172.21.15.66:0/1838034042 learned_addr learned my addr 172.21.15.66:0/1838034042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.560+0000 7f18882e6640 1 -- 172.21.15.66:0/1838034042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b779010 con 0x560c6b778620 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 --2- 172.21.15.66:0/1838034042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1880021fd0 tx=0x7f18800168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0325cfeb42bb7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1766ffd640 1 -- 172.21.15.66:0/1838034042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880029d50 con 0x560c6b778620 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1766ffd640 1 -- 172.21.15.66:0/1838034042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880021400 con 0x560c6b778620 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1766ffd640 1 -- 172.21.15.66:0/1838034042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880029350 con 0x560c6b778620 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1838034042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 msgr2=0x560c6b778a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/1838034042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1880021fd0 tx=0x7f18800168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1838034042 shutdown_connections 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/1838034042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b778a20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1838034042 >> 172.21.15.66:0/1838034042 conn(0x560c6b773a40 msgr2=0x560c6b771c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1838034042 shutdown_connections 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/1838034042 wait complete. 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 Processor -- start 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- start start 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c6b777570 con 0x560c6b778620 2024-09-12T00:20:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35802/0 (socket says 172.21.15.66:35802) 2024-09-12T00:20:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 learned_addr learned my addr 172.21.15.66:0/4149743124 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6b77f030 con 0x560c6b778620 2024-09-12T00:20:57.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f18882e6640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1880021fd0 tx=0x7f188004ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f17657fa640 1 -- 172.21.15.66:0/4149743124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1880039070 con 0x560c6b778620 2024-09-12T00:20:57.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f17657fa640 1 -- 172.21.15.66:0/4149743124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880029350 con 0x560c6b778620 2024-09-12T00:20:57.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c6b77f2c0 con 0x560c6b778620 2024-09-12T00:20:57.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f17657fa640 1 -- 172.21.15.66:0/4149743124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18800203b0 con 0x560c6b778620 2024-09-12T00:20:57.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.564+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6b77fc70 con 0x560c6b778620 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f17657fa640 1 -- 172.21.15.66:0/4149743124 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f188003c070 con 0x560c6b778620 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f17657fa640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1750039a70 0x7f175003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f17657fa640 1 -- 172.21.15.66:0/4149743124 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1880031070 con 0x560c6b778620 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1887ae5640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1750039a70 0x7f175003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b78a000 0x560c6b78c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b78cc10 con 0x560c6b78a000 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b78a000 0x560c6b78c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1887ae5640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1750039a70 0x7f175003bf30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f187804ef40 tx=0x7f187804c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b78a000 0x560c6b78c4c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 realm 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b78d040 con 0x560c6b78a000 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b78d910 con 0x560c6b78a000 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b78dcb0 con 0x560c6b78a000 2024-09-12T00:20:57.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b78ea10 0x560c6b790e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b791410 con 0x560c6b78ea10 2024-09-12T00:20:57.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18882e6640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b78ea10 0x560c6b790e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18882e6640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b78ea10 0x560c6b790e00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:57.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 20 searching for the correct realm 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.568+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c6b792ce0 con 0x560c6b78ea10 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18882e6640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1880021020 0x7f188002a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c6b792ce0 con 0x7f1880021020 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f1887ae5640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1880021020 0x7f188002a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f1887ae5640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1880021020 0x7f188002a7f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f1887ae5640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1878017050 0x7f1878016570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c6b792ce0 con 0x7f1878017050 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1878017050 0x7f1878016570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1878017050 0x7f1878016570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c6b792ce0 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c6b792ce0 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.572+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1878017050 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1880021020 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78a000 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1880021020 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78a000 2024-09-12T00:20:57.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1880021020 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1878017050 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.576+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x560c6b78a000 2024-09-12T00:20:57.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x560c6b78a000 2024-09-12T00:20:57.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1878017050 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x7f1880021020 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x560c6b78a000 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1878017050 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.580+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1878017050 2024-09-12T00:20:57.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1880021020 2024-09-12T00:20:57.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78ea10 2024-09-12T00:20:57.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f188006b040 con 0x7f1878017050 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x560c6b78a000 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f18700cd040 con 0x7f1880021020 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:57.592 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b791d90 con 0x560c6b78a000 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7925e0 con 0x560c6b78a000 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7925e0 con 0x560c6b78ea10 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:57.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 zone default found 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 4 Realm: () 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 zonegroup default 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.594 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.584+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b793110 con 0x7f1878017050 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b794ef0 con 0x560c6b78ea10 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b795300 con 0x560c6b78ea10 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 started sync module instance, tier type = 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b794390 con 0x7f1880021020 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94611342704352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b795300 con 0x7f1880021020 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b795b50 con 0x560c6b78a000 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.588+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94611342704352] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94611342710432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b795ac0 con 0x560c6b78a000 2024-09-12T00:20:57.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b796920 con 0x560c6b78ea10 2024-09-12T00:20:57.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94611342710432] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94611342712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7968e0 con 0x560c6b78ea10 2024-09-12T00:20:57.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.592+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b797330 con 0x7f1880021020 2024-09-12T00:20:57.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94611342716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b797750 con 0x7f1880021020 2024-09-12T00:20:57.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b798200 con 0x560c6b78a000 2024-09-12T00:20:57.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94611342712640] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94611342716544] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94611342713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7972a0 con 0x560c6b78a000 2024-09-12T00:20:57.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.596+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b798aa0 con 0x7f1878017050 2024-09-12T00:20:57.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94611342713696] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94611342720224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7972a0 con 0x7f1878017050 2024-09-12T00:20:57.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b798ff0 con 0x7f1878017050 2024-09-12T00:20:57.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94611342720224] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94611342723808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b798fb0 con 0x7f1878017050 2024-09-12T00:20:57.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.600+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7999b0 con 0x7f1878017050 2024-09-12T00:20:57.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94611342726336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b799dd0 con 0x7f1878017050 2024-09-12T00:20:57.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=0 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=1 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=2 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=3 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=4 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=5 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94611342723808] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=6 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94611342726336] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 20 add_watcher() i=7 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b798460 con 0x560c6b78a000 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.604+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94611342722144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b79a310 con 0x560c6b78a000 2024-09-12T00:20:57.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94611342722144] v33'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f173dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 5 note: GC not initialized 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f173cfe1640 20 reqs_thread_entry: start 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 Filter name: none 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f16b67fc640 20 reqs_thread_entry: start 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7c0440 con 0x7f1878017050 2024-09-12T00:20:57.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7beae0 con 0x560c6b78ea10 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T00:20:57.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T00:20:57.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.608+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7bf600 con 0x7f1878017050 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v33'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x7f1878017050 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1889fdf9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1889fdf9c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1889fdf9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94611342880752 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7c40f0 con 0x7f1880021020 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== watch-notify(notify (1) cookie 94611342704352 notify 141733920791 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f1878057040 con 0x7f1880021020 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1766ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94611342704352 notifier 4844 bl.length()=533 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1766ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T00:20:57.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1766ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T00:20:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(65 notify.0 [notify cookie 94611342880752 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1766ffd640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f174c003eb0 con 0x7f1880021020 2024-09-12T00:20:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== watch-notify(notify_complete (2) cookie 94611342880752 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c6b751310 con 0x7f1880021020 2024-09-12T00:20:57.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.612+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7c40b0 con 0x560c6b78ea10 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v33'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94611342900224 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7c4520 con 0x560c6b78a000 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94611342710432 notify 141733920802 ret 0) ==== 218+0+0 (crc 0 0 0) 0x560c6b7c3a30 con 0x560c6b78a000 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f17667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94611342710432 notifier 4844 bl.length()=176 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(68 notify.1 [notify cookie 94611342900224 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f17667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f17667fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T00:20:57.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f17667fc640 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f16bc003410 con 0x560c6b78a000 2024-09-12T00:20:57.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700aba40 con 0x560c6b78a000 2024-09-12T00:20:57.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94611342900224 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c6b7becb0 con 0x560c6b78a000 2024-09-12T00:20:57.622 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-12T00:20:57.615554Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.615541Z","tags":[],"group_ids":[]} 2024-09-12T00:20:57.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f173dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94611342722144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7be140 con 0x560c6b78a000 2024-09-12T00:20:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94611342722144] v33'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x560c6b78a000 2024-09-12T00:20:57.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.616+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94611342704352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7be140 con 0x7f1880021020 2024-09-12T00:20:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94611342704352] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1889fdf9c0 20 remove_watcher() i=0 2024-09-12T00:20:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1889fdf9c0 2 removed watcher, disabling cache 2024-09-12T00:20:57.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94611342710432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7be140 con 0x560c6b78a000 2024-09-12T00:20:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94611342710432] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x560c6b78a000 2024-09-12T00:20:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1889fdf9c0 20 remove_watcher() i=1 2024-09-12T00:20:57.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.620+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94611342712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7956a0 con 0x560c6b78ea10 2024-09-12T00:20:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f18882e6640 1 -- 172.21.15.66:0/4149743124 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94611342712640] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f188003b030 con 0x560c6b78ea10 2024-09-12T00:20:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f1889fdf9c0 20 remove_watcher() i=2 2024-09-12T00:20:57.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94611342716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b795f40 con 0x7f1880021020 2024-09-12T00:20:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f1887ae5640 1 -- 172.21.15.66:0/4149743124 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94611342716544] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1878008030 con 0x7f1880021020 2024-09-12T00:20:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f1889fdf9c0 20 remove_watcher() i=3 2024-09-12T00:20:57.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.624+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94611342713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7956a0 con 0x560c6b78a000 2024-09-12T00:20:57.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94611342713696] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x560c6b78a000 2024-09-12T00:20:57.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f1889fdf9c0 20 remove_watcher() i=4 2024-09-12T00:20:57.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94611342720224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b796e80 con 0x7f1878017050 2024-09-12T00:20:57.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94611342720224] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x7f1878017050 2024-09-12T00:20:57.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f1889fdf9c0 20 remove_watcher() i=5 2024-09-12T00:20:57.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.628+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94611342723808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b7956a0 con 0x7f1878017050 2024-09-12T00:20:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94611342723808] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x7f1878017050 2024-09-12T00:20:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 20 remove_watcher() i=6 2024-09-12T00:20:57.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94611342726336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c6b796e80 con 0x7f1878017050 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94611342726336] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18700d6040 con 0x7f1878017050 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 20 remove_watcher() i=7 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1878017050 msgr2=0x7f1878016570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1878017050 0x7f1878016570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b78a000 msgr2=0x560c6b78c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b78a000 0x560c6b78c4c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1880021020 msgr2=0x7f188002a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1880021020 0x7f188002a7f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.632+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b78ea10 msgr2=0x560c6b790e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b78ea10 0x560c6b790e00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1750039a70 msgr2=0x7f175003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1750039a70 0x7f175003bf30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f187804ef40 tx=0x7f187804c000 comp rx=0 tx=0).stop 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 msgr2=0x560c6b77ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1880021fd0 tx=0x7f188004ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f18872e4640 1 -- 172.21.15.66:0/4149743124 reap_dead start 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 shutdown_connections 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/4149743124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b778620 0x560c6b77ead0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 >> 172.21.15.66:0/4149743124 conn(0x560c6b773a40 msgr2=0x560c6b771c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 shutdown_connections 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/4149743124 wait complete. 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 msgr2=0x7f176003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 0x7f176003bf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f187804ece0 tx=0x7f187802c950 comp rx=0 tx=0).stop 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 msgr2=0x560c6b76b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x560c6b7511a0 tx=0x7f188000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 shutdown_connections 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1760039ac0 0x7f176003bf80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/2022175487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b76acb0 0x560c6b76b0d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 >> 172.21.15.66:0/2022175487 conn(0x560c6b760660 msgr2=0x560c6b760a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 shutdown_connections 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/2022175487 wait complete. 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 msgr2=0x560c6b7572e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 0x560c6b7572e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 msgr2=0x560c6b75be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 0x560c6b75be70 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 msgr2=0x7f177003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 0x7f177003bf30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f18700ad000 tx=0x7f18700a5070 comp rx=0 tx=0).stop 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 msgr2=0x560c6b750170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x560c6b65b1b0 tx=0x7f1878000bd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 shutdown_connections 2024-09-12T00:20:57.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x560c6b759a80 0x560c6b75be70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x560c6b65f810 0x560c6b7572e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1770039a70 0x7f177003bf30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 --2- 172.21.15.66:0/3672672874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c6b5cf740 0x560c6b750170 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 >> 172.21.15.66:0/3672672874 conn(0x560c6b655e20 msgr2=0x560c6b65a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 shutdown_connections 2024-09-12T00:20:57.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.636+0000 7f1889fdf9c0 1 -- 172.21.15.66:0/3672672874 wait complete. 2024-09-12T00:20:57.653 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T00:20:57.615554Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.615541Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.653 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T00:20:57.615554Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.615541Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:57.654 ERROR:root:0 2024-09-12T00:20:57.654 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:57.667 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:57.668 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-12T00:20:57.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-12T00:20:57.668 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-12T00:20:57.699 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:57.699 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:57.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc99833b9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5603fe2a16c0 0x5603fe2a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc99833b9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5603fe1519c0 con 0x5603fe29d520 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc99833b9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5603fe1a16d0 con 0x5603fe2a16c0 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc995640640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5603fe2a16c0 0x5603fe2a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc995e41640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5603fe29d520 0x5603fe29d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41882/0 (socket says 172.21.15.66:41882) 2024-09-12T00:20:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc995e41640 1 -- 172.21.15.66:0/1387173514 learned_addr learned my addr 172.21.15.66:0/1387173514 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:57.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc995640640 1 -- 172.21.15.66:0/1387173514 >> v1:172.21.15.31:6789/0 conn(0x5603fe29d520 legacy=0x5603fe29d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.696+0000 7fc995640640 1 -- 172.21.15.66:0/1387173514 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe145ca0 con 0x5603fe2a16c0 2024-09-12T00:20:57.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc995640640 1 --2- 172.21.15.66:0/1387173514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe2a16c0 0x5603fe2a3ab0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00a480 tx=0x7fc98c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e92b473a8c7359 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc994e3f640 1 -- 172.21.15.66:0/1387173514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc98c0aa570 con 0x5603fe2a16c0 2024-09-12T00:20:57.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc994e3f640 1 -- 172.21.15.66:0/1387173514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98c0af070 con 0x5603fe2a16c0 2024-09-12T00:20:57.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc994e3f640 1 -- 172.21.15.66:0/1387173514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc98c0aa860 con 0x5603fe2a16c0 2024-09-12T00:20:57.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1387173514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe2a16c0 msgr2=0x5603fe2a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1387173514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe2a16c0 0x5603fe2a3ab0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00a480 tx=0x7fc98c01b310 comp rx=0 tx=0).stop 2024-09-12T00:20:57.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1387173514 shutdown_connections 2024-09-12T00:20:57.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1387173514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe2a16c0 0x5603fe2a3ab0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1387173514 >> 172.21.15.66:0/1387173514 conn(0x5603fe299040 msgr2=0x5603fe29b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1387173514 shutdown_connections 2024-09-12T00:20:57.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.700+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1387173514 wait complete. 2024-09-12T00:20:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc99833b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc99833b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603fe1a5680 con 0x5603fe29d520 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc995e41640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc995e41640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35824/0 (socket says 172.21.15.66:35824) 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc995e41640 1 -- 172.21.15.66:0/2720452330 learned_addr learned my addr 172.21.15.66:0/2720452330 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc995e41640 1 -- 172.21.15.66:0/2720452330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe120da0 con 0x5603fe29d520 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc995e41640 1 --2- 172.21.15.66:0/2720452330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc990001810 tx=0x7fc990001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e468694df41516f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc883e07640 1 -- 172.21.15.66:0/2720452330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc990004530 con 0x5603fe29d520 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc883e07640 1 -- 172.21.15.66:0/2720452330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9900046d0 con 0x5603fe29d520 2024-09-12T00:20:57.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.716+0000 7fc883e07640 1 -- 172.21.15.66:0/2720452330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9900049f0 con 0x5603fe29d520 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/2720452330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 msgr2=0x5603fe388850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/2720452330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc990001810 tx=0x7fc990001cd0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/2720452330 shutdown_connections 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/2720452330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe388850 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/2720452330 >> 172.21.15.66:0/2720452330 conn(0x5603fe299040 msgr2=0x5603fe3844f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/2720452330 shutdown_connections 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/2720452330 wait complete. 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603fe147a50 con 0x5603fe29d520 2024-09-12T00:20:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc995e41640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc995e41640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35836/0 (socket says 172.21.15.66:35836) 2024-09-12T00:20:57.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc995e41640 1 -- 172.21.15.66:0/3848820977 learned_addr learned my addr 172.21.15.66:0/3848820977 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc995e41640 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe3903e0 con 0x5603fe29d520 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc995e41640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5603fe389840 tx=0x7fc990001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc882604640 1 -- 172.21.15.66:0/3848820977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc990013760 con 0x5603fe29d520 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc882604640 1 -- 172.21.15.66:0/3848820977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc990013940 con 0x5603fe29d520 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603fe390670 con 0x5603fe29d520 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc882604640 1 -- 172.21.15.66:0/3848820977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc990013c60 con 0x5603fe29d520 2024-09-12T00:20:57.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603fe391020 con 0x5603fe29d520 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.720+0000 7fc882604640 1 -- 172.21.15.66:0/3848820977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc990010070 con 0x5603fe29d520 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc882604640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 0x7fc87c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc882604640 1 -- 172.21.15.66:0/3848820977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc990018070 con 0x5603fe29d520 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995640640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 0x7fc87c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 0x5603fe396ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe397530 con 0x5603fe2a16c0 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc996642640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 0x5603fe396ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995640640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 0x7fc87c03bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0ae000 tx=0x7fc98c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc996642640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 0x5603fe396ff0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc996642640 1 -- 172.21.15.66:0/3848820977 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9880083f0 con 0x5603fe2a16c0 2024-09-12T00:20:57.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe397930 con 0x5603fe2a16c0 2024-09-12T00:20:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc996642640 1 -- 172.21.15.66:0/3848820977 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9880083f0 con 0x5603fe2a16c0 2024-09-12T00:20:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 0x5603fe39bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe39c200 con 0x5603fe399740 2024-09-12T00:20:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995e41640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 0x5603fe39bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995e41640 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 0x5603fe39bb30 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995e41640 1 -- 172.21.15.66:0/3848820977 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc99001b030 con 0x5603fe399740 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3985e0 con 0x5603fe2a16c0 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc996642640 1 -- 172.21.15.66:0/3848820977 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9880083f0 con 0x5603fe2a16c0 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe398ac0 con 0x5603fe399740 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc995e41640 1 -- 172.21.15.66:0/3848820977 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc99001b030 con 0x5603fe399740 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.724+0000 7fc99833b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603fe1b2450 con 0x5603fe3aa950 2024-09-12T00:20:57.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35852/0 (socket says 172.21.15.66:35852) 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc996642640 1 -- 172.21.15.66:0/4270302755 learned_addr learned my addr 172.21.15.66:0/4270302755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc996642640 1 -- 172.21.15.66:0/4270302755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe3ab3b0 con 0x5603fe3aa950 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc996642640 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5603fe390c00 tx=0x7fc98800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 -- 172.21.15.66:0/4270302755 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc98801c020 con 0x5603fe3aa950 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 -- 172.21.15.66:0/4270302755 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc988007d00 con 0x5603fe3aa950 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 -- 172.21.15.66:0/4270302755 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc988018440 con 0x5603fe3aa950 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603fe3abc10 con 0x5603fe3aa950 2024-09-12T00:20:57.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603fe3ac180 con 0x5603fe3aa950 2024-09-12T00:20:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 -- 172.21.15.66:0/4270302755 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc98801f020 con 0x5603fe3aa950 2024-09-12T00:20:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 0x7fc87003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc87b7fe640 1 -- 172.21.15.66:0/4270302755 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc988051de0 con 0x5603fe3aa950 2024-09-12T00:20:57.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc995e41640 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 0x7fc87003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc995e41640 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 0x7fc87003bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc990010850 tx=0x7fc990050420 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.728+0000 7fc99833b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603fe389080 con 0x5603fe212a60 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35868/0 (socket says 172.21.15.66:35868) 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 -- 172.21.15.66:0/4283905980 learned_addr learned my addr 172.21.15.66:0/4283905980 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 -- 172.21.15.66:0/4283905980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe213380 con 0x5603fe212a60 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- 172.21.15.66:0/4283905980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc988050130 tx=0x7fc988043050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2640c260339575 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc8797fa640 1 -- 172.21.15.66:0/4283905980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc988021530 con 0x5603fe212a60 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc8797fa640 1 -- 172.21.15.66:0/4283905980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc988029350 con 0x5603fe212a60 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc8797fa640 1 -- 172.21.15.66:0/4283905980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc988029c70 con 0x5603fe212a60 2024-09-12T00:20:57.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4283905980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 msgr2=0x5603fe212e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4283905980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc988050130 tx=0x7fc988043050 comp rx=0 tx=0).stop 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4283905980 shutdown_connections 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4283905980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe212e40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4283905980 >> 172.21.15.66:0/4283905980 conn(0x5603fe3b36a0 msgr2=0x5603fe3b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4283905980 shutdown_connections 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4283905980 wait complete. 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 Processor -- start 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- start start 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.739 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603fe213970 con 0x5603fe212a60 2024-09-12T00:20:57.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35874/0 (socket says 172.21.15.66:35874) 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 learned_addr learned my addr 172.21.15.66:0/1221275650 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe3c0e60 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc996642640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc98804efd0 tx=0x7fc988050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc8677fe640 1 -- 172.21.15.66:0/1221275650 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc988028300 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.732+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603fe3c10f0 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc8677fe640 1 -- 172.21.15.66:0/1221275650 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9880284a0 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc8677fe640 1 -- 172.21.15.66:0/1221275650 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9880289c0 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603fe3c1aa0 con 0x5603fe212a60 2024-09-12T00:20:57.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc8677fe640 1 -- 172.21.15.66:0/1221275650 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc988016040 con 0x5603fe212a60 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc8677fe640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc860039a70 0x7fc86003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc8677fe640 1 -- 172.21.15.66:0/1221275650 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fc988031070 con 0x5603fe212a60 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995e41640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc860039a70 0x7fc86003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe3cbe50 0x5603fe3ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3cea60 con 0x5603fe3cbe50 2024-09-12T00:20:57.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe3cbe50 0x5603fe3ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995e41640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc860039a70 0x7fc86003bf30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc9900504d0 tx=0x7fc990041000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe3cbe50 0x5603fe3ce310 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 realm 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3cee90 con 0x5603fe3cbe50 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3cf760 con 0x5603fe3cbe50 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3cfb00 con 0x5603fe3cbe50 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe3d0860 0x5603fe3d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d3260 con 0x5603fe3d0860 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.736+0000 7fc996642640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe3d0860 0x5603fe3d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc996642640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe3d0860 0x5603fe3d2c50 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc99833b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc99833b9c0 20 searching for the correct realm 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3d0860 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc996642640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc988021020 0x7fc9880343c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc988021020 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995e41640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc988021020 0x7fc9880343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995e41640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc988021020 0x7fc9880343c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99004d030 con 0x7fc988021020 2024-09-12T00:20:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995e41640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc9900283d0 0x7fc990029470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc9900283d0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc9900283d0 0x7fc990029470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc9900283d0 0x7fc990029470 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.740+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc9900283d0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99004d030 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3d0860 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3cbe50 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3cbe50 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3d0860 2024-09-12T00:20:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4b30 con 0x5603fe3d0860 2024-09-12T00:20:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.744+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc9900283d0 2024-09-12T00:20:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3d0860 2024-09-12T00:20:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3d0860 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3cbe50 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3cbe50 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc9900283d0 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3d0860 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc988021020 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3cbe50 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc9900283d0 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.748+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3d0860 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.758 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc9900283d0 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc988021020 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3d0860 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc9900283d0 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.762 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x5603fe3cbe50 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fc988064040 con 0x7fc988021020 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d3bb0 con 0x5603fe3cbe50 2024-09-12T00:20:57.763 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4400 con 0x5603fe3cbe50 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.752+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d4f60 con 0x5603fe3d0860 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 zone default found 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 4 Realm: () 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:57.764 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 zonegroup default 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d5300 con 0x7fc9900283d0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d7540 con 0x5603fe3d0860 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.765 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d7540 con 0x5603fe3d0860 2024-09-12T00:20:57.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:57.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 started sync module instance, tier type = 2024-09-12T00:20:57.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:57.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d6980 con 0x7fc988021020 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94575150329200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d7640 con 0x7fc988021020 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.756+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d8000 con 0x5603fe3cbe50 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.760+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94575150329200] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.760+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.760+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94575150332752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d7f70 con 0x5603fe3cbe50 2024-09-12T00:20:57.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.760+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d8ec0 con 0x5603fe3d0860 2024-09-12T00:20:57.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94575150332752] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94575150336528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d92e0 con 0x5603fe3d0860 2024-09-12T00:20:57.768 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d8430 con 0x7fc988021020 2024-09-12T00:20:57.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94575150340080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d8430 con 0x7fc988021020 2024-09-12T00:20:57.769 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3da720 con 0x5603fe3cbe50 2024-09-12T00:20:57.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94575150336528] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94575150340080] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94575150341136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3da230 con 0x5603fe3cbe50 2024-09-12T00:20:57.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.764+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3dafc0 con 0x7fc9900283d0 2024-09-12T00:20:57.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.768+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94575150341136] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.768+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.768+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94575150337584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3dac70 con 0x7fc9900283d0 2024-09-12T00:20:57.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.768+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3db4c0 con 0x7fc9900283d0 2024-09-12T00:20:57.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94575150345600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3db830 con 0x7fc9900283d0 2024-09-12T00:20:57.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3dc350 con 0x7fc9900283d0 2024-09-12T00:20:57.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94575150337584] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94575150345600] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94575150349856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3db280 con 0x7fc9900283d0 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=0 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=1 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=2 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=3 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=4 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=5 2024-09-12T00:20:57.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.772+0000 7fc99833b9c0 20 add_watcher() i=6 2024-09-12T00:20:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94575150349856] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0a8070 con 0x7fc9900283d0 2024-09-12T00:20:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 20 add_watcher() i=7 2024-09-12T00:20:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:57.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3df340 con 0x5603fe3cbe50 2024-09-12T00:20:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc98c0a8070 con 0x5603fe3cbe50 2024-09-12T00:20:57.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94575150344128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3dc7c0 con 0x5603fe3cbe50 2024-09-12T00:20:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94575150344128] v33'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc8477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:57.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.776+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7af0 con 0x5603fe3cbe50 2024-09-12T00:20:57.785 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.780+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.780+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7af0 con 0x7fc9900283d0 2024-09-12T00:20:57.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.780+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7af0 con 0x5603fe3d0860 2024-09-12T00:20:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e8840 con 0x5603fe3cbe50 2024-09-12T00:20:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'252 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7160 con 0x7fc988021020 2024-09-12T00:20:57.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.784+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'84 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.792 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.788+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7160 con 0x5603fe3d0860 2024-09-12T00:20:57.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.788+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'63 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.788+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e7160 con 0x5603fe3cbe50 2024-09-12T00:20:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.788+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.788+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e9340 con 0x7fc9900283d0 2024-09-12T00:20:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.792+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.792+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e9340 con 0x7fc988021020 2024-09-12T00:20:57.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.792+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.792+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e93d0 con 0x5603fe3d0860 2024-09-12T00:20:57.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.796+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.796+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e94c0 con 0x7fc988021020 2024-09-12T00:20:57.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.796+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'85 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.796+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc9900283d0 2024-09-12T00:20:57.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.800+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'37 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.800+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc988021020 2024-09-12T00:20:57.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.800+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.800+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc9900283d0 2024-09-12T00:20:57.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3cbe50 2024-09-12T00:20:57.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'253 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'77 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.804+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc988021020 2024-09-12T00:20:57.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.808+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'86 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.808+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.808+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.808+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3cbe50 2024-09-12T00:20:57.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3cbe50 2024-09-12T00:20:57.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'254 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'78 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.812+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc988021020 2024-09-12T00:20:57.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.816+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.820+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.820+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.820+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.820+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc9900283d0 2024-09-12T00:20:57.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.820+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.824+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.824+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.824+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc9900283d0 2024-09-12T00:20:57.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.824+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.824+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x5603fe3d0860 2024-09-12T00:20:57.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.828+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'79 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.828+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc9900283d0 2024-09-12T00:20:57.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.828+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.828+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e99e0 con 0x7fc988021020 2024-09-12T00:20:57.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc8467fc640 20 reqs_thread_entry: start 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 20 Filter name: none 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc7b7fff640 20 reqs_thread_entry: start 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe404a10 con 0x7fc9900283d0 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T00:20:57.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.832+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe407430 con 0x7fc9900283d0 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 10 removing key index: system_akey 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3e6540 con 0x5603fe3d0860 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(96 system_akey [delete] v33'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94575150522224 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe407850 con 0x5603fe3cbe50 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== watch-notify(notify (1) cookie 94575150332752 notify 141733920803 ret 0) ==== 203+0+0 (crc 0 0 0) 0x5603fe3e6cb0 con 0x5603fe3cbe50 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc8797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94575150332752 notifier 4851 bl.length()=161 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc8797fa640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc858003d70 con 0x5603fe3cbe50 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(97 notify.1 [notify cookie 94575150522224 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== watch-notify(notify_complete (2) cookie 94575150522224 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5603fe3c10f0 con 0x5603fe3cbe50 2024-09-12T00:20:57.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 10 removing email index: 2024-09-12T00:20:57.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 10 removing user buckets index 2024-09-12T00:20:57.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.836+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe4053c0 con 0x7fc9900283d0 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(99 system_user.buckets [delete] v33'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc99833b9c0 10 removing user index: system_user 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x7fc9900283d0 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(100 system_user [call,call,delete] v33'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc99833b9c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-12T00:20:57.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc99833b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94575150534832 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5603fe4094d0 con 0x7fc988021020 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== watch-notify(notify (1) cookie 94575150329200 notify 141733920792 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5603fe3e77b0 con 0x7fc988021020 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc878ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94575150329200 notifier 4851 bl.length()=160 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(101 notify.0 [notify cookie 94575150534832 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc878ff9640 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fc7c00032d0 con 0x7fc988021020 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== watch-notify(notify_complete (2) cookie 94575150534832 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5603fe3e6ae0 con 0x7fc988021020 2024-09-12T00:20:57.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.840+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc8477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:57.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94575150344128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x5603fe3cbe50 2024-09-12T00:20:57.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94575150344128] v33'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94575150329200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x7fc988021020 2024-09-12T00:20:57.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94575150329200] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc99833b9c0 20 remove_watcher() i=0 2024-09-12T00:20:57.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc99833b9c0 2 removed watcher, disabling cache 2024-09-12T00:20:57.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.844+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94575150332752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x5603fe3cbe50 2024-09-12T00:20:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94575150332752] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc99833b9c0 20 remove_watcher() i=1 2024-09-12T00:20:57.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94575150336528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x5603fe3d0860 2024-09-12T00:20:57.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc996642640 1 -- 172.21.15.66:0/1221275650 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94575150336528] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98803b020 con 0x5603fe3d0860 2024-09-12T00:20:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc99833b9c0 20 remove_watcher() i=2 2024-09-12T00:20:57.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.848+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94575150340080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x7fc988021020 2024-09-12T00:20:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc995e41640 1 -- 172.21.15.66:0/1221275650 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94575150340080] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc99005d040 con 0x7fc988021020 2024-09-12T00:20:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc99833b9c0 20 remove_watcher() i=3 2024-09-12T00:20:57.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94575150341136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x5603fe3cbe50 2024-09-12T00:20:57.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94575150341136] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x5603fe3cbe50 2024-09-12T00:20:57.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc99833b9c0 20 remove_watcher() i=4 2024-09-12T00:20:57.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.852+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94575150337584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x7fc9900283d0 2024-09-12T00:20:57.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94575150337584] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc99833b9c0 20 remove_watcher() i=5 2024-09-12T00:20:57.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94575150345600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe3d6d70 con 0x7fc9900283d0 2024-09-12T00:20:57.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94575150345600] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc99833b9c0 20 remove_watcher() i=6 2024-09-12T00:20:57.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.856+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94575150349856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5603fe409560 con 0x7fc9900283d0 2024-09-12T00:20:57.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94575150349856] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc98c0d5040 con 0x7fc9900283d0 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 20 remove_watcher() i=7 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc9900283d0 msgr2=0x7fc990029470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fc9900283d0 0x7fc990029470 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe3cbe50 msgr2=0x5603fe3ce310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe3cbe50 0x5603fe3ce310 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc988021020 msgr2=0x7fc9880343c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fc988021020 0x7fc9880343c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe3d0860 msgr2=0x5603fe3d2c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe3d0860 0x5603fe3d2c50 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc860039a70 msgr2=0x7fc86003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc860039a70 0x7fc86003bf30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc9900504d0 tx=0x7fc990041000 comp rx=0 tx=0).stop 2024-09-12T00:20:57.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc995640640 1 -- 172.21.15.66:0/1221275650 reap_dead start 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 msgr2=0x5603fe3c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc98804efd0 tx=0x7fc988050090 comp rx=0 tx=0).stop 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 shutdown_connections 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/1221275650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe212a60 0x5603fe3c0900 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 >> 172.21.15.66:0/1221275650 conn(0x5603fe3b36a0 msgr2=0x5603fe3b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 shutdown_connections 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/1221275650 wait complete. 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 msgr2=0x7fc87003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 0x7fc87003bf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc990010850 tx=0x7fc990050420 comp rx=0 tx=0).stop 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 msgr2=0x5603fe3aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x5603fe390c00 tx=0x7fc98800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:57.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 shutdown_connections 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc870039a70 0x7fc87003bf30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/4270302755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe3aa950 0x5603fe3aad70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 >> 172.21.15.66:0/4270302755 conn(0x5603fe3a0300 msgr2=0x5603fe3a06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 shutdown_connections 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/4270302755 wait complete. 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 msgr2=0x5603fe396ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 0x5603fe396ff0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 msgr2=0x5603fe39bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 0x5603fe39bb30 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 msgr2=0x7fc87c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 0x7fc87c03bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0ae000 tx=0x7fc98c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 msgr2=0x5603fe38fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5603fe389840 tx=0x7fc990001260 comp rx=0 tx=0).stop 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 shutdown_connections 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5603fe399740 0x5603fe39bb30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5603fe2a16c0 0x5603fe396ff0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fc87c039a70 0x7fc87c03bf30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 --2- 172.21.15.66:0/3848820977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603fe29d520 0x5603fe38fe80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 >> 172.21.15.66:0/3848820977 conn(0x5603fe299040 msgr2=0x5603fe382f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 shutdown_connections 2024-09-12T00:20:57.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.860+0000 7fc99833b9c0 1 -- 172.21.15.66:0/3848820977 wait complete. 2024-09-12T00:20:57.879 ERROR:root:None 2024-09-12T00:20:57.879 ERROR:root:0 2024-09-12T00:20:57.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T00:20:57.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T00:20:57.880 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-12T00:20:57.973 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:57.973 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa386edc9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634418af4f0 0x5634418b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa386edc9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634417609c0 con 0x5634418ab300 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa386edc9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5634417b06d0 con 0x5634418af4f0 2024-09-12T00:20:57.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3841e1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634418af4f0 0x5634418b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3841e1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5634418af4f0 0x5634418b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35890/0 (socket says 172.21.15.66:35890) 2024-09-12T00:20:57.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3849e2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5634418ab300 0x5634418ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41886/0 (socket says 172.21.15.66:41886) 2024-09-12T00:20:57.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3841e1640 1 -- 172.21.15.66:0/454971059 learned_addr learned my addr 172.21.15.66:0/454971059 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3841e1640 1 -- 172.21.15.66:0/454971059 >> v1:172.21.15.31:6789/0 conn(0x5634418ab300 legacy=0x5634418ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.968+0000 7fa3841e1640 1 -- 172.21.15.66:0/454971059 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563441754ca0 con 0x5634418af4f0 2024-09-12T00:20:57.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa3841e1640 1 --2- 172.21.15.66:0/454971059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418af4f0 0x5634418b18e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00a5c0 tx=0x7fa36c01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f8139829c1ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa3839e0640 1 -- 172.21.15.66:0/454971059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa36c0a9590 con 0x5634418af4f0 2024-09-12T00:20:57.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa3839e0640 1 -- 172.21.15.66:0/454971059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c0ae070 con 0x5634418af4f0 2024-09-12T00:20:57.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa3839e0640 1 -- 172.21.15.66:0/454971059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa36c0a9880 con 0x5634418af4f0 2024-09-12T00:20:57.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 -- 172.21.15.66:0/454971059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418af4f0 msgr2=0x5634418b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/454971059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418af4f0 0x5634418b18e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00a5c0 tx=0x7fa36c01b3d0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 -- 172.21.15.66:0/454971059 shutdown_connections 2024-09-12T00:20:57.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/454971059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418af4f0 0x5634418b18e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 -- 172.21.15.66:0/454971059 >> 172.21.15.66:0/454971059 conn(0x5634418a6e20 msgr2=0x5634418a9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 -- 172.21.15.66:0/454971059 shutdown_connections 2024-09-12T00:20:57.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.972+0000 7fa386edc9c0 1 -- 172.21.15.66:0/454971059 wait complete. 2024-09-12T00:20:57.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa386edc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa386edc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634417b4680 con 0x5634418ab300 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa3849e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa3849e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35906/0 (socket says 172.21.15.66:35906) 2024-09-12T00:20:57.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa3849e2640 1 -- 172.21.15.66:0/1722800048 learned_addr learned my addr 172.21.15.66:0/1722800048 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:57.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa3849e2640 1 -- 172.21.15.66:0/1722800048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344172fda0 con 0x5634418ab300 2024-09-12T00:20:57.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.988+0000 7fa3849e2640 1 --2- 172.21.15.66:0/1722800048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa374001680 tx=0x7fa374001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8671c875172f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:57.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa272e0d640 1 -- 172.21.15.66:0/1722800048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa374013420 con 0x5634418ab300 2024-09-12T00:20:57.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa272e0d640 1 -- 172.21.15.66:0/1722800048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3740135c0 con 0x5634418ab300 2024-09-12T00:20:57.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa272e0d640 1 -- 172.21.15.66:0/1722800048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3740138e0 con 0x5634418ab300 2024-09-12T00:20:57.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/1722800048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 msgr2=0x5634418201f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:57.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/1722800048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa374001680 tx=0x7fa374001b40 comp rx=0 tx=0).stop 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/1722800048 shutdown_connections 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/1722800048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x5634418201f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/1722800048 >> 172.21.15.66:0/1722800048 conn(0x5634418a6e20 msgr2=0x563441992380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/1722800048 shutdown_connections 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/1722800048 wait complete. 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:57.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563441756a50 con 0x5634418ab300 2024-09-12T00:20:57.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa3849e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:57.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa3849e2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35908/0 (socket says 172.21.15.66:35908) 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa3849e2640 1 -- 172.21.15.66:0/2222645939 learned_addr learned my addr 172.21.15.66:0/2222645939 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa3849e2640 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563441998230 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa3849e2640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa374001b80 tx=0x7fa374000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa27160a640 1 -- 172.21.15.66:0/2222645939 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa374013630 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa27160a640 1 -- 172.21.15.66:0/2222645939 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa374023070 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa27160a640 1 -- 172.21.15.66:0/2222645939 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa374013920 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563441996610 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.992+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563441996ba0 con 0x5634418ab300 2024-09-12T00:20:58.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa27160a640 1 -- 172.21.15.66:0/2222645939 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa374010070 con 0x5634418ab300 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa27160a640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 0x7fa26c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa27160a640 1 -- 172.21.15.66:0/2222645939 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fa374050240 con 0x5634418ab300 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3841e1640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 0x7fa26c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 0x5634419a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419a87e0 con 0x5634418af4f0 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3851e3640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 0x5634419a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3841e1640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 0x7fa26c03bf80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0ad000 tx=0x7fa36c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3851e3640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 0x5634419a82a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3851e3640 1 -- 172.21.15.66:0/2222645939 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa37c0083f0 con 0x5634418af4f0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419a8be0 con 0x5634418af4f0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3851e3640 1 -- 172.21.15.66:0/2222645939 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa37c0083f0 con 0x5634418af4f0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 0x5634419acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419ad4b0 con 0x5634419aa9f0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3849e2640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 0x5634419acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3849e2640 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 0x5634419acde0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:57.996+0000 7fa3849e2640 1 -- 172.21.15.66:0/2222645939 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa37400f030 con 0x5634419aa9f0 2024-09-12T00:20:58.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419a9890 con 0x5634418af4f0 2024-09-12T00:20:58.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 -- 172.21.15.66:0/2222645939 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa37c0083f0 con 0x5634418af4f0 2024-09-12T00:20:58.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419a9d10 con 0x5634419aa9f0 2024-09-12T00:20:58.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3849e2640 1 -- 172.21.15.66:0/2222645939 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa37400f030 con 0x5634419aa9f0 2024-09-12T00:20:58.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634417c1450 con 0x5634419bbbc0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35914/0 (socket says 172.21.15.66:35914) 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 -- 172.21.15.66:0/660402651 learned_addr learned my addr 172.21.15.66:0/660402651 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 -- 172.21.15.66:0/660402651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634419bc620 con 0x5634419bbbc0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa3851e3640 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x563441996d90 tx=0x7fa37c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa26a7fc640 1 -- 172.21.15.66:0/660402651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c01c020 con 0x5634419bbbc0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa26a7fc640 1 -- 172.21.15.66:0/660402651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c007d00 con 0x5634419bbbc0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa26a7fc640 1 -- 172.21.15.66:0/660402651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c018440 con 0x5634419bbbc0 2024-09-12T00:20:58.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634419bce80 con 0x5634419bbbc0 2024-09-12T00:20:58.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.000+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634419bd3f0 con 0x5634419bbbc0 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa26a7fc640 1 -- 172.21.15.66:0/660402651 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa37c01f020 con 0x5634419bbbc0 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa26a7fc640 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 0x7fa25c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa26a7fc640 1 -- 172.21.15.66:0/660402651 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fa37c051de0 con 0x5634419bbbc0 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3849e2640 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 0x7fa25c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3849e2640 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 0x7fa25c03bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa37404e560 tx=0x7fa374013b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.009 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563441820a40 con 0x5634419c84e0 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35920/0 (socket says 172.21.15.66:35920) 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3851e3640 1 -- 172.21.15.66:0/234682334 learned_addr learned my addr 172.21.15.66:0/234682334 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3851e3640 1 -- 172.21.15.66:0/234682334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634419c8e90 con 0x5634419c84e0 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa3851e3640 1 --2- 172.21.15.66:0/234682334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa37c050100 tx=0x7fa37c043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6baeff0dad4253b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa25bfff640 1 -- 172.21.15.66:0/234682334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c021530 con 0x5634419c84e0 2024-09-12T00:20:58.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa25bfff640 1 -- 172.21.15.66:0/234682334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c029c50 con 0x5634419c84e0 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa25bfff640 1 -- 172.21.15.66:0/234682334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c028300 con 0x5634419c84e0 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- 172.21.15.66:0/234682334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 msgr2=0x5634419c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/234682334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa37c050100 tx=0x7fa37c043110 comp rx=0 tx=0).stop 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- 172.21.15.66:0/234682334 shutdown_connections 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/234682334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419c88c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- 172.21.15.66:0/234682334 >> 172.21.15.66:0/234682334 conn(0x5634419c4910 msgr2=0x5634419c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- 172.21.15.66:0/234682334 shutdown_connections 2024-09-12T00:20:58.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- 172.21.15.66:0/234682334 wait complete. 2024-09-12T00:20:58.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 Processor -- start 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.004+0000 7fa386edc9c0 1 -- start start 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634419c94f0 con 0x5634419c84e0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3851e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35928/0 (socket says 172.21.15.66:35928) 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 learned_addr learned my addr 172.21.15.66:0/36674504 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634419cff10 con 0x5634419c84e0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3851e3640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa37c021fd0 tx=0x7fa37c050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 -- 172.21.15.66:0/36674504 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c028af0 con 0x5634419c84e0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634419d01a0 con 0x5634419c84e0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 -- 172.21.15.66:0/36674504 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c028c90 con 0x5634419c84e0 2024-09-12T00:20:58.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 -- 172.21.15.66:0/36674504 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa37c0203b0 con 0x5634419c84e0 2024-09-12T00:20:58.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634419d0b50 con 0x5634419c84e0 2024-09-12T00:20:58.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 -- 172.21.15.66:0/36674504 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa37c016040 con 0x5634419c84e0 2024-09-12T00:20:58.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa250039a70 0x7fa25003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa25a7fc640 1 -- 172.21.15.66:0/36674504 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fa37c032070 con 0x5634419c84e0 2024-09-12T00:20:58.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3849e2640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa250039a70 0x7fa25003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634419daef0 0x5634419dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419ddb00 con 0x5634419daef0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3841e1640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634419daef0 0x5634419dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.008+0000 7fa3849e2640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa250039a70 0x7fa25003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa37401dae0 tx=0x7fa374040000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3841e1640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634419daef0 0x5634419dd3b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 realm 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419ddf30 con 0x5634419daef0 2024-09-12T00:20:58.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419de800 con 0x5634419daef0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419deba0 con 0x5634419daef0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419df900 0x5634419e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e2300 con 0x5634419df900 2024-09-12T00:20:58.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419df900 0x5634419e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419df900 0x5634419e1cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 20 searching for the correct realm 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa37c021020 0x7fa37c049a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3849e2640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa37c021020 0x7fa37c049a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3849e2640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa37c021020 0x7fa37c049a40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3849e2640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa374011590 0x7fa37404e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.012+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa374011590 0x7fa37404e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa374011590 0x7fa37404e8b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.016+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.020+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419df900 2024-09-12T00:20:58.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.024+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa374011590 2024-09-12T00:20:58.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x5634419daef0 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3bd0 con 0x7fa37c021020 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e2d50 con 0x5634419daef0 2024-09-12T00:20:58.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e35a0 con 0x5634419daef0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e3f70 con 0x5634419df900 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 zone default found 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 4 Realm: () 2024-09-12T00:20:58.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:58.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:58.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:58.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 zonegroup default 2024-09-12T00:20:58.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e43a0 con 0x7fa374011590 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e61d0 con 0x5634419df900 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419e6690 con 0x5634419df900 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.028+0000 7fa386edc9c0 20 started sync module instance, tier type = 2024-09-12T00:20:58.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e5670 con 0x7fa37c021020 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94782439182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e6af0 con 0x7fa37c021020 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e7340 con 0x5634419daef0 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94782439182784] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94782439184992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e7380 con 0x5634419daef0 2024-09-12T00:20:58.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.032+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e7ea0 con 0x5634419df900 2024-09-12T00:20:58.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94782439192944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e7e60 con 0x5634419df900 2024-09-12T00:20:58.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e8e00 con 0x7fa37c021020 2024-09-12T00:20:58.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94782439184992] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94782439196896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e91f0 con 0x7fa37c021020 2024-09-12T00:20:58.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.036+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e9bb0 con 0x5634419daef0 2024-09-12T00:20:58.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94782439196896] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94782439192944] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94782439195280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e9700 con 0x5634419daef0 2024-09-12T00:20:58.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419e9f50 con 0x7fa374011590 2024-09-12T00:20:58.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94782439195280] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94782439200512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419ea340 con 0x7fa374011590 2024-09-12T00:20:58.047 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.040+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419eab90 con 0x7fa374011590 2024-09-12T00:20:58.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.044+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94782439200512] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.044+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.044+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94782439201568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419ea7f0 con 0x7fa374011590 2024-09-12T00:20:58.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.044+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419eb2b0 con 0x7fa374011590 2024-09-12T00:20:58.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.044+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94782439201568] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94782439206272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419eb490 con 0x7fa374011590 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=0 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=1 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=2 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=3 2024-09-12T00:20:58.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=4 2024-09-12T00:20:58.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=5 2024-09-12T00:20:58.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=6 2024-09-12T00:20:58.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94782439206272] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 20 add_watcher() i=7 2024-09-12T00:20:58.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:58.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5634419ee860 con 0x5634419daef0 2024-09-12T00:20:58.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.048+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94782439207808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5634419ebc50 con 0x5634419daef0 2024-09-12T00:20:58.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94782439207808] v33'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa23afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 5 note: GC not initialized 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa239fe3640 20 reqs_thread_entry: start 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 Filter name: none 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa1ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563441a11d00 con 0x5634419df900 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563441a103a0 con 0x5634419df900 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.059 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a10f30 con 0x5634419df900 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v33'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T00:20:58.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94782439361152 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563441a157a0 con 0x5634419df900 2024-09-12T00:20:58.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== watch-notify(notify (1) cookie 94782439192944 notify 141733920777 ret 0) ==== 584+0+0 (crc 0 0 0) 0x563441a10790 con 0x5634419df900 2024-09-12T00:20:58.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa25bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94782439192944 notifier 4858 bl.length()=542 2024-09-12T00:20:58.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa25bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa25bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(65 notify.2 [notify cookie 94782439361152 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.052+0000 7fa25bfff640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa248003eb0 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== watch-notify(notify_complete (2) cookie 94782439361152 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634419cff10 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a10a80 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v33'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa386edc9c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa386edc9c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa386edc9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T00:20:58.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94782439361152 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563441a15900 con 0x7fa374011590 2024-09-12T00:20:58.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== watch-notify(notify (1) cookie 94782439200512 notify 141733920814 ret 0) ==== 217+0+0 (crc 0 0 0) 0x563441754ca0 con 0x7fa374011590 2024-09-12T00:20:58.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa25b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920814 cookie 94782439200512 notifier 4858 bl.length()=175 2024-09-12T00:20:58.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa25b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T00:20:58.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(68 notify.5 [notify cookie 94782439361152 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa25b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa25b7fe640 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa1b8003410 con 0x7fa374011590 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== watch-notify(notify_complete (2) cookie 94782439361152 notify 141733920814 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa36c0bfb80 con 0x7fa374011590 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.056+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x7fa374011590 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-12T00:20:58.058273Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:58.058255Z","tags":[],"group_ids":[]} 2024-09-12T00:20:58.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa23afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94782439207808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x5634419daef0 2024-09-12T00:20:58.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94782439207808] v33'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa36c0a9a50 con 0x5634419daef0 2024-09-12T00:20:58.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94782439182784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x7fa37c021020 2024-09-12T00:20:58.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94782439182784] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa386edc9c0 20 remove_watcher() i=0 2024-09-12T00:20:58.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa386edc9c0 2 removed watcher, disabling cache 2024-09-12T00:20:58.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.060+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94782439184992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x5634419daef0 2024-09-12T00:20:58.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94782439184992] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0d5040 con 0x5634419daef0 2024-09-12T00:20:58.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa386edc9c0 20 remove_watcher() i=1 2024-09-12T00:20:58.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94782439192944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x5634419df900 2024-09-12T00:20:58.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa3851e3640 1 -- 172.21.15.66:0/36674504 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94782439192944] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37c03c020 con 0x5634419df900 2024-09-12T00:20:58.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa386edc9c0 20 remove_watcher() i=2 2024-09-12T00:20:58.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.064+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94782439196896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x7fa37c021020 2024-09-12T00:20:58.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa3849e2640 1 -- 172.21.15.66:0/36674504 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94782439196896] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa37403c070 con 0x7fa37c021020 2024-09-12T00:20:58.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa386edc9c0 20 remove_watcher() i=3 2024-09-12T00:20:58.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94782439195280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x5634419daef0 2024-09-12T00:20:58.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94782439195280] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0d5040 con 0x5634419daef0 2024-09-12T00:20:58.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa386edc9c0 20 remove_watcher() i=4 2024-09-12T00:20:58.075 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.068+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94782439200512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x7fa374011590 2024-09-12T00:20:58.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94782439200512] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0d5040 con 0x7fa374011590 2024-09-12T00:20:58.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa386edc9c0 20 remove_watcher() i=5 2024-09-12T00:20:58.077 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94782439201568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x7fa374011590 2024-09-12T00:20:58.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94782439201568] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0d5040 con 0x7fa374011590 2024-09-12T00:20:58.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa386edc9c0 20 remove_watcher() i=6 2024-09-12T00:20:58.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.072+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94782439206272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563441a0fa30 con 0x7fa374011590 2024-09-12T00:20:58.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94782439206272] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa36c0d5040 con 0x7fa374011590 2024-09-12T00:20:58.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 20 remove_watcher() i=7 2024-09-12T00:20:58.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa374011590 msgr2=0x7fa37404e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fa374011590 0x7fa37404e8b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634419daef0 msgr2=0x5634419dd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634419daef0 0x5634419dd3b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa37c021020 msgr2=0x7fa37c049a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fa37c021020 0x7fa37c049a40 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419df900 msgr2=0x5634419e1cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419df900 0x5634419e1cf0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa250039a70 msgr2=0x7fa25003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa250039a70 0x7fa25003bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa37401dae0 tx=0x7fa374040000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa3841e1640 1 -- 172.21.15.66:0/36674504 reap_dead start 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 msgr2=0x5634419cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa37c021fd0 tx=0x7fa37c050090 comp rx=0 tx=0).stop 2024-09-12T00:20:58.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 shutdown_connections 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/36674504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419c84e0 0x5634419cf9b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 >> 172.21.15.66:0/36674504 conn(0x5634419c4910 msgr2=0x5634419c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 shutdown_connections 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/36674504 wait complete. 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 msgr2=0x7fa25c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 0x7fa25c03bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa37404e560 tx=0x7fa374013b60 comp rx=0 tx=0).stop 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 msgr2=0x5634419bbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x563441996d90 tx=0x7fa37c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 shutdown_connections 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa25c039a70 0x7fa25c03bf30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/660402651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634419bbbc0 0x5634419bbfe0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 >> 172.21.15.66:0/660402651 conn(0x5634419b1570 msgr2=0x5634419b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 shutdown_connections 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/660402651 wait complete. 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 msgr2=0x5634419a82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 0x5634419a82a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 msgr2=0x5634419acde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 0x5634419acde0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 msgr2=0x7fa26c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 0x7fa26c03bf80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0ad000 tx=0x7fa36c0a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 msgr2=0x563441997cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa374001b80 tx=0x7fa374000f50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 shutdown_connections 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5634419aa9f0 0x5634419acde0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5634418af4f0 0x5634419a82a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa26c039ac0 0x7fa26c03bf80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 --2- 172.21.15.66:0/2222645939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634418ab300 0x563441997cd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 >> 172.21.15.66:0/2222645939 conn(0x5634418a6e20 msgr2=0x563441990e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 shutdown_connections 2024-09-12T00:20:58.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.076+0000 7fa386edc9c0 1 -- 172.21.15.66:0/2222645939 wait complete. 2024-09-12T00:20:58.095 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T00:20:58.058273Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:58.058255Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.095 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T00:20:58.058273Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:58.058255Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.095 ERROR:root:0 2024-09-12T00:20:58.096 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:58.109 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:58.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-12T00:20:58.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-12T00:20:58.110 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-12T00:20:58.141 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:58.141 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:58.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc27ca29c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f01696b8c0 0x55f01696dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc27ca29c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f01681b9c0 con 0x55f0168db770 2024-09-12T00:20:58.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc27ca29c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55f01686b6d0 con 0x55f01696b8c0 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc24fa7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f01696b8c0 0x55f01696dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc24fa7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55f01696b8c0 0x55f01696dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35934/0 (socket says 172.21.15.66:35934) 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc257a8640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55f0168db770 0x55f01696a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41890/0 (socket says 172.21.15.66:41890) 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc24fa7640 1 -- 172.21.15.66:0/1178485933 learned_addr learned my addr 172.21.15.66:0/1178485933 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc24fa7640 1 -- 172.21.15.66:0/1178485933 >> v1:172.21.15.31:6789/0 conn(0x55f0168db770 legacy=0x55f01696a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.136+0000 7fcc24fa7640 1 -- 172.21.15.66:0/1178485933 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01680fca0 con 0x55f01696b8c0 2024-09-12T00:20:58.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/1178485933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f01696dcb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000a5c0 tx=0x7fcc1001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befc4fa9d1b5d63c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc1ffff640 1 -- 172.21.15.66:0/1178485933 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc100b1070 con 0x55f01696b8c0 2024-09-12T00:20:58.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc1ffff640 1 -- 172.21.15.66:0/1178485933 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc100a8070 con 0x55f01696b8c0 2024-09-12T00:20:58.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc1ffff640 1 -- 172.21.15.66:0/1178485933 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc100ac5b0 con 0x55f01696b8c0 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1178485933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 msgr2=0x55f01696dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/1178485933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f01696dcb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000a5c0 tx=0x7fcc1001b340 comp rx=0 tx=0).stop 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1178485933 shutdown_connections 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/1178485933 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f01696dcb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1178485933 >> 172.21.15.66:0/1178485933 conn(0x55f016961e90 msgr2=0x55f0169642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1178485933 shutdown_connections 2024-09-12T00:20:58.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.140+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1178485933 wait complete. 2024-09-12T00:20:58.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc27ca29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc27ca29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f01686f680 con 0x55f0168db770 2024-09-12T00:20:58.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc257a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc257a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35950/0 (socket says 172.21.15.66:35950) 2024-09-12T00:20:58.163 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc257a8640 1 -- 172.21.15.66:0/1803807625 learned_addr learned my addr 172.21.15.66:0/1803807625 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc257a8640 1 -- 172.21.15.66:0/1803807625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0167eada0 con 0x55f0168db770 2024-09-12T00:20:58.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcc257a8640 1 --2- 172.21.15.66:0/1803807625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcc20001680 tx=0x7fcc20001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708e60aae4a12e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcb13606640 1 -- 172.21.15.66:0/1803807625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc20013420 con 0x55f0168db770 2024-09-12T00:20:58.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcb13606640 1 -- 172.21.15.66:0/1803807625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200135c0 con 0x55f0168db770 2024-09-12T00:20:58.164 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.156+0000 7fcb13606640 1 -- 172.21.15.66:0/1803807625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200138e0 con 0x55f0168db770 2024-09-12T00:20:58.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1803807625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 msgr2=0x55f0169676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.165 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/1803807625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcc20001680 tx=0x7fcc20001b40 comp rx=0 tx=0).stop 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1803807625 shutdown_connections 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/1803807625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f0168db770 0x55f0169676a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1803807625 >> 172.21.15.66:0/1803807625 conn(0x55f016961e90 msgr2=0x55f016a4e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1803807625 shutdown_connections 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/1803807625 wait complete. 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f016811a50 con 0x55f01696b8c0 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc257a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc257a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35954/0 (socket says 172.21.15.66:35954) 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc257a8640 1 -- 172.21.15.66:0/435397050 learned_addr learned my addr 172.21.15.66:0/435397050 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc257a8640 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f016a5ca90 con 0x55f01696b8c0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc257a8640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55f016967260 tx=0x7fcc20000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcb11e03640 1 -- 172.21.15.66:0/435397050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc20013630 con 0x55f01696b8c0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f016a5cd20 con 0x55f01696b8c0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcb11e03640 1 -- 172.21.15.66:0/435397050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc20023070 con 0x55f01696b8c0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f016a5d540 con 0x55f01696b8c0 2024-09-12T00:20:58.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.160+0000 7fcb11e03640 1 -- 172.21.15.66:0/435397050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc200137f0 con 0x55f01696b8c0 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcb11e03640 1 -- 172.21.15.66:0/435397050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcc20010070 con 0x55f01696b8c0 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcb11e03640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 0x7fcb0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcb11e03640 1 -- 172.21.15.66:0/435397050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcc200501a0 con 0x55f01696b8c0 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 0x7fcb0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 0x55f016a638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a63e30 con 0x55f016a61500 2024-09-12T00:20:58.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 0x55f016a638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 0x7fcb0c03bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc100ae000 tx=0x7fcc100a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 0x55f016a638f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc25fa9640 1 -- 172.21.15.66:0/435397050 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc180083f0 con 0x55f016a61500 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a64280 con 0x55f016a61500 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc25fa9640 1 -- 172.21.15.66:0/435397050 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc180083f0 con 0x55f016a61500 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 0x55f016a68480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a68b50 con 0x55f016a66090 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc257a8640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 0x55f016a68480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc257a8640 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 0x55f016a68480 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc257a8640 1 -- 172.21.15.66:0/435397050 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcc2000f030 con 0x55f016a66090 2024-09-12T00:20:58.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a64f30 con 0x55f016a61500 2024-09-12T00:20:58.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc25fa9640 1 -- 172.21.15.66:0/435397050 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc180083f0 con 0x55f016a61500 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a65410 con 0x55f016a66090 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.164+0000 7fcc257a8640 1 -- 172.21.15.66:0/435397050 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcc2000f030 con 0x55f016a66090 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f01687c450 con 0x55f016a772a0 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35968/0 (socket says 172.21.15.66:35968) 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc25fa9640 1 -- 172.21.15.66:0/3108630967 learned_addr learned my addr 172.21.15.66:0/3108630967 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc25fa9640 1 -- 172.21.15.66:0/3108630967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f016a77d00 con 0x55f016a772a0 2024-09-12T00:20:58.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55f016a5d3d0 tx=0x7fcc1800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 -- 172.21.15.66:0/3108630967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1801c020 con 0x55f016a772a0 2024-09-12T00:20:58.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 -- 172.21.15.66:0/3108630967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18007d00 con 0x55f016a772a0 2024-09-12T00:20:58.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f016a78560 con 0x55f016a772a0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 -- 172.21.15.66:0/3108630967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc18018440 con 0x55f016a772a0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f016a78ad0 con 0x55f016a772a0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 -- 172.21.15.66:0/3108630967 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcc1801f020 con 0x55f016a772a0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 0x7fcafc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcb0affd640 1 -- 172.21.15.66:0/3108630967 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcc18051de0 con 0x55f016a772a0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc257a8640 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 0x7fcafc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc27ca29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f016967ef0 con 0x55f016a84bd0 2024-09-12T00:20:58.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.168+0000 7fcc257a8640 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 0x7fcafc03bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc2004e500 tx=0x7fcc20012ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35970/0 (socket says 172.21.15.66:35970) 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 -- 172.21.15.66:0/3923491696 learned_addr learned my addr 172.21.15.66:0/3923491696 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 -- 172.21.15.66:0/3923491696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f016a855a0 con 0x55f016a84bd0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/3923491696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcc18050130 tx=0x7fcc18043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dad24802def826 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcb08ff9640 1 -- 172.21.15.66:0/3923491696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc18021400 con 0x55f016a84bd0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcb08ff9640 1 -- 172.21.15.66:0/3923491696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18029350 con 0x55f016a84bd0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcb08ff9640 1 -- 172.21.15.66:0/3923491696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc180215a0 con 0x55f016a84bd0 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3923491696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 msgr2=0x55f016a84fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3923491696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcc18050130 tx=0x7fcc18043110 comp rx=0 tx=0).stop 2024-09-12T00:20:58.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3923491696 shutdown_connections 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3923491696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a84fb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3923491696 >> 172.21.15.66:0/3923491696 conn(0x55f016a7fff0 msgr2=0x55f016a7e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3923491696 shutdown_connections 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3923491696 wait complete. 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 Processor -- start 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- start start 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f016a83b20 con 0x55f016a84bd0 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35976/0 (socket says 172.21.15.66:35976) 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 learned_addr learned my addr 172.21.15.66:0/2283196189 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f016a8b5a0 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcc18043150 tx=0x7fcc18050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcafaffd640 1 -- 172.21.15.66:0/2283196189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc18016e00 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f016a8b830 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcafaffd640 1 -- 172.21.15.66:0/2283196189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18028300 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.172+0000 7fcafaffd640 1 -- 172.21.15.66:0/2283196189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc18028620 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f016a8c1e0 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcafaffd640 1 -- 172.21.15.66:0/2283196189 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcc18016040 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcafaffd640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcaf0039ac0 0x7fcaf003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcafaffd640 1 -- 172.21.15.66:0/2283196189 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcc18032070 con 0x55f016a84bd0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc257a8640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcaf0039ac0 0x7fcaf003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a96580 0x55f016a98a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a99190 con 0x55f016a96580 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a96580 0x55f016a98a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc257a8640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcaf0039ac0 0x7fcaf003bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55f016a5d830 tx=0x7fcc20045000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a96580 0x55f016a98a40 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 realm 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a99560 con 0x55f016a96580 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a99e30 con 0x55f016a96580 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9a1d0 con 0x55f016a96580 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a9af30 0x55f016a9d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9d8e0 con 0x55f016a9af30 2024-09-12T00:20:58.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.176+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a9af30 0x55f016a9d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a9af30 0x55f016a9d320 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc27ca29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:58.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc27ca29c0 20 searching for the correct realm 2024-09-12T00:20:58.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a9af30 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc25fa9640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcc18021020 0x7fcc1802da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x7fcc18021020 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc257a8640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcc18021020 0x7fcc1802da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc257a8640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcc18021020 0x7fcc1802da10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc257a8640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x55f0168db770 0x7fcc200125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f0168db770 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x55f0168db770 0x7fcc200125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x55f0168db770 0x7fcc200125e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.180+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f0168db770 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x7fcc18021020 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a9af30 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a96580 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x7fcc18021020 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a96580 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x7fcc18021020 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a9af30 2024-09-12T00:20:58.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f1b0 con 0x55f016a9af30 2024-09-12T00:20:58.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.196 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.184+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f0168db770 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a9af30 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a9af30 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a96580 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a96580 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f0168db770 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.197 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a9af30 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x7fcc18021020 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a96580 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f0168db770 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.188+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a9af30 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f0168db770 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x7fcc18021020 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a9af30 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f0168db770 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x55f016a96580 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcc18064040 con 0x7fcc18021020 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9e260 con 0x55f016a96580 2024-09-12T00:20:58.203 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9eb00 con 0x55f016a96580 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9ef20 con 0x55f016a9af30 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 zone default found 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 4 Realm: () 2024-09-12T00:20:58.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 zonegroup default 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.192+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016a9f5e0 con 0x55f0168db770 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa1820 con 0x55f016a9af30 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa1820 con 0x55f016a9af30 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 started sync module instance, tier type = 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa0d20 con 0x7fcc18021020 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489660756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa1c50 con 0x7fcc18021020 2024-09-12T00:20:58.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.196+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa24a0 con 0x55f016a96580 2024-09-12T00:20:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489660756240] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489660760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa28c0 con 0x55f016a96580 2024-09-12T00:20:58.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa3110 con 0x55f016a9af30 2024-09-12T00:20:58.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489660760048] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489660761376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa2f70 con 0x55f016a9af30 2024-09-12T00:20:58.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.200+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa3a70 con 0x7fcc18021020 2024-09-12T00:20:58.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489660765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa4340 con 0x7fcc18021020 2024-09-12T00:20:58.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa4d40 con 0x55f016a96580 2024-09-12T00:20:58.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489660761376] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489660765536] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489660767888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa4850 con 0x55f016a96580 2024-09-12T00:20:58.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.204+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa5210 con 0x55f0168db770 2024-09-12T00:20:58.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489660767888] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489660762560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa5210 con 0x55f0168db770 2024-09-12T00:20:58.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa5b00 con 0x55f0168db770 2024-09-12T00:20:58.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489660772880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa6190 con 0x55f0168db770 2024-09-12T00:20:58.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.208+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa6a40 con 0x55f0168db770 2024-09-12T00:20:58.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489660762560] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489660771680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa6c20 con 0x55f0168db770 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=0 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=1 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=2 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=3 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=4 2024-09-12T00:20:58.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=5 2024-09-12T00:20:58.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489660772880] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc27ca29c0 20 add_watcher() i=6 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.212+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489660771680] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100b4040 con 0x55f0168db770 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 20 add_watcher() i=7 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa9b40 con 0x55f016a96580 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcc100b4040 con 0x55f016a96580 2024-09-12T00:20:58.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489660775824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016aa6fc0 con 0x55f016a96580 2024-09-12T00:20:58.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489660775824] v33'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcadb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:58.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:58.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab22b0 con 0x55f016a96580 2024-09-12T00:20:58.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.216+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab22b0 con 0x55f0168db770 2024-09-12T00:20:58.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.220+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.220+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab2df0 con 0x55f016a9af30 2024-09-12T00:20:58.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.220+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.220+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab2df0 con 0x55f016a96580 2024-09-12T00:20:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'259 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3360 con 0x7fcc18021020 2024-09-12T00:20:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'87 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab38d0 con 0x55f016a9af30 2024-09-12T00:20:58.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.224+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab38d0 con 0x55f016a96580 2024-09-12T00:20:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.228+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.228+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab38d0 con 0x55f0168db770 2024-09-12T00:20:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.228+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.228+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab38d0 con 0x7fcc18021020 2024-09-12T00:20:58.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.232+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.232+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a9af30 2024-09-12T00:20:58.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.232+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.232+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x7fcc18021020 2024-09-12T00:20:58.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'88 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f0168db770 2024-09-12T00:20:58.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'38 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x7fcc18021020 2024-09-12T00:20:58.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.236+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f0168db770 2024-09-12T00:20:58.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.240+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'73 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.240+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a96580 2024-09-12T00:20:58.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.240+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'260 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.240+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a9af30 2024-09-12T00:20:58.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.244+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'80 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.244+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x7fcc18021020 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.244+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'89 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.244+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a9af30 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a96580 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a96580 2024-09-12T00:20:58.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'261 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.248+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x55f016a9af30 2024-09-12T00:20:58.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.252+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'81 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.252+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b30 con 0x7fcc18021020 2024-09-12T00:20:58.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.252+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.252+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3b70 con 0x55f016a9af30 2024-09-12T00:20:58.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.252+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3bb0 con 0x55f016a9af30 2024-09-12T00:20:58.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3bb0 con 0x55f016a9af30 2024-09-12T00:20:58.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3bf0 con 0x55f016a9af30 2024-09-12T00:20:58.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.256+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3bf0 con 0x55f0168db770 2024-09-12T00:20:58.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.260+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.260+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3c30 con 0x55f016a9af30 2024-09-12T00:20:58.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.260+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.260+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3c30 con 0x55f0168db770 2024-09-12T00:20:58.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.264+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.264+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3c30 con 0x55f016a9af30 2024-09-12T00:20:58.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.264+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'82 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.264+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3c30 con 0x55f0168db770 2024-09-12T00:20:58.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.268+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'74 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.268+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab3c70 con 0x7fcc18021020 2024-09-12T00:20:58.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcada7e4640 20 reqs_thread_entry: start 2024-09-12T00:20:58.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 20 Filter name: none 2024-09-12T00:20:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fca4bfff640 20 reqs_thread_entry: start 2024-09-12T00:20:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T00:20:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016ab1dc0 con 0x55f016a9af30 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:58.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1920 con 0x55f016a9af30 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 removing key index: true_admin_akey 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016acf900 con 0x55f016a9af30 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(96 true_admin_akey [delete] v33'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T00:20:58.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.272+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94489660949600 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1e00 con 0x55f0168db770 2024-09-12T00:20:58.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== watch-notify(notify (1) cookie 94489660762560 notify 141733920815 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55f016ab2b10 con 0x55f0168db770 2024-09-12T00:20:58.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcb08ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920815 cookie 94489660762560 notifier 4865 bl.length()=165 2024-09-12T00:20:58.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(97 notify.5 [notify cookie 94489660949600 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcb08ff9640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fcae8003d70 con 0x55f0168db770 2024-09-12T00:20:58.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== watch-notify(notify_complete (2) cookie 94489660949600 notify 141733920815 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f016a8b830 con 0x55f0168db770 2024-09-12T00:20:58.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc27ca29c0 10 removing email index: 2024-09-12T00:20:58.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc27ca29c0 10 removing user buckets index 2024-09-12T00:20:58.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016acf900 con 0x55f016a9af30 2024-09-12T00:20:58.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(99 a_user.buckets [delete] v33'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc27ca29c0 10 removing user index: a_user 2024-09-12T00:20:58.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.276+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a9af30 2024-09-12T00:20:58.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(100 a_user [call,call,delete] v33'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc27ca29c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc27ca29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94489660954064 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a9af30 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== watch-notify(notify (1) cookie 94489660761376 notify 141733920778 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55f016ab2eb0 con 0x55f016a9af30 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcafbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94489660761376 notifier 4865 bl.length()=155 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcafbfff640 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fca580032d0 con 0x55f016a9af30 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(101 notify.2 [notify cookie 94489660954064 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== watch-notify(notify_complete (2) cookie 94489660954064 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f016a8b5a0 con 0x55f016a9af30 2024-09-12T00:20:58.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcadb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.280+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489660775824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a96580 2024-09-12T00:20:58.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94489660775824] v33'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489660756240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x7fcc18021020 2024-09-12T00:20:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94489660756240] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 20 remove_watcher() i=0 2024-09-12T00:20:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 2 removed watcher, disabling cache 2024-09-12T00:20:58.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489660760048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a96580 2024-09-12T00:20:58.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94489660760048] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 20 remove_watcher() i=1 2024-09-12T00:20:58.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.284+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489660761376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a9af30 2024-09-12T00:20:58.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc25fa9640 1 -- 172.21.15.66:0/2283196189 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94489660761376] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1803c020 con 0x55f016a9af30 2024-09-12T00:20:58.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc27ca29c0 20 remove_watcher() i=2 2024-09-12T00:20:58.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489660765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x7fcc18021020 2024-09-12T00:20:58.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc257a8640 1 -- 172.21.15.66:0/2283196189 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94489660765536] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc2000f030 con 0x7fcc18021020 2024-09-12T00:20:58.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc27ca29c0 20 remove_watcher() i=3 2024-09-12T00:20:58.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.288+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489660767888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f016a96580 2024-09-12T00:20:58.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.292+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94489660767888] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f016a96580 2024-09-12T00:20:58.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.292+0000 7fcc27ca29c0 20 remove_watcher() i=4 2024-09-12T00:20:58.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.292+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489660762560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f0168db770 2024-09-12T00:20:58.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94489660762560] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc27ca29c0 20 remove_watcher() i=5 2024-09-12T00:20:58.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489660772880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f0168db770 2024-09-12T00:20:58.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94489660772880] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc27ca29c0 20 remove_watcher() i=6 2024-09-12T00:20:58.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.296+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489660771680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f016ad1af0 con 0x55f0168db770 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94489660771680] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc100d7040 con 0x55f0168db770 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 20 remove_watcher() i=7 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x55f0168db770 msgr2=0x7fcc200125e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x55f0168db770 0x7fcc200125e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a96580 msgr2=0x55f016a98a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a96580 0x55f016a98a40 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcc18021020 msgr2=0x7fcc1802da10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcc18021020 0x7fcc1802da10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a9af30 msgr2=0x55f016a9d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a9af30 0x55f016a9d320 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcaf0039ac0 msgr2=0x7fcaf003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcaf0039ac0 0x7fcaf003bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55f016a5d830 tx=0x7fcc20045000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc24fa7640 1 -- 172.21.15.66:0/2283196189 reap_dead start 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 msgr2=0x55f016a8b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcc18043150 tx=0x7fcc18050090 comp rx=0 tx=0).stop 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 shutdown_connections 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/2283196189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a84bd0 0x55f016a8b040 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 >> 172.21.15.66:0/2283196189 conn(0x55f016a7fff0 msgr2=0x55f016a7e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 shutdown_connections 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/2283196189 wait complete. 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 msgr2=0x7fcafc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 0x7fcafc03bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc2004e500 tx=0x7fcc20012ee0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 msgr2=0x55f016a776c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x55f016a5d3d0 tx=0x7fcc1800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 shutdown_connections 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcafc039a70 0x7fcafc03bf30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/3108630967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f016a772a0 0x55f016a776c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 >> 172.21.15.66:0/3108630967 conn(0x55f016a6cc50 msgr2=0x55f016a6d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 shutdown_connections 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/3108630967 wait complete. 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 msgr2=0x55f016a638f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 0x55f016a638f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 msgr2=0x55f016a68480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 0x55f016a68480 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 msgr2=0x7fcb0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 0x7fcb0c03bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc100ae000 tx=0x7fcc100a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 msgr2=0x55f016a5c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55f016967260 tx=0x7fcc20000f50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 shutdown_connections 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55f016a66090 0x55f016a68480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55f016a61500 0x55f016a638f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcb0c039a70 0x7fcb0c03bf30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 --2- 172.21.15.66:0/435397050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f01696b8c0 0x55f016a5c530 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 >> 172.21.15.66:0/435397050 conn(0x55f016961e90 msgr2=0x55f016966440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 shutdown_connections 2024-09-12T00:20:58.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.300+0000 7fcc27ca29c0 1 -- 172.21.15.66:0/435397050 wait complete. 2024-09-12T00:20:58.321 ERROR:root:None 2024-09-12T00:20:58.321 ERROR:root:0 2024-09-12T00:20:58.321 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T00:20:58.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T00:20:58.322 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-12T00:20:58.405 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:58.405 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:58.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f47514249c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fbc14c58c0 0x55fbc14c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f47514249c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbc13739c0 con 0x55fbc14c1770 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f47514249c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55fbc13c36d0 con 0x55fbc14c58c0 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f474e729640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fbc14c58c0 0x55fbc14c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f474e729640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55fbc14c58c0 0x55fbc14c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35984/0 (socket says 172.21.15.66:35984) 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f474ef2a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55fbc14c1770 0x55fbc14c1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41898/0 (socket says 172.21.15.66:41898) 2024-09-12T00:20:58.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.400+0000 7f474e729640 1 -- 172.21.15.66:0/3263806286 learned_addr learned my addr 172.21.15.66:0/3263806286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.404+0000 7f474e729640 1 -- 172.21.15.66:0/3263806286 >> v1:172.21.15.31:6789/0 conn(0x55fbc14c1770 legacy=0x55fbc14c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.404+0000 7f474e729640 1 -- 172.21.15.66:0/3263806286 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc1367ca0 con 0x55fbc14c58c0 2024-09-12T00:20:58.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f474e729640 1 --2- 172.21.15.66:0/3263806286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c58c0 0x55fbc14c7cb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f473800a5c0 tx=0x7f473801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a296cd0a2a8616db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f474df28640 1 -- 172.21.15.66:0/3263806286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47380a9590 con 0x55fbc14c58c0 2024-09-12T00:20:58.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f474df28640 1 -- 172.21.15.66:0/3263806286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47380ae070 con 0x55fbc14c58c0 2024-09-12T00:20:58.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f474df28640 1 -- 172.21.15.66:0/3263806286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47380a9880 con 0x55fbc14c58c0 2024-09-12T00:20:58.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 -- 172.21.15.66:0/3263806286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c58c0 msgr2=0x55fbc14c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 --2- 172.21.15.66:0/3263806286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c58c0 0x55fbc14c7cb0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f473800a5c0 tx=0x7f473801b3d0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 -- 172.21.15.66:0/3263806286 shutdown_connections 2024-09-12T00:20:58.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 --2- 172.21.15.66:0/3263806286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c58c0 0x55fbc14c7cb0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 -- 172.21.15.66:0/3263806286 >> 172.21.15.66:0/3263806286 conn(0x55fbc1435080 msgr2=0x55fbc1435490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 -- 172.21.15.66:0/3263806286 shutdown_connections 2024-09-12T00:20:58.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.408+0000 7f47514249c0 1 -- 172.21.15.66:0/3263806286 wait complete. 2024-09-12T00:20:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f47514249c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f47514249c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fbc13c7680 con 0x55fbc14c1770 2024-09-12T00:20:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f474ef2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f474ef2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:35994/0 (socket says 172.21.15.66:35994) 2024-09-12T00:20:58.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f474ef2a640 1 -- 172.21.15.66:0/2203248455 learned_addr learned my addr 172.21.15.66:0/2203248455 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f474ef2a640 1 -- 172.21.15.66:0/2203248455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc1342da0 con 0x55fbc14c1770 2024-09-12T00:20:58.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f474ef2a640 1 --2- 172.21.15.66:0/2203248455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4748001680 tx=0x7f4748001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade78d80c25a6837 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f463ce09640 1 -- 172.21.15.66:0/2203248455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748013420 con 0x55fbc14c1770 2024-09-12T00:20:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f463ce09640 1 -- 172.21.15.66:0/2203248455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47480135c0 con 0x55fbc14c1770 2024-09-12T00:20:58.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.424+0000 7f463ce09640 1 -- 172.21.15.66:0/2203248455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47480138e0 con 0x55fbc14c1770 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2203248455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 msgr2=0x55fbc15acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 --2- 172.21.15.66:0/2203248455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4748001680 tx=0x7f4748001b40 comp rx=0 tx=0).stop 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2203248455 shutdown_connections 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 --2- 172.21.15.66:0/2203248455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15acb70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2203248455 >> 172.21.15.66:0/2203248455 conn(0x55fbc1435080 msgr2=0x55fbc15a8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2203248455 shutdown_connections 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2203248455 wait complete. 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fbc1369a50 con 0x55fbc14c1770 2024-09-12T00:20:58.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f474ef2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f474ef2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36004/0 (socket says 172.21.15.66:36004) 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f474ef2a640 1 -- 172.21.15.66:0/2539082100 learned_addr learned my addr 172.21.15.66:0/2539082100 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f474ef2a640 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc15b4770 con 0x55fbc14c1770 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f474ef2a640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55fbc15adb60 tx=0x7f4748000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f463b606640 1 -- 172.21.15.66:0/2539082100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47480037a0 con 0x55fbc14c1770 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f463b606640 1 -- 172.21.15.66:0/2539082100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4748023070 con 0x55fbc14c1770 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc15b4a00 con 0x55fbc14c1770 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f463b606640 1 -- 172.21.15.66:0/2539082100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4748003ad0 con 0x55fbc14c1770 2024-09-12T00:20:58.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc15b53b0 con 0x55fbc14c1770 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.428+0000 7f463b606640 1 -- 172.21.15.66:0/2539082100 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4748010070 con 0x55fbc14c1770 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f463b606640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 0x7f463403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f463b606640 1 -- 172.21.15.66:0/2539082100 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f4748050320 con 0x55fbc14c1770 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474e729640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 0x7f463403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 0x55fbc15bb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15bbca0 con 0x55fbc15b9370 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474f72b640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 0x55fbc15bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474e729640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 0x7f463403bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f47380ad000 tx=0x7f47380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474f72b640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 0x55fbc15bb760 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474f72b640 1 -- 172.21.15.66:0/2539082100 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15b9370 2024-09-12T00:20:58.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15b56f0 con 0x55fbc15b9370 2024-09-12T00:20:58.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474f72b640 1 -- 172.21.15.66:0/2539082100 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15b9370 2024-09-12T00:20:58.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 0x55fbc15c0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15c09f0 con 0x55fbc15bdf10 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474ef2a640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 0x55fbc15c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474ef2a640 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 0x55fbc15c0300 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474ef2a640 1 -- 172.21.15.66:0/2539082100 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f474800f030 con 0x55fbc15bdf10 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15bcdb0 con 0x55fbc15b9370 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474f72b640 1 -- 172.21.15.66:0/2539082100 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15b9370 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15bd210 con 0x55fbc15bdf10 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f474ef2a640 1 -- 172.21.15.66:0/2539082100 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f474800f030 con 0x55fbc15bdf10 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.432+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fbc13d4450 con 0x55fbc15cf100 2024-09-12T00:20:58.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36008/0 (socket says 172.21.15.66:36008) 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474f72b640 1 -- 172.21.15.66:0/1442394046 learned_addr learned my addr 172.21.15.66:0/1442394046 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474f72b640 1 -- 172.21.15.66:0/1442394046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc15cfb60 con 0x55fbc15cf100 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474f72b640 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55fbc15b55a0 tx=0x7f474000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 -- 172.21.15.66:0/1442394046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740007cb0 con 0x55fbc15cf100 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 -- 172.21.15.66:0/1442394046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4740007e50 con 0x55fbc15cf100 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc15d03c0 con 0x55fbc15cf100 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 -- 172.21.15.66:0/1442394046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47400195c0 con 0x55fbc15cf100 2024-09-12T00:20:58.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc15d0930 con 0x55fbc15cf100 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 -- 172.21.15.66:0/1442394046 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4740016050 con 0x55fbc15cf100 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 0x7f462803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f4638e01640 1 -- 172.21.15.66:0/1442394046 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f4740051f10 con 0x55fbc15cf100 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474ef2a640 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 0x7f462803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f474ef2a640 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 0x7f462803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55fbc15bc0e0 tx=0x7f4748006340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.436+0000 7f47514249c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fbc15ad3c0 con 0x55fbc15dca90 2024-09-12T00:20:58.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36022/0 (socket says 172.21.15.66:36022) 2024-09-12T00:20:58.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 -- 172.21.15.66:0/897241590 learned_addr learned my addr 172.21.15.66:0/897241590 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 -- 172.21.15.66:0/897241590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc15dd460 con 0x55fbc15dca90 2024-09-12T00:20:58.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- 172.21.15.66:0/897241590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4740014530 tx=0x7f47400144a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae0f75a239b8f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f46327fc640 1 -- 172.21.15.66:0/897241590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740024470 con 0x55fbc15dca90 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f46327fc640 1 -- 172.21.15.66:0/897241590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4740049570 con 0x55fbc15dca90 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f46327fc640 1 -- 172.21.15.66:0/897241590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47400247f0 con 0x55fbc15dca90 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- 172.21.15.66:0/897241590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 msgr2=0x55fbc15dce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 --2- 172.21.15.66:0/897241590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4740014530 tx=0x7f47400144a0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- 172.21.15.66:0/897241590 shutdown_connections 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 --2- 172.21.15.66:0/897241590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15dce70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- 172.21.15.66:0/897241590 >> 172.21.15.66:0/897241590 conn(0x55fbc15d7e50 msgr2=0x55fbc15d6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- 172.21.15.66:0/897241590 shutdown_connections 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- 172.21.15.66:0/897241590 wait complete. 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 Processor -- start 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- start start 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f47514249c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fbc15db980 con 0x55fbc15dca90 2024-09-12T00:20:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36038/0 (socket says 172.21.15.66:36038) 2024-09-12T00:20:58.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 learned_addr learned my addr 172.21.15.66:0/4076538164 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc15e3470 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f474f72b640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f474004eff0 tx=0x7f4740050100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.440+0000 7f4630ff9640 1 -- 172.21.15.66:0/4076538164 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740019e30 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc15e3700 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f4630ff9640 1 -- 172.21.15.66:0/4076538164 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4740024470 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f4630ff9640 1 -- 172.21.15.66:0/4076538164 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47400147d0 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc15e40b0 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f4630ff9640 1 -- 172.21.15.66:0/4076538164 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4740054020 con 0x55fbc15dca90 2024-09-12T00:20:58.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f4630ff9640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f46180399d0 0x7f461803be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f4630ff9640 1 -- 172.21.15.66:0/4076538164 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f4740032a00 con 0x55fbc15dca90 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474ef2a640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f46180399d0 0x7f461803be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15ee470 0x55fbc15f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f1080 con 0x55fbc15ee470 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15ee470 0x55fbc15f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474ef2a640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f46180399d0 0x7f461803be90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f474801da60 tx=0x7f4748035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15ee470 0x55fbc15f0930 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 realm 2024-09-12T00:20:58.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f14b0 con 0x55fbc15ee470 2024-09-12T00:20:58.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f1d80 con 0x55fbc15ee470 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f2120 con 0x55fbc15ee470 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15f2e80 0x55fbc15f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.444+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f5880 con 0x55fbc15f2e80 2024-09-12T00:20:58.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15f2e80 0x55fbc15f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15f2e80 0x55fbc15f5270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f47514249c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f47514249c0 20 searching for the correct realm 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4740057040 0x7f4740040440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474ef2a640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4740057040 0x7f4740040440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474ef2a640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4740057040 0x7f4740040440 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474ef2a640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f47480417e0 0x7f474804e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474e729640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f47480417e0 0x7f474804e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474e729640 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f47480417e0 0x7f474804e780 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.448+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.452+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.456+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15f2e80 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f47480417e0 2024-09-12T00:20:58.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x55fbc15ee470 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7150 con 0x7f4740057040 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:58.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f62d0 con 0x55fbc15ee470 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f6b20 con 0x55fbc15ee470 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.460+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f74f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 zone default found 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 4 Realm: () 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 zonegroup default 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f7920 con 0x7f47480417e0 2024-09-12T00:20:58.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f9750 con 0x55fbc15f2e80 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f9be0 con 0x55fbc15f2e80 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 started sync module instance, tier type = 2024-09-12T00:20:58.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:58.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f8bf0 con 0x7f4740057040 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539769415488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15f9be0 con 0x7f4740057040 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.464+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fa430 con 0x55fbc15ee470 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.468+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539769415488] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.468+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.468+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539769421696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fa850 con 0x55fbc15ee470 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.468+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fb0e0 con 0x55fbc15f2e80 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.468+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539769421696] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539769422752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fac70 con 0x55fbc15f2e80 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fbaf0 con 0x7f4740057040 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539769427520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fc340 con 0x7f4740057040 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fcd40 con 0x55fbc15ee470 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539769422752] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539769427520] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539769423808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fbe90 con 0x55fbc15ee470 2024-09-12T00:20:58.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.472+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fd5e0 con 0x7f47480417e0 2024-09-12T00:20:58.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.476+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539769423808] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.476+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.476+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539769432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fbe90 con 0x7f47480417e0 2024-09-12T00:20:58.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.476+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fdad0 con 0x7f47480417e0 2024-09-12T00:20:58.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539769432144] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539769435616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fdad0 con 0x7f47480417e0 2024-09-12T00:20:58.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fe510 con 0x7f47480417e0 2024-09-12T00:20:58.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539769435616] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539769433920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fe510 con 0x7f47480417e0 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=0 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=1 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=2 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=3 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=4 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=5 2024-09-12T00:20:58.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.480+0000 7f47514249c0 20 add_watcher() i=6 2024-09-12T00:20:58.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539769433920] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x7f47480417e0 2024-09-12T00:20:58.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f47514249c0 20 add_watcher() i=7 2024-09-12T00:20:58.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f47514249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:58.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1601910 con 0x55fbc15ee470 2024-09-12T00:20:58.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.484+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539769438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc15fee30 con 0x55fbc15ee470 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539769438768] v33'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47380a9920 con 0x55fbc15ee470 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f4605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 5 note: GC not initialized 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f4604fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:58.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:58.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 Filter name: none 2024-09-12T00:20:58.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f45fdffb640 20 reqs_thread_entry: start 2024-09-12T00:20:58.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:58.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1624e90 con 0x7f47480417e0 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f47380d5040 con 0x7f47480417e0 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:58.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.488+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc162b8c0 con 0x7f47480417e0 2024-09-12T00:20:58.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x7f47480417e0 2024-09-12T00:20:58.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f47514249c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f47514249c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f47514249c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94539769623344 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1626fd0 con 0x55fbc15ee470 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94539769423808 notify 141733920804 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55fbc1367ca0 con 0x55fbc15ee470 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f46327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94539769423808 notifier 4872 bl.length()=666 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f46327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f46327fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94539769623344 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f47380d5040 con 0x55fbc15ee470 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f46327fc640 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4614003eb0 con 0x55fbc15ee470 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x55fbc15ee470 2024-09-12T00:20:58.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94539769623344 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f47380bfde0 con 0x55fbc15ee470 2024-09-12T00:20:58.499 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:58.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f4605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.492+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539769438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x55fbc15ee470 2024-09-12T00:20:58.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94539769438768] v33'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x55fbc15ee470 2024-09-12T00:20:58.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539769415488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x7f4740057040 2024-09-12T00:20:58.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94539769415488] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f47514249c0 20 remove_watcher() i=0 2024-09-12T00:20:58.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f47514249c0 2 removed watcher, disabling cache 2024-09-12T00:20:58.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.496+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539769421696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x55fbc15ee470 2024-09-12T00:20:58.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94539769421696] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x55fbc15ee470 2024-09-12T00:20:58.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 20 remove_watcher() i=1 2024-09-12T00:20:58.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539769422752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x55fbc15f2e80 2024-09-12T00:20:58.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f474f72b640 1 -- 172.21.15.66:0/4076538164 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94539769422752] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47400083f0 con 0x55fbc15f2e80 2024-09-12T00:20:58.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 20 remove_watcher() i=2 2024-09-12T00:20:58.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539769427520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x7f4740057040 2024-09-12T00:20:58.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f474ef2a640 1 -- 172.21.15.66:0/4076538164 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94539769427520] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f474800f030 con 0x7f4740057040 2024-09-12T00:20:58.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 20 remove_watcher() i=3 2024-09-12T00:20:58.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.500+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539769423808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x55fbc15ee470 2024-09-12T00:20:58.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94539769423808] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x55fbc15ee470 2024-09-12T00:20:58.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f47514249c0 20 remove_watcher() i=4 2024-09-12T00:20:58.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539769432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x7f47480417e0 2024-09-12T00:20:58.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94539769432144] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x7f47480417e0 2024-09-12T00:20:58.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f47514249c0 20 remove_watcher() i=5 2024-09-12T00:20:58.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.504+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539769435616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x7f47480417e0 2024-09-12T00:20:58.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.508+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94539769435616] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x7f47480417e0 2024-09-12T00:20:58.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.508+0000 7f47514249c0 20 remove_watcher() i=6 2024-09-12T00:20:58.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.508+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539769433920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fbc1622bc0 con 0x7f47480417e0 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.508+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94539769433920] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47380d5040 con 0x7f47480417e0 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.508+0000 7f47514249c0 20 remove_watcher() i=7 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f47480417e0 msgr2=0x7f474804e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f47480417e0 0x7f474804e780 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15ee470 msgr2=0x55fbc15f0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15ee470 0x55fbc15f0930 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4740057040 msgr2=0x7f4740040440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4740057040 0x7f4740040440 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15f2e80 msgr2=0x55fbc15f5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15f2e80 0x55fbc15f5270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f46180399d0 msgr2=0x7f461803be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f46180399d0 0x7f461803be90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f474801da60 tx=0x7f4748035000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 msgr2=0x55fbc15e2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f474004eff0 tx=0x7f4740050100 comp rx=0 tx=0).stop 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f474e729640 1 -- 172.21.15.66:0/4076538164 reap_dead start 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 shutdown_connections 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/4076538164 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15dca90 0x55fbc15e2f10 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 >> 172.21.15.66:0/4076538164 conn(0x55fbc15d7e50 msgr2=0x55fbc15d6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 shutdown_connections 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/4076538164 wait complete. 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 msgr2=0x7f462803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 0x7f462803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55fbc15bc0e0 tx=0x7f4748006340 comp rx=0 tx=0).stop 2024-09-12T00:20:58.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 msgr2=0x55fbc15cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x55fbc15b55a0 tx=0x7f474000af40 comp rx=0 tx=0).stop 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 shutdown_connections 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4628039a70 0x7f462803bf30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/1442394046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc15cf100 0x55fbc15cf520 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 >> 172.21.15.66:0/1442394046 conn(0x55fbc15c4ab0 msgr2=0x55fbc15c4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 shutdown_connections 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/1442394046 wait complete. 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 msgr2=0x55fbc15bb760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 0x55fbc15bb760 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 msgr2=0x55fbc15c0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 0x55fbc15c0300 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 msgr2=0x7f463403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 0x7f463403bf30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f47380ad000 tx=0x7f47380a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 msgr2=0x55fbc15b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55fbc15adb60 tx=0x7f4748000f50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 shutdown_connections 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55fbc15bdf10 0x55fbc15c0300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55fbc15b9370 0x55fbc15bb760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4634039a70 0x7f463403bf30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 --2- 172.21.15.66:0/2539082100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fbc14c1770 0x55fbc15b4210 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 >> 172.21.15.66:0/2539082100 conn(0x55fbc1435080 msgr2=0x55fbc15a7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 shutdown_connections 2024-09-12T00:20:58.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.512+0000 7f47514249c0 1 -- 172.21.15.66:0/2539082100 wait complete. 2024-09-12T00:20:58.529 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.529 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.530 ERROR:root:0 2024-09-12T00:20:58.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:58.543 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:58.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T00:20:58.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T00:20:58.544 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-12T00:20:58.617 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:58.617 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:58.618 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf83c269c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562411cbd590 0x562411cbc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf83c269c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562411bfa9c0 con 0x562411cbd060 2024-09-12T00:20:58.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf83c269c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x562411c4a6d0 con 0x562411cbd590 2024-09-12T00:20:58.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf80f2b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x562411cbd590 0x562411cbc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf8172c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x562411cbd060 0x562411cbba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41912/0 (socket says 172.21.15.66:41912) 2024-09-12T00:20:58.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.612+0000 7fcf8172c640 1 -- 172.21.15.66:0/707802709 learned_addr learned my addr 172.21.15.66:0/707802709 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:58.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf80f2b640 1 -- 172.21.15.66:0/707802709 >> v1:172.21.15.31:6789/0 conn(0x562411cbd060 legacy=0x562411cbba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.620 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf80f2b640 1 -- 172.21.15.66:0/707802709 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411beeca0 con 0x562411cbd590 2024-09-12T00:20:58.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/707802709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd590 0x562411cbc110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00a420 tx=0x7fcf6c01af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf96fcb844fadc42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf7bfff640 1 -- 172.21.15.66:0/707802709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c0af070 con 0x562411cbd590 2024-09-12T00:20:58.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf7bfff640 1 -- 172.21.15.66:0/707802709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0aa530 con 0x562411cbd590 2024-09-12T00:20:58.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf7bfff640 1 -- 172.21.15.66:0/707802709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf6c0aa850 con 0x562411cbd590 2024-09-12T00:20:58.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 -- 172.21.15.66:0/707802709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd590 msgr2=0x562411cbc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/707802709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd590 0x562411cbc110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00a420 tx=0x7fcf6c01af70 comp rx=0 tx=0).stop 2024-09-12T00:20:58.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 -- 172.21.15.66:0/707802709 shutdown_connections 2024-09-12T00:20:58.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/707802709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd590 0x562411cbc110 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 -- 172.21.15.66:0/707802709 >> 172.21.15.66:0/707802709 conn(0x562411d42040 msgr2=0x562411d44460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 -- 172.21.15.66:0/707802709 shutdown_connections 2024-09-12T00:20:58.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.616+0000 7fcf83c269c0 1 -- 172.21.15.66:0/707802709 wait complete. 2024-09-12T00:20:58.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.632+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562411c4e680 con 0x562411cbd060 2024-09-12T00:20:58.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36052/0 (socket says 172.21.15.66:36052) 2024-09-12T00:20:58.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 -- 172.21.15.66:0/968150950 learned_addr learned my addr 172.21.15.66:0/968150950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 -- 172.21.15.66:0/968150950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411bc9da0 con 0x562411cbd060 2024-09-12T00:20:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 --2- 172.21.15.66:0/968150950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcf74001e50 tx=0x7fcf74001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43d467e74cbe223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fce6e614640 1 -- 172.21.15.66:0/968150950 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf74012020 con 0x562411cbd060 2024-09-12T00:20:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fce6e614640 1 -- 172.21.15.66:0/968150950 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7400e7c0 con 0x562411cbd060 2024-09-12T00:20:58.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fce6e614640 1 -- 172.21.15.66:0/968150950 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7400eaa0 con 0x562411cbd060 2024-09-12T00:20:58.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- 172.21.15.66:0/968150950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 msgr2=0x562411e33d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/968150950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcf74001e50 tx=0x7fcf74001e80 comp rx=0 tx=0).stop 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- 172.21.15.66:0/968150950 shutdown_connections 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/968150950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e33d60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- 172.21.15.66:0/968150950 >> 172.21.15.66:0/968150950 conn(0x562411d42040 msgr2=0x562411e2fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- 172.21.15.66:0/968150950 shutdown_connections 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- 172.21.15.66:0/968150950 wait complete. 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf83c269c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562411bf0a50 con 0x562411cbd060 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36058/0 (socket says 172.21.15.66:36058) 2024-09-12T00:20:58.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.636+0000 7fcf8172c640 1 -- 172.21.15.66:0/4144005626 learned_addr learned my addr 172.21.15.66:0/4144005626 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf8172c640 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411e3b8c0 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf8172c640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x562411e34d50 tx=0x7fcf74000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 -- 172.21.15.66:0/4144005626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf74012030 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562411e3bb50 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 -- 172.21.15.66:0/4144005626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7401a680 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 -- 172.21.15.66:0/4144005626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7401a9a0 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562411e3c500 con 0x562411cbd060 2024-09-12T00:20:58.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 -- 172.21.15.66:0/4144005626 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcf74015020 con 0x562411cbd060 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 0x7fce6803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fce6ce11640 1 -- 172.21.15.66:0/4144005626 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcf74020070 con 0x562411cbd060 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 0x7fce6803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 0x562411e424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e42a10 con 0x562411cbd590 2024-09-12T00:20:58.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 0x562411e424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 0x7fce6803bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0ac000 tx=0x7fcf6c0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 0x562411e424d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf81f2d640 1 -- 172.21.15.66:0/4144005626 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf7c0083f0 con 0x562411cbd590 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.640+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e3c840 con 0x562411cbd590 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 -- 172.21.15.66:0/4144005626 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf7c0083f0 con 0x562411cbd590 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 0x562411e47070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e47760 con 0x562411e44c80 2024-09-12T00:20:58.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf8172c640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 0x562411e47070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf8172c640 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 0x562411e47070 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf8172c640 1 -- 172.21.15.66:0/4144005626 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf74008030 con 0x562411e44c80 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e43b20 con 0x562411cbd590 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 -- 172.21.15.66:0/4144005626 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf7c0083f0 con 0x562411cbd590 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e44000 con 0x562411e44c80 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf8172c640 1 -- 172.21.15.66:0/4144005626 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf74008030 con 0x562411e44c80 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf83c269c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562411c5b450 con 0x562411e55eb0 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36070/0 (socket says 172.21.15.66:36070) 2024-09-12T00:20:58.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 -- 172.21.15.66:0/406602579 learned_addr learned my addr 172.21.15.66:0/406602579 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 -- 172.21.15.66:0/406602579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411e56910 con 0x562411e55eb0 2024-09-12T00:20:58.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x562411e3c6f0 tx=0x7fcf7c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.644+0000 7fce65ffb640 1 -- 172.21.15.66:0/406602579 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c01c020 con 0x562411e55eb0 2024-09-12T00:20:58.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fce65ffb640 1 -- 172.21.15.66:0/406602579 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c007d20 con 0x562411e55eb0 2024-09-12T00:20:58.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562411e57170 con 0x562411e55eb0 2024-09-12T00:20:58.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fce65ffb640 1 -- 172.21.15.66:0/406602579 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c018440 con 0x562411e55eb0 2024-09-12T00:20:58.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562411e576e0 con 0x562411e55eb0 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fce65ffb640 1 -- 172.21.15.66:0/406602579 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcf7c01f020 con 0x562411e55eb0 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fce65ffb640 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 0x7fce5803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fce65ffb640 1 -- 172.21.15.66:0/406602579 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcf7c051de0 con 0x562411e55eb0 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf8172c640 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 0x7fce5803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf8172c640 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 0x7fce5803bf80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf74016b70 tx=0x7fcf740163f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf83c269c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562411e34590 con 0x562411e63840 2024-09-12T00:20:58.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36082/0 (socket says 172.21.15.66:36082) 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf81f2d640 1 -- 172.21.15.66:0/283794145 learned_addr learned my addr 172.21.15.66:0/283794145 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf81f2d640 1 -- 172.21.15.66:0/283794145 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411e64230 con 0x562411e63840 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.648+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/283794145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c050070 tx=0x7fcf7c016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3a17168c9c85d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5f7fe640 1 -- 172.21.15.66:0/283794145 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c021530 con 0x562411e63840 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5f7fe640 1 -- 172.21.15.66:0/283794145 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c029350 con 0x562411e63840 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5f7fe640 1 -- 172.21.15.66:0/283794145 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c029c70 con 0x562411e63840 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/283794145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 msgr2=0x562411e63c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/283794145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c050070 tx=0x7fcf7c016970 comp rx=0 tx=0).stop 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/283794145 shutdown_connections 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/283794145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e63c40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/283794145 >> 172.21.15.66:0/283794145 conn(0x562411e5ec60 msgr2=0x562411e5cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/283794145 shutdown_connections 2024-09-12T00:20:58.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/283794145 wait complete. 2024-09-12T00:20:58.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 Processor -- start 2024-09-12T00:20:58.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- start start 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562411e62790 con 0x562411e63840 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf81f2d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36092/0 (socket says 172.21.15.66:36092) 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 learned_addr learned my addr 172.21.15.66:0/1699334892 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562411e6a250 con 0x562411e63840 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c050360 tx=0x7fcf7c04ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5dffb640 1 -- 172.21.15.66:0/1699334892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c039070 con 0x562411e63840 2024-09-12T00:20:58.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5dffb640 1 -- 172.21.15.66:0/1699334892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c029c70 con 0x562411e63840 2024-09-12T00:20:58.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562411e6a4e0 con 0x562411e63840 2024-09-12T00:20:58.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5dffb640 1 -- 172.21.15.66:0/1699334892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf7c028300 con 0x562411e63840 2024-09-12T00:20:58.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562411e6ae90 con 0x562411e63840 2024-09-12T00:20:58.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.652+0000 7fce5dffb640 1 -- 172.21.15.66:0/1699334892 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcf7c03c070 con 0x562411e63840 2024-09-12T00:20:58.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fce5dffb640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce50039a70 0x7fce5003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fce5dffb640 1 -- 172.21.15.66:0/1699334892 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcf7c031070 con 0x562411e63840 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf8172c640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce50039a70 0x7fce5003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411e751f0 0x562411e776b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e77e00 con 0x562411e751f0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411e751f0 0x562411e776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf8172c640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce50039a70 0x7fce5003bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf74016fd0 tx=0x7fcf74033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411e751f0 0x562411e776b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 realm 2024-09-12T00:20:58.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e78230 con 0x562411e751f0 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e78b00 con 0x562411e751f0 2024-09-12T00:20:58.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e78ea0 con 0x562411e751f0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e79c00 0x562411e7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e7c640 con 0x562411e79c00 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e79c00 0x562411e7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e79c00 0x562411e7bff0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 20 searching for the correct realm 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e79c00 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcf7c021020 0x7fcf7c02aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x7fcf7c021020 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.656+0000 7fcf8172c640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcf7c021020 0x7fcf7c02aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf8172c640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcf7c021020 0x7fcf7c02aa30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf8172c640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcf74017050 0x7fcf7404d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x7fcf74017050 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcf74017050 0x7fcf7404d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcf74017050 0x7fcf7404d340 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x7fcf74017050 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.660+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x7fcf7c021020 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e79c00 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x562411e751f0 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562411e7df10 con 0x7fcf7c021020 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x562411e751f0 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x7fcf7c021020 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x562411e79c00 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x7fcf74017050 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7405d040 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.664+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e751f0 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e751f0 2024-09-12T00:20:58.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf74017050 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e79c00 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf7c021020 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e751f0 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf74017050 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e79c00 2024-09-12T00:20:58.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf74017050 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.668+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf7c021020 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e79c00 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf74017050 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x562411e751f0 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fcf7c06b040 con 0x7fcf7c021020 2024-09-12T00:20:58.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e7d0c0 con 0x562411e751f0 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e7d910 con 0x562411e751f0 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e7e2b0 con 0x562411e79c00 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 zone default found 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 4 Realm: () 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:58.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 zonegroup default 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e7e6e0 con 0x7fcf74017050 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e809c0 con 0x562411e79c00 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.672+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e809c0 con 0x562411e79c00 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 20 started sync module instance, tier type = 2024-09-12T00:20:58.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:58.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e7fe50 con 0x7fcf7c021020 2024-09-12T00:20:58.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94712919228992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e80e20 con 0x7fcf7c021020 2024-09-12T00:20:58.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e81670 con 0x562411e751f0 2024-09-12T00:20:58.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.676+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94712919228992] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94712919230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e81350 con 0x562411e751f0 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e81e70 con 0x562411e79c00 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94712919230048] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94712919234880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e81e30 con 0x562411e79c00 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.680+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e82880 con 0x7fcf7c021020 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94712919237584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e82ca0 con 0x7fcf7c021020 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e83710 con 0x562411e751f0 2024-09-12T00:20:58.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94712919234880] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94712919237584] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94712919241184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e827f0 con 0x562411e751f0 2024-09-12T00:20:58.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.684+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e83fb0 con 0x7fcf74017050 2024-09-12T00:20:58.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94712919241184] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94712919232032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e827f0 con 0x7fcf74017050 2024-09-12T00:20:58.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e84490 con 0x7fcf74017050 2024-09-12T00:20:58.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94712919232032] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94712919244672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e84450 con 0x7fcf74017050 2024-09-12T00:20:58.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.688+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e84e70 con 0x7fcf74017050 2024-09-12T00:20:58.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94712919244672] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94712919247200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e84e30 con 0x7fcf74017050 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=0 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=1 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=2 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=3 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=4 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=5 2024-09-12T00:20:58.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.692+0000 7fcf83c269c0 20 add_watcher() i=6 2024-09-12T00:20:58.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94712919247200] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74017050 2024-09-12T00:20:58.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 add_watcher() i=7 2024-09-12T00:20:58.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:58.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411e882c0 con 0x562411e751f0 2024-09-12T00:20:58.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf6c0b2070 con 0x562411e751f0 2024-09-12T00:20:58.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94712919242976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411e857e0 con 0x562411e751f0 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94712919242976] v33'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fce367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 5 note: GC not initialized 2024-09-12T00:20:58.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fce357e2640 20 reqs_thread_entry: start 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 Filter name: none 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcda6ffd640 20 reqs_thread_entry: start 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.696+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411eab8b0 con 0x7fcf74017050 2024-09-12T00:20:58.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fcf6c0d6040 con 0x7fcf74017050 2024-09-12T00:20:58.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T00:20:58.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:58.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:58.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411eb2640 con 0x7fcf74017050 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x7fcf74017050 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94712919433392 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562411eadd10 con 0x562411e751f0 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94712919241184 notify 141733920805 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fcf6c0c9040 con 0x562411e751f0 2024-09-12T00:20:58.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fce5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94712919241184 notifier 4879 bl.length()=666 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fce5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fce5f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fce5f7fe640 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fce44003eb0 con 0x562411e751f0 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94712919433392 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.700+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94712919433392 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcf6c0bd040 con 0x562411e751f0 2024-09-12T00:20:58.708 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:58.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fce367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94712919242976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x562411e751f0 2024-09-12T00:20:58.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94712919242976] v33'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94712919228992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x7fcf7c021020 2024-09-12T00:20:58.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94712919228992] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf83c269c0 20 remove_watcher() i=0 2024-09-12T00:20:58.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf83c269c0 2 removed watcher, disabling cache 2024-09-12T00:20:58.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.704+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94712919230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x562411e751f0 2024-09-12T00:20:58.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94712919230048] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf83c269c0 20 remove_watcher() i=1 2024-09-12T00:20:58.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94712919234880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x562411e79c00 2024-09-12T00:20:58.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf81f2d640 1 -- 172.21.15.66:0/1699334892 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94712919234880] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf7c03b030 con 0x562411e79c00 2024-09-12T00:20:58.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf83c269c0 20 remove_watcher() i=2 2024-09-12T00:20:58.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.708+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94712919237584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x7fcf7c021020 2024-09-12T00:20:58.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf8172c640 1 -- 172.21.15.66:0/1699334892 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94712919237584] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf74008030 con 0x7fcf7c021020 2024-09-12T00:20:58.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf83c269c0 20 remove_watcher() i=3 2024-09-12T00:20:58.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94712919241184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x562411e751f0 2024-09-12T00:20:58.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94712919241184] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x562411e751f0 2024-09-12T00:20:58.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf83c269c0 20 remove_watcher() i=4 2024-09-12T00:20:58.719 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.712+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94712919232032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x7fcf74017050 2024-09-12T00:20:58.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94712919232032] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x7fcf74017050 2024-09-12T00:20:58.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf83c269c0 20 remove_watcher() i=5 2024-09-12T00:20:58.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94712919244672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x7fcf74017050 2024-09-12T00:20:58.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94712919244672] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x7fcf74017050 2024-09-12T00:20:58.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf83c269c0 20 remove_watcher() i=6 2024-09-12T00:20:58.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.716+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94712919247200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562411ea9620 con 0x7fcf74017050 2024-09-12T00:20:58.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94712919247200] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf6c0d6040 con 0x7fcf74017050 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 20 remove_watcher() i=7 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcf74017050 msgr2=0x7fcf7404d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcf74017050 0x7fcf7404d340 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411e751f0 msgr2=0x562411e776b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411e751f0 0x562411e776b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcf7c021020 msgr2=0x7fcf7c02aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fcf7c021020 0x7fcf7c02aa30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e79c00 msgr2=0x562411e7bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e79c00 0x562411e7bff0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce50039a70 msgr2=0x7fce5003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce50039a70 0x7fce5003bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf74016fd0 tx=0x7fcf74033000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 msgr2=0x562411e69cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c050360 tx=0x7fcf7c04ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf80f2b640 1 -- 172.21.15.66:0/1699334892 reap_dead start 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 shutdown_connections 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/1699334892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e63840 0x562411e69cf0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 >> 172.21.15.66:0/1699334892 conn(0x562411e5ec60 msgr2=0x562411e5ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 shutdown_connections 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/1699334892 wait complete. 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 msgr2=0x7fce5803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 0x7fce5803bf80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf74016b70 tx=0x7fcf740163f0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 msgr2=0x562411e562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x562411e3c6f0 tx=0x7fcf7c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 shutdown_connections 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce58039ac0 0x7fce5803bf80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/406602579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411e55eb0 0x562411e562d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 >> 172.21.15.66:0/406602579 conn(0x562411e4b860 msgr2=0x562411e4bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 shutdown_connections 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/406602579 wait complete. 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 msgr2=0x562411e424d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 0x562411e424d0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 msgr2=0x562411e47070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 0x562411e47070 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 msgr2=0x7fce6803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 0x7fce6803bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0ac000 tx=0x7fcf6c0a5000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 msgr2=0x562411e3b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x562411e34d50 tx=0x7fcf74000ee0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 shutdown_connections 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x562411e44c80 0x562411e47070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x562411cbd590 0x562411e424d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fce68039a70 0x7fce6803bf30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 --2- 172.21.15.66:0/4144005626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562411cbd060 0x562411e3b360 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 >> 172.21.15.66:0/4144005626 conn(0x562411d42040 msgr2=0x562411e2e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 shutdown_connections 2024-09-12T00:20:58.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.720+0000 7fcf83c269c0 1 -- 172.21.15.66:0/4144005626 wait complete. 2024-09-12T00:20:58.739 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.739 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.739 ERROR:root:0 2024-09-12T00:20:58.739 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:58.752 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:58.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:58.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:58.753 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T00:20:58.815 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:58.815 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:58.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436d3299c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc7a94b770 0x55dc7a9dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436d3299c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc7a88b9c0 con 0x55dc7a94bb50 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436d3299c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55dc7a8db6d0 con 0x55dc7a94b770 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436ae2f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc7a94b770 0x55dc7a9dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436ae2f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55dc7a94b770 0x55dc7a9dc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36100/0 (socket says 172.21.15.66:36100) 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436a62e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55dc7a94bb50 0x55dc7a9deaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41928/0 (socket says 172.21.15.66:41928) 2024-09-12T00:20:58.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436ae2f640 1 -- 172.21.15.66:0/1226420553 learned_addr learned my addr 172.21.15.66:0/1226420553 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436ae2f640 1 -- 172.21.15.66:0/1226420553 >> v1:172.21.15.31:6789/0 conn(0x55dc7a94bb50 legacy=0x55dc7a9deaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.812+0000 7f436ae2f640 1 -- 172.21.15.66:0/1226420553 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7a87fca0 con 0x55dc7a94b770 2024-09-12T00:20:58.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1226420553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7a9dc5a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f435c00a5c0 tx=0x7f435c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735f540d2192b158 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f4369e2d640 1 -- 172.21.15.66:0/1226420553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0a6070 con 0x55dc7a94b770 2024-09-12T00:20:58.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f4369e2d640 1 -- 172.21.15.66:0/1226420553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c0af070 con 0x55dc7a94b770 2024-09-12T00:20:58.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f4369e2d640 1 -- 172.21.15.66:0/1226420553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0aa5c0 con 0x55dc7a94b770 2024-09-12T00:20:58.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 -- 172.21.15.66:0/1226420553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 msgr2=0x55dc7a9dc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1226420553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7a9dc5a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f435c00a5c0 tx=0x7f435c01b340 comp rx=0 tx=0).stop 2024-09-12T00:20:58.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 -- 172.21.15.66:0/1226420553 shutdown_connections 2024-09-12T00:20:58.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1226420553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7a9dc5a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 -- 172.21.15.66:0/1226420553 >> 172.21.15.66:0/1226420553 conn(0x55dc7a9d1e90 msgr2=0x55dc7a9d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 -- 172.21.15.66:0/1226420553 shutdown_connections 2024-09-12T00:20:58.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.816+0000 7f436d3299c0 1 -- 172.21.15.66:0/1226420553 wait complete. 2024-09-12T00:20:58.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc7a8df680 con 0x55dc7a94b770 2024-09-12T00:20:58.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436ae2f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436ae2f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36114/0 (socket says 172.21.15.66:36114) 2024-09-12T00:20:58.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436ae2f640 1 -- 172.21.15.66:0/3928520386 learned_addr learned my addr 172.21.15.66:0/3928520386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436ae2f640 1 -- 172.21.15.66:0/3928520386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7a85ada0 con 0x55dc7a94b770 2024-09-12T00:20:58.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436ae2f640 1 --2- 172.21.15.66:0/3928520386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f435c018f70 tx=0x7f435c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3aee723b0d96462 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f4258e09640 1 -- 172.21.15.66:0/3928520386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0aa9e0 con 0x55dc7a94b770 2024-09-12T00:20:58.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f4258e09640 1 -- 172.21.15.66:0/3928520386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c0aab80 con 0x55dc7a94b770 2024-09-12T00:20:58.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f4258e09640 1 -- 172.21.15.66:0/3928520386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0aae60 con 0x55dc7a94b770 2024-09-12T00:20:58.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- 172.21.15.66:0/3928520386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 msgr2=0x55dc7aac4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3928520386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f435c018f70 tx=0x7f435c003030 comp rx=0 tx=0).stop 2024-09-12T00:20:58.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- 172.21.15.66:0/3928520386 shutdown_connections 2024-09-12T00:20:58.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3928520386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aac4a40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- 172.21.15.66:0/3928520386 >> 172.21.15.66:0/3928520386 conn(0x55dc7a9d1e90 msgr2=0x55dc7aac06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- 172.21.15.66:0/3928520386 shutdown_connections 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 -- 172.21.15.66:0/3928520386 wait complete. 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.832+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc7a881a50 con 0x55dc7a94b770 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436ae2f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436ae2f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36130/0 (socket says 172.21.15.66:36130) 2024-09-12T00:20:58.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436ae2f640 1 -- 172.21.15.66:0/3702367143 learned_addr learned my addr 172.21.15.66:0/3702367143 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436ae2f640 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7aacc4e0 con 0x55dc7a94b770 2024-09-12T00:20:58.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436ae2f640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c10 tx=0x7f435c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 -- 172.21.15.66:0/3702367143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0c6750 con 0x55dc7a94b770 2024-09-12T00:20:58.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 -- 172.21.15.66:0/3702367143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c0c68f0 con 0x55dc7a94b770 2024-09-12T00:20:58.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7aacc770 con 0x55dc7a94b770 2024-09-12T00:20:58.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 -- 172.21.15.66:0/3702367143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f435c0c6bf0 con 0x55dc7a94b770 2024-09-12T00:20:58.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7aacd120 con 0x55dc7a94b770 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 -- 172.21.15.66:0/3702367143 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f435c0ce030 con 0x55dc7a94b770 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 0x7f425003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f4257606640 1 -- 172.21.15.66:0/3702367143 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f435c0cc020 con 0x55dc7a94b770 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436a62e640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 0x7f425003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 0x55dc7aad30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.836+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7aad3630 con 0x55dc7a94bb50 2024-09-12T00:20:58.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 0x55dc7aad30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436a62e640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 0x7f425003bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4360001e40 tx=0x7f43600013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 0x55dc7aad30f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 -- 172.21.15.66:0/3702367143 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7a94bb50 2024-09-12T00:20:58.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7aad3a80 con 0x55dc7a94bb50 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 -- 172.21.15.66:0/3702367143 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7a94bb50 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 0x55dc7aad7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7aad8350 con 0x55dc7aad5890 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436ae2f640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 0x55dc7aad7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436ae2f640 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 0x55dc7aad7c80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436ae2f640 1 -- 172.21.15.66:0/3702367143 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f435c0c53e0 con 0x55dc7aad5890 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7aad4730 con 0x55dc7a94bb50 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 -- 172.21.15.66:0/3702367143 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7a94bb50 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7aad4c10 con 0x55dc7aad5890 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436ae2f640 1 -- 172.21.15.66:0/3702367143 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f435c0c53e0 con 0x55dc7aad5890 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436d3299c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc7a8ec450 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36134/0 (socket says 172.21.15.66:36134) 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.840+0000 7f436b630640 1 -- 172.21.15.66:0/1415537720 learned_addr learned my addr 172.21.15.66:0/1415537720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436b630640 1 -- 172.21.15.66:0/1415537720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7aae7520 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436b630640 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55dc7aad39d0 tx=0x7f43640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 -- 172.21.15.66:0/1415537720 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4364013640 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 -- 172.21.15.66:0/1415537720 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43640137e0 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7aae7d80 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 -- 172.21.15.66:0/1415537720 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4364013ac0 con 0x55dc7aae6ac0 2024-09-12T00:20:58.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7aae82f0 con 0x55dc7aae6ac0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 -- 172.21.15.66:0/1415537720 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4364011040 con 0x55dc7aae6ac0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 0x7f424403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f4254e01640 1 -- 172.21.15.66:0/1415537720 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f436400e040 con 0x55dc7aae6ac0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 0x7f424403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436d3299c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc7aac51d0 con 0x55dc7aaf4370 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 0x7f424403bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f435c018f70 tx=0x7f435c0d0cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36140/0 (socket says 172.21.15.66:36140) 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.844+0000 7f436b630640 1 -- 172.21.15.66:0/3673454347 learned_addr learned my addr 172.21.15.66:0/3673454347 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 -- 172.21.15.66:0/3673454347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7aaf4d40 con 0x55dc7aaf4370 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 --2- 172.21.15.66:0/3673454347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4364050900 tx=0x7f436401fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0ed32250547374 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424e7fc640 1 -- 172.21.15.66:0/3673454347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43640293a0 con 0x55dc7aaf4370 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424e7fc640 1 -- 172.21.15.66:0/3673454347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436402a3f0 con 0x55dc7aaf4370 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424e7fc640 1 -- 172.21.15.66:0/3673454347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436404f2a0 con 0x55dc7aaf4370 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/3673454347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 msgr2=0x55dc7aaf4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3673454347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4364050900 tx=0x7f436401fd70 comp rx=0 tx=0).stop 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/3673454347 shutdown_connections 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3673454347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aaf4750 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/3673454347 >> 172.21.15.66:0/3673454347 conn(0x55dc7aaef790 msgr2=0x55dc7aaed9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/3673454347 shutdown_connections 2024-09-12T00:20:58.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/3673454347 wait complete. 2024-09-12T00:20:58.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 Processor -- start 2024-09-12T00:20:58.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- start start 2024-09-12T00:20:58.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aafa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55dc7aaf32c0 con 0x55dc7aaf4370 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aafa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aafa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36152/0 (socket says 172.21.15.66:36152) 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 learned_addr learned my addr 172.21.15.66:0/1836540652 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7aafadb0 con 0x55dc7aaf4370 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436b630640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aafa850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4364020560 tx=0x7f4364050860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424cff9640 1 -- 172.21.15.66:0/1836540652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436402e070 con 0x55dc7aaf4370 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7aafadb0 con 0x55dc7aaf4370 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424cff9640 1 -- 172.21.15.66:0/1836540652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364052320 con 0x55dc7aaf4370 2024-09-12T00:20:58.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f424cff9640 1 -- 172.21.15.66:0/1836540652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f436403ebf0 con 0x55dc7aaf4370 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.848+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7aafadb0 con 0x55dc7aaf4370 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f424cff9640 1 -- 172.21.15.66:0/1836540652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4364050a10 con 0x55dc7aaf4370 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f424cff9640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4234039a70 0x7f423403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f424cff9640 1 -- 172.21.15.66:0/1836540652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f4364048070 con 0x55dc7aaf4370 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4234039a70 0x7f423403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7ab059e0 0x55dc7ab07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab085f0 con 0x55dc7ab059e0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7ab059e0 0x55dc7ab07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4234039a70 0x7f423403bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f435c0c5790 tx=0x7f435c0da000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7ab059e0 0x55dc7ab07ea0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436000f620 con 0x55dc7ab059e0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 realm 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab04d30 con 0x55dc7ab059e0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436000f620 con 0x55dc7ab059e0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab090f0 con 0x55dc7ab059e0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436000f620 con 0x55dc7ab059e0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab099c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f436000f620 con 0x55dc7ab059e0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7ab0a3e0 0x55dc7ab0c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0cf10 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436b630640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7ab0a3e0 0x55dc7ab0c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.852+0000 7f436b630640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7ab0a3e0 0x55dc7ab0c7d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436d3299c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436d3299c0 20 searching for the correct realm 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436b630640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4364033460 0x7f436403d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x7f4364033460 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4364033460 0x7f436403d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4364033460 0x7f436403d9d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436ae2f640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f435c009040 0x7f435c0b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x7f435c009040 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f435c009040 0x7f435c0b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f435c009040 0x7f435c0b35c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436000f620 con 0x7f435c009040 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab059e0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436000f620 con 0x55dc7ab059e0 2024-09-12T00:20:58.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab059e0 2024-09-12T00:20:58.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab059e0 2024-09-12T00:20:58.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.856+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x7f435c009040 2024-09-12T00:20:58.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x7f4364033460 2024-09-12T00:20:58.872 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x55dc7ab059e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e7e0 con 0x7f4364033460 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab059e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f4364033460 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f435c009040 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.860+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab059e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab059e0 2024-09-12T00:20:58.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f435c009040 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f4364033460 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab059e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f435c009040 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.864+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f435c009040 2024-09-12T00:20:58.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f4364033460 2024-09-12T00:20:58.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f435c009040 2024-09-12T00:20:58.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f436002b040 con 0x7f435c009040 2024-09-12T00:20:58.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x55dc7ab059e0 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f435c105040 con 0x7f4364033460 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0d960 con 0x55dc7ab059e0 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0e200 con 0x55dc7ab059e0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0eb80 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 zone default found 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 4 Realm: () 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:58.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 zonegroup default 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.868+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab0ef80 con 0x7f435c009040 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab11260 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab11600 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 started sync module instance, tier type = 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab106f0 con 0x7f4364033460 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94405439589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab10350 con 0x7f4364033460 2024-09-12T00:20:58.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab12410 con 0x55dc7ab059e0 2024-09-12T00:20:58.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.872+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94405439589088] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94405439593008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab123d0 con 0x55dc7ab059e0 2024-09-12T00:20:58.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab12e20 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94405439596912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab12d90 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab13d60 con 0x7f4364033460 2024-09-12T00:20:58.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.876+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94405439593008] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94405439600688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab13d20 con 0x7f4364033460 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab14770 con 0x55dc7ab059e0 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94405439596912] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94405439600688] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94405439594064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab142c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.880+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab15010 con 0x7f435c009040 2024-09-12T00:20:58.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94405439594064] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94405439599120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab14d30 con 0x7f435c009040 2024-09-12T00:20:58.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab15580 con 0x7f435c009040 2024-09-12T00:20:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94405439606336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab158d0 con 0x7f435c009040 2024-09-12T00:20:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab163f0 con 0x7f435c009040 2024-09-12T00:20:58.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.884+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94405439599120] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94405439606336] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94405439610560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab15320 con 0x7f435c009040 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=0 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=1 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=2 2024-09-12T00:20:58.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=3 2024-09-12T00:20:58.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=4 2024-09-12T00:20:58.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=5 2024-09-12T00:20:58.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=6 2024-09-12T00:20:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94405439610560] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 20 add_watcher() i=7 2024-09-12T00:20:58.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:58.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab193e0 con 0x55dc7ab059e0 2024-09-12T00:20:58.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.888+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94405439604864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab16860 con 0x55dc7ab059e0 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94405439604864] v33'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f42217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 5 note: GC not initialized 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f419bfff640 20 reqs_thread_entry: start 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 Filter name: none 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f4199ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:58.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:58.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3c890 con 0x7f435c009040 2024-09-12T00:20:58.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T00:20:58.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:58.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:58.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.892+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab43610 con 0x7f435c009040 2024-09-12T00:20:58.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436d3299c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436d3299c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436d3299c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94405439795328 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3ecc0 con 0x55dc7ab059e0 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94405439594064 notify 141733920806 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f4360018040 con 0x55dc7ab059e0 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94405439795328 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f424e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94405439594064 notifier 4886 bl.length()=679 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f424e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f424e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f424e7fc640 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4230003eb0 con 0x55dc7ab059e0 2024-09-12T00:20:58.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.896+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94405439795328 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dc7a88b9c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.905 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:58.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f42217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:58.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94405439604864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94405439604864] v33'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94405439589088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x7f4364033460 2024-09-12T00:20:58.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94405439589088] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436d3299c0 20 remove_watcher() i=0 2024-09-12T00:20:58.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436d3299c0 2 removed watcher, disabling cache 2024-09-12T00:20:58.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.900+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94405439593008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94405439593008] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436d3299c0 20 remove_watcher() i=1 2024-09-12T00:20:58.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94405439596912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436b630640 1 -- 172.21.15.66:0/1836540652 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94405439596912] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436400a4d0 con 0x55dc7ab0a3e0 2024-09-12T00:20:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436d3299c0 20 remove_watcher() i=2 2024-09-12T00:20:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.904+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94405439600688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x7f4364033460 2024-09-12T00:20:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436ae2f640 1 -- 172.21.15.66:0/1836540652 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94405439600688] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f435c0c53e0 con 0x7f4364033460 2024-09-12T00:20:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436d3299c0 20 remove_watcher() i=3 2024-09-12T00:20:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94405439594064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x55dc7ab059e0 2024-09-12T00:20:58.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94405439594064] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x55dc7ab059e0 2024-09-12T00:20:58.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436d3299c0 20 remove_watcher() i=4 2024-09-12T00:20:58.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.908+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94405439599120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x7f435c009040 2024-09-12T00:20:58.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94405439599120] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436d3299c0 20 remove_watcher() i=5 2024-09-12T00:20:58.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94405439606336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x7f435c009040 2024-09-12T00:20:58.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94405439606336] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436d3299c0 20 remove_watcher() i=6 2024-09-12T00:20:58.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.912+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94405439610560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55dc7ab3a5c0 con 0x7f435c009040 2024-09-12T00:20:58.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94405439610560] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f436003b040 con 0x7f435c009040 2024-09-12T00:20:58.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 20 remove_watcher() i=7 2024-09-12T00:20:58.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f435c009040 msgr2=0x7f435c0b35c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f435c009040 0x7f435c0b35c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7ab059e0 msgr2=0x55dc7ab07ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7ab059e0 0x55dc7ab07ea0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4364033460 msgr2=0x7f436403d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f4364033460 0x7f436403d9d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7ab0a3e0 msgr2=0x55dc7ab0c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7ab0a3e0 0x55dc7ab0c7d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4234039a70 msgr2=0x7f423403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4234039a70 0x7f423403bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f435c0c5790 tx=0x7f435c0da000 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 msgr2=0x55dc7aafa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1836540652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aaf4370 0x55dc7aafa850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4364020560 tx=0x7f4364050860 comp rx=0 tx=0).stop 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436a62e640 1 -- 172.21.15.66:0/1836540652 reap_dead start 2024-09-12T00:20:58.924 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 shutdown_connections 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 >> 172.21.15.66:0/1836540652 conn(0x55dc7aaef790 msgr2=0x55dc7aaed9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 shutdown_connections 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1836540652 wait complete. 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 msgr2=0x7f424403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 0x7f424403bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f435c018f70 tx=0x7f435c0d0cb0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 msgr2=0x55dc7aae6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x55dc7aad39d0 tx=0x7f43640167b0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 shutdown_connections 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4244039ac0 0x7f424403bf80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/1415537720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7aae6ac0 0x55dc7aae6ee0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 >> 172.21.15.66:0/1415537720 conn(0x55dc7aadc470 msgr2=0x55dc7aadc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 shutdown_connections 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/1415537720 wait complete. 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 msgr2=0x55dc7aad30f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 0x55dc7aad30f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 msgr2=0x55dc7aad7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 0x55dc7aad7c80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 msgr2=0x7f425003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 0x7f425003bf30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4360001e40 tx=0x7f43600013a0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 msgr2=0x55dc7aacbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c10 tx=0x7f435c0180e0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 shutdown_connections 2024-09-12T00:20:58.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55dc7aad5890 0x55dc7aad7c80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55dc7a94bb50 0x55dc7aad30f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f4250039a70 0x7f425003bf30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 --2- 172.21.15.66:0/3702367143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55dc7a94b770 0x55dc7aacbf80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 >> 172.21.15.66:0/3702367143 conn(0x55dc7a9d1e90 msgr2=0x55dc7aabf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 shutdown_connections 2024-09-12T00:20:58.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:58.916+0000 7f436d3299c0 1 -- 172.21.15.66:0/3702367143 wait complete. 2024-09-12T00:20:58.935 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.935 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:58.935 ERROR:root:0 2024-09-12T00:20:58.935 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:58.948 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:58.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T00:20:58.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T00:20:58.949 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-12T00:20:59.015 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:59.015 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:59.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ffa1e59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55df9b70c8c0 0x55df9b70ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ffa1e59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df9b5ba9c0 con 0x55df9b708770 2024-09-12T00:20:59.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ffa1e59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55df9b60a6d0 con 0x55df9b70c8c0 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff74ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55df9b70c8c0 0x55df9b70ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff7ceb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x55df9b708770 0x55df9b708b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41940/0 (socket says 172.21.15.66:41940) 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff74ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55df9b70c8c0 0x55df9b70ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36164/0 (socket says 172.21.15.66:36164) 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/1263789052 learned_addr learned my addr 172.21.15.66:0/1263789052 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff74ea640 1 -- 172.21.15.66:0/1263789052 >> v1:172.21.15.31:6789/0 conn(0x55df9b708770 legacy=0x55df9b708b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.012+0000 7f2ff74ea640 1 -- 172.21.15.66:0/1263789052 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b5aeca0 con 0x55df9b70c8c0 2024-09-12T00:20:59.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/1263789052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b70c8c0 0x55df9b70ecb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00a480 tx=0x7f2fec01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbcba649ff2b420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ff6ce9640 1 -- 172.21.15.66:0/1263789052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fec0aa570 con 0x55df9b70c8c0 2024-09-12T00:20:59.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ff6ce9640 1 -- 172.21.15.66:0/1263789052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fec0af070 con 0x55df9b70c8c0 2024-09-12T00:20:59.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ff6ce9640 1 -- 172.21.15.66:0/1263789052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fec0aa860 con 0x55df9b70c8c0 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1263789052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b70c8c0 msgr2=0x55df9b70ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1263789052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b70c8c0 0x55df9b70ecb0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00a480 tx=0x7f2fec01b310 comp rx=0 tx=0).stop 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1263789052 shutdown_connections 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1263789052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b70c8c0 0x55df9b70ecb0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1263789052 >> 172.21.15.66:0/1263789052 conn(0x55df9b67c080 msgr2=0x55df9b67c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1263789052 shutdown_connections 2024-09-12T00:20:59.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.016+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1263789052 wait complete. 2024-09-12T00:20:59.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ffa1e59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ffa1e59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55df9b60e680 con 0x55df9b708770 2024-09-12T00:20:59.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ff7ceb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ff7ceb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36166/0 (socket says 172.21.15.66:36166) 2024-09-12T00:20:59.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/1049981577 learned_addr learned my addr 172.21.15.66:0/1049981577 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/1049981577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b589da0 con 0x55df9b708770 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/1049981577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8001e50 tx=0x7f2fe8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8a13cfd20fe953 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ee5e0b640 1 -- 172.21.15.66:0/1049981577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe8012020 con 0x55df9b708770 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ee5e0b640 1 -- 172.21.15.66:0/1049981577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe800e7c0 con 0x55df9b708770 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.032+0000 7f2ee5e0b640 1 -- 172.21.15.66:0/1049981577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe800eaa0 con 0x55df9b708770 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1049981577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 msgr2=0x55df9b7f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1049981577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8001e50 tx=0x7f2fe8001e80 comp rx=0 tx=0).stop 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1049981577 shutdown_connections 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1049981577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7f3a40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1049981577 >> 172.21.15.66:0/1049981577 conn(0x55df9b67c080 msgr2=0x55df9b7ef6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1049981577 shutdown_connections 2024-09-12T00:20:59.040 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1049981577 wait complete. 2024-09-12T00:20:59.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55df9b5b0a50 con 0x55df9b708770 2024-09-12T00:20:59.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ff7ceb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ff7ceb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36178/0 (socket says 172.21.15.66:36178) 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2645444030 learned_addr learned my addr 172.21.15.66:0/2645444030 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b7fb640 con 0x55df9b708770 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55df9b7f4a30 tx=0x7f2fe8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 -- 172.21.15.66:0/2645444030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe8012030 con 0x55df9b708770 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9b7fb8d0 con 0x55df9b708770 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 -- 172.21.15.66:0/2645444030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe801a680 con 0x55df9b708770 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 -- 172.21.15.66:0/2645444030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fe801a980 con 0x55df9b708770 2024-09-12T00:20:59.043 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9b7fc280 con 0x55df9b708770 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 -- 172.21.15.66:0/2645444030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2fe8015020 con 0x55df9b708770 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 0x7f2ee003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.036+0000 7f2edffff640 1 -- 172.21.15.66:0/2645444030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2fe8020070 con 0x55df9b708770 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 0x7f2ee003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 0x55df9b802250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b802790 con 0x55df9b70c8c0 2024-09-12T00:20:59.045 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 0x55df9b802250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 0x7f2ee003bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0ae000 tx=0x7f2fec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 0x55df9b802250 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2645444030 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ff000a4d0 con 0x55df9b70c8c0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b7fc5c0 con 0x55df9b70c8c0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2645444030 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ff000a4d0 con 0x55df9b70c8c0 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 0x55df9b806df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8074e0 con 0x55df9b804a00 2024-09-12T00:20:59.046 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 0x55df9b806df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 0x55df9b806df0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2645444030 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2fe8008030 con 0x55df9b804a00 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8038a0 con 0x55df9b70c8c0 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2645444030 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ff000a4d0 con 0x55df9b70c8c0 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b803d80 con 0x55df9b804a00 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2645444030 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2fe8008030 con 0x55df9b804a00 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.040+0000 7f2ffa1e59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55df9b61b450 con 0x55df9b815c10 2024-09-12T00:20:59.048 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36182/0 (socket says 172.21.15.66:36182) 2024-09-12T00:20:59.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff84ec640 1 -- 172.21.15.66:0/1223664712 learned_addr learned my addr 172.21.15.66:0/1223664712 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff84ec640 1 -- 172.21.15.66:0/1223664712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b816670 con 0x55df9b815c10 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55df9b7fc470 tx=0x7f2ff00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 -- 172.21.15.66:0/1223664712 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff0013450 con 0x55df9b815c10 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 -- 172.21.15.66:0/1223664712 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff00135f0 con 0x55df9b815c10 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9b816ed0 con 0x55df9b815c10 2024-09-12T00:20:59.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 -- 172.21.15.66:0/1223664712 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff00138d0 con 0x55df9b815c10 2024-09-12T00:20:59.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9b817440 con 0x55df9b815c10 2024-09-12T00:20:59.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 -- 172.21.15.66:0/1223664712 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ff0011040 con 0x55df9b815c10 2024-09-12T00:20:59.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 0x7f2ed003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2edd7fa640 1 -- 172.21.15.66:0/1223664712 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2ff000e040 con 0x55df9b815c10 2024-09-12T00:20:59.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 0x7f2ed003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 0x7f2ed003bf30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2fe804ed50 tx=0x7f2fe804ec20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.044+0000 7f2ffa1e59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55df9b7f4290 con 0x55df9b8235e0 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36194/0 (socket says 172.21.15.66:36194) 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 -- 172.21.15.66:0/1412601863 learned_addr learned my addr 172.21.15.66:0/1412601863 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 -- 172.21.15.66:0/1412601863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b823fd0 con 0x55df9b8235e0 2024-09-12T00:20:59.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/1412601863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00508b0 tx=0x7f2ff001fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e1db50c684e50c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed6ffd640 1 -- 172.21.15.66:0/1412601863 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff004d070 con 0x55df9b8235e0 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed6ffd640 1 -- 172.21.15.66:0/1412601863 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff0013ce0 con 0x55df9b8235e0 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed6ffd640 1 -- 172.21.15.66:0/1412601863 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff002a960 con 0x55df9b8235e0 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1412601863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 msgr2=0x55df9b8239e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1412601863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00508b0 tx=0x7f2ff001fe80 comp rx=0 tx=0).stop 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1412601863 shutdown_connections 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1412601863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b8239e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1412601863 >> 172.21.15.66:0/1412601863 conn(0x55df9b81ea00 msgr2=0x55df9b81cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1412601863 shutdown_connections 2024-09-12T00:20:59.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1412601863 wait complete. 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 Processor -- start 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- start start 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55df9b822530 con 0x55df9b8235e0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36200/0 (socket says 172.21.15.66:36200) 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 learned_addr learned my addr 172.21.15.66:0/2725942661 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b829fe0 con 0x55df9b8235e0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0029560 tx=0x7f2ff0050840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed57fa640 1 -- 172.21.15.66:0/2725942661 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff004d040 con 0x55df9b8235e0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9b82a270 con 0x55df9b8235e0 2024-09-12T00:20:59.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed57fa640 1 -- 172.21.15.66:0/2725942661 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff003ea60 con 0x55df9b8235e0 2024-09-12T00:20:59.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.048+0000 7f2ed57fa640 1 -- 172.21.15.66:0/2725942661 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ff003ed60 con 0x55df9b8235e0 2024-09-12T00:20:59.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9b82ac20 con 0x55df9b8235e0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ed57fa640 1 -- 172.21.15.66:0/2725942661 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2ff001f390 con 0x55df9b8235e0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ed57fa640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ec0039a70 0x7f2ec003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ed57fa640 1 -- 172.21.15.66:0/2725942661 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f2ff0048040 con 0x55df9b8235e0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ec0039a70 0x7f2ec003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b8351d0 0x55df9b837690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b837de0 con 0x55df9b8351d0 2024-09-12T00:20:59.062 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b8351d0 0x55df9b837690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ec0039a70 0x7f2ec003bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55df9b802ba0 tx=0x7f2fe8047000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b8351d0 0x55df9b837690 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 realm 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b838210 con 0x55df9b8351d0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b838ae0 con 0x55df9b8351d0 2024-09-12T00:20:59.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b838e80 con 0x55df9b8351d0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b839be0 0x55df9b83bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83c620 con 0x55df9b839be0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.052+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b839be0 0x55df9b83bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b839be0 0x55df9b83bfd0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ffa1e59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:59.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ffa1e59c0 20 searching for the correct realm 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff84ec640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2ff0013070 0x7f2ff00147f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2ff0013070 0x7f2ff00147f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2ff0013070 0x7f2ff00147f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff7ceb640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2fe8017050 0x7f2fe804d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2fe8017050 0x7f2fe804d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2fe8017050 0x7f2fe804d440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.056+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.060+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.072 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.064+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b839be0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2fe8017050 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x55df9b8351d0 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83def0 con 0x7f2ff0013070 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:59.080 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83d070 con 0x55df9b8351d0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83d8c0 con 0x55df9b8351d0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83e290 con 0x55df9b839be0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 zone default found 2024-09-12T00:20:59.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 4 Realm: () 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 zonegroup default 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.068+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83e6a0 con 0x7f2fe8017050 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b840980 con 0x55df9b839be0 2024-09-12T00:20:59.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b840d80 con 0x55df9b839be0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 started sync module instance, tier type = 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83fe10 con 0x7f2ff0013070 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418875187712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b83fa70 con 0x7f2ff0013070 2024-09-12T00:20:59.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b841cb0 con 0x55df9b8351d0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.072+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418875187712] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418875193344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8420d0 con 0x55df9b8351d0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b842960 con 0x55df9b839be0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418875193344] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418875195600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8424f0 con 0x55df9b839be0 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.076+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b841c20 con 0x7f2ff0013070 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418875200368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b841c20 con 0x7f2ff0013070 2024-09-12T00:20:59.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b844260 con 0x55df9b8351d0 2024-09-12T00:20:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418875195600] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418875200368] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418875201424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b843db0 con 0x55df9b8351d0 2024-09-12T00:20:59.087 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.080+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b844b00 con 0x7f2fe8017050 2024-09-12T00:20:59.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418875201424] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418875198800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8447f0 con 0x7f2fe8017050 2024-09-12T00:20:59.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b845040 con 0x7f2fe8017050 2024-09-12T00:20:59.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418875206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b845400 con 0x7f2fe8017050 2024-09-12T00:20:59.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b845f00 con 0x7f2fe8017050 2024-09-12T00:20:59.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.084+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418875198800] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418875210224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b845ec0 con 0x7f2fe8017050 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=0 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=1 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=2 2024-09-12T00:20:59.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=3 2024-09-12T00:20:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=4 2024-09-12T00:20:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=5 2024-09-12T00:20:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418875206096] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=6 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418875210224] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0a8070 con 0x7f2fe8017050 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 20 add_watcher() i=7 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b844e90 con 0x55df9b8351d0 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2fec0a8070 con 0x55df9b8351d0 2024-09-12T00:20:59.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.088+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418875207248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b8462f0 con 0x55df9b8351d0 2024-09-12T00:20:59.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418875207248] v33'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:59.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 5 note: GC not initialized 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2eacfe1640 20 reqs_thread_entry: start 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 Filter name: none 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2e267fc640 20 reqs_thread_entry: start 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86c400 con 0x7f2fe8017050 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f2fec0d5040 con 0x7f2fe8017050 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:59.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.092+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b873180 con 0x7f2fe8017050 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x7f2fe8017050 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ffa1e59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ffa1e59c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ffa1e59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94418875395056 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86e8b0 con 0x55df9b8351d0 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94418875201424 notify 141733920807 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55df9b5aeca0 con 0x55df9b8351d0 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ed6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94418875201424 notifier 4893 bl.length()=636 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ed6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ed6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ed6ffd640 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2ebc003eb0 con 0x55df9b8351d0 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94418875395056 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94418875395056 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2fec0d7b00 con 0x55df9b8351d0 2024-09-12T00:20:59.103 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:59.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.096+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418875207248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x55df9b8351d0 2024-09-12T00:20:59.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94418875207248] v33'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418875187712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x7f2ff0013070 2024-09-12T00:20:59.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94418875187712] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ffa1e59c0 20 remove_watcher() i=0 2024-09-12T00:20:59.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ffa1e59c0 2 removed watcher, disabling cache 2024-09-12T00:20:59.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.100+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418875193344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x55df9b8351d0 2024-09-12T00:20:59.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94418875193344] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ffa1e59c0 20 remove_watcher() i=1 2024-09-12T00:20:59.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418875195600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x55df9b839be0 2024-09-12T00:20:59.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ff84ec640 1 -- 172.21.15.66:0/2725942661 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94418875195600] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ff0039020 con 0x55df9b839be0 2024-09-12T00:20:59.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ffa1e59c0 20 remove_watcher() i=2 2024-09-12T00:20:59.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.104+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418875200368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x7f2ff0013070 2024-09-12T00:20:59.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ff7ceb640 1 -- 172.21.15.66:0/2725942661 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94418875200368] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fe8008030 con 0x7f2ff0013070 2024-09-12T00:20:59.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ffa1e59c0 20 remove_watcher() i=3 2024-09-12T00:20:59.112 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418875201424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x55df9b8351d0 2024-09-12T00:20:59.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94418875201424] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x55df9b8351d0 2024-09-12T00:20:59.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ffa1e59c0 20 remove_watcher() i=4 2024-09-12T00:20:59.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.108+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418875198800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x7f2fe8017050 2024-09-12T00:20:59.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94418875198800] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x7f2fe8017050 2024-09-12T00:20:59.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ffa1e59c0 20 remove_watcher() i=5 2024-09-12T00:20:59.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418875206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x7f2fe8017050 2024-09-12T00:20:59.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94418875206096] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x7f2fe8017050 2024-09-12T00:20:59.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ffa1e59c0 20 remove_watcher() i=6 2024-09-12T00:20:59.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.112+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418875210224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55df9b86a120 con 0x7f2fe8017050 2024-09-12T00:20:59.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94418875210224] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fec0d5040 con 0x7f2fe8017050 2024-09-12T00:20:59.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 20 remove_watcher() i=7 2024-09-12T00:20:59.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2fe8017050 msgr2=0x7f2fe804d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f2fe8017050 0x7f2fe804d440 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b8351d0 msgr2=0x55df9b837690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b8351d0 0x55df9b837690 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2ff0013070 msgr2=0x7f2ff00147f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f2ff0013070 0x7f2ff00147f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b839be0 msgr2=0x55df9b83bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b839be0 0x55df9b83bfd0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ec0039a70 msgr2=0x7f2ec003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ec0039a70 0x7f2ec003bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55df9b802ba0 tx=0x7f2fe8047000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 msgr2=0x55df9b829a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ff74ea640 1 -- 172.21.15.66:0/2725942661 reap_dead start 2024-09-12T00:20:59.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0029560 tx=0x7f2ff0050840 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 shutdown_connections 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2725942661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b8235e0 0x55df9b829a80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 >> 172.21.15.66:0/2725942661 conn(0x55df9b81ea00 msgr2=0x55df9b81cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 shutdown_connections 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2725942661 wait complete. 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 msgr2=0x7f2ed003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 0x7f2ed003bf30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2fe804ed50 tx=0x7f2fe804ec20 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 msgr2=0x55df9b816030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55df9b7fc470 tx=0x7f2ff00163e0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 shutdown_connections 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ed0039a70 0x7f2ed003bf30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/1223664712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b815c10 0x55df9b816030 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 >> 172.21.15.66:0/1223664712 conn(0x55df9b80b5c0 msgr2=0x55df9b80b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 shutdown_connections 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/1223664712 wait complete. 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 msgr2=0x55df9b802250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 0x55df9b802250 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 msgr2=0x55df9b806df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 0x55df9b806df0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 msgr2=0x7f2ee003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 0x7f2ee003bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0ae000 tx=0x7f2fec0a6000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 msgr2=0x55df9b7fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55df9b7f4a30 tx=0x7f2fe8000ee0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 shutdown_connections 2024-09-12T00:20:59.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55df9b804a00 0x55df9b806df0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55df9b70c8c0 0x55df9b802250 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f2ee0039a70 0x7f2ee003bf30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 --2- 172.21.15.66:0/2645444030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55df9b708770 0x55df9b7fb0e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 >> 172.21.15.66:0/2645444030 conn(0x55df9b67c080 msgr2=0x55df9b7ee170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 shutdown_connections 2024-09-12T00:20:59.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.116+0000 7f2ffa1e59c0 1 -- 172.21.15.66:0/2645444030 wait complete. 2024-09-12T00:20:59.133 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.134 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.134 ERROR:root:0 2024-09-12T00:20:59.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T00:20:59.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T00:20:59.134 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-12T00:20:59.216 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:59.216 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:59.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f075021a9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613daf8bb50 0x5613db01fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f075021a9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613daecb9c0 con 0x5613daf8b770 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f075021a9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x5613daf1b6d0 con 0x5613daf8bb50 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f074d51f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x5613daf8bb50 0x5613db01fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f074dd20640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x5613daf8b770 0x5613db01c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41944/0 (socket says 172.21.15.66:41944) 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f074dd20640 1 -- 172.21.15.66:0/2901066634 learned_addr learned my addr 172.21.15.66:0/2901066634 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f074d51f640 1 -- 172.21.15.66:0/2901066634 >> v1:172.21.15.31:6789/0 conn(0x5613daf8b770 legacy=0x5613db01c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.212+0000 7f074d51f640 1 -- 172.21.15.66:0/2901066634 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613daebfca0 con 0x5613daf8bb50 2024-09-12T00:20:59.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f074d51f640 1 --2- 172.21.15.66:0/2901066634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8bb50 0x5613db01fcd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f074400a480 tx=0x7f074401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c8420d59b267a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f074cd1e640 1 -- 172.21.15.66:0/2901066634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07440b0070 con 0x5613daf8bb50 2024-09-12T00:20:59.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f074cd1e640 1 -- 172.21.15.66:0/2901066634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07440ab540 con 0x5613daf8bb50 2024-09-12T00:20:59.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f074cd1e640 1 -- 172.21.15.66:0/2901066634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07440ab840 con 0x5613daf8bb50 2024-09-12T00:20:59.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 -- 172.21.15.66:0/2901066634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8bb50 msgr2=0x5613db01fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2901066634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8bb50 0x5613db01fcd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f074400a480 tx=0x7f074401b280 comp rx=0 tx=0).stop 2024-09-12T00:20:59.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 -- 172.21.15.66:0/2901066634 shutdown_connections 2024-09-12T00:20:59.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2901066634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8bb50 0x5613db01fcd0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 -- 172.21.15.66:0/2901066634 >> 172.21.15.66:0/2901066634 conn(0x5613db011e90 msgr2=0x5613db0142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 -- 172.21.15.66:0/2901066634 shutdown_connections 2024-09-12T00:20:59.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.216+0000 7f075021a9c0 1 -- 172.21.15.66:0/2901066634 wait complete. 2024-09-12T00:20:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f075021a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f075021a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613daf1f680 con 0x5613daf8b770 2024-09-12T00:20:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f074dd20640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f074dd20640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36228/0 (socket says 172.21.15.66:36228) 2024-09-12T00:20:59.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f074dd20640 1 -- 172.21.15.66:0/2441210699 learned_addr learned my addr 172.21.15.66:0/2441210699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f074dd20640 1 -- 172.21.15.66:0/2441210699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613dae9ada0 con 0x5613daf8b770 2024-09-12T00:20:59.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f074dd20640 1 --2- 172.21.15.66:0/2441210699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0740001810 tx=0x7f0740001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ebcbb61f68b566 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f063be07640 1 -- 172.21.15.66:0/2441210699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0740004530 con 0x5613daf8b770 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f063be07640 1 -- 172.21.15.66:0/2441210699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400046d0 con 0x5613daf8b770 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.232+0000 7f063be07640 1 -- 172.21.15.66:0/2441210699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07400049f0 con 0x5613daf8b770 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/2441210699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 msgr2=0x5613db104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2441210699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0740001810 tx=0x7f0740001cd0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/2441210699 shutdown_connections 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2441210699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db104c10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/2441210699 >> 172.21.15.66:0/2441210699 conn(0x5613db011e90 msgr2=0x5613db100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/2441210699 shutdown_connections 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/2441210699 wait complete. 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613daec1a50 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f074dd20640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f074dd20640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36230/0 (socket says 172.21.15.66:36230) 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f074dd20640 1 -- 172.21.15.66:0/682663391 learned_addr learned my addr 172.21.15.66:0/682663391 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f074dd20640 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db10c810 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f074dd20640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0740000f90 tx=0x7f0740001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f063a604640 1 -- 172.21.15.66:0/682663391 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0740013820 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613db10caa0 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f063a604640 1 -- 172.21.15.66:0/682663391 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400139c0 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f063a604640 1 -- 172.21.15.66:0/682663391 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0740013ce0 con 0x5613daf8b770 2024-09-12T00:20:59.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613db10d450 con 0x5613daf8b770 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.236+0000 7f063a604640 1 -- 172.21.15.66:0/682663391 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0740010070 con 0x5613daf8b770 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f063a604640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f063a604640 1 -- 172.21.15.66:0/682663391 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0740018070 con 0x5613daf8b770 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074d51f640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 0x5613db113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db113d40 con 0x5613db111410 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074e521640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 0x5613db113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074d51f640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 0x7f063403bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07440ad000 tx=0x7f07440a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074e521640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 0x5613db113800 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074e521640 1 -- 172.21.15.66:0/682663391 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07480083f0 con 0x5613db111410 2024-09-12T00:20:59.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db114170 con 0x5613db111410 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074e521640 1 -- 172.21.15.66:0/682663391 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07480083f0 con 0x5613db111410 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 0x5613db118370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db118a40 con 0x5613db115f80 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074dd20640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 0x5613db118370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074dd20640 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 0x5613db118370 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074dd20640 1 -- 172.21.15.66:0/682663391 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f074001b030 con 0x5613db115f80 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db114e20 con 0x5613db111410 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074e521640 1 -- 172.21.15.66:0/682663391 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07480083f0 con 0x5613db111410 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db115300 con 0x5613db115f80 2024-09-12T00:20:59.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f074dd20640 1 -- 172.21.15.66:0/682663391 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f074001b030 con 0x5613db115f80 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.240+0000 7f075021a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613daf2c450 con 0x5613db127170 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36246/0 (socket says 172.21.15.66:36246) 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 -- 172.21.15.66:0/516454747 learned_addr learned my addr 172.21.15.66:0/516454747 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 -- 172.21.15.66:0/516454747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db127bd0 con 0x5613db127170 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x5613db10d170 tx=0x7f074800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 -- 172.21.15.66:0/516454747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074801c020 con 0x5613db127170 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 -- 172.21.15.66:0/516454747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748007d00 con 0x5613db127170 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613db128430 con 0x5613db127170 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 -- 172.21.15.66:0/516454747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0748018440 con 0x5613db127170 2024-09-12T00:20:59.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613db1289a0 con 0x5613db127170 2024-09-12T00:20:59.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 -- 172.21.15.66:0/516454747 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f074801f020 con 0x5613db127170 2024-09-12T00:20:59.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 0x7f062803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f06337fe640 1 -- 172.21.15.66:0/516454747 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0748051e50 con 0x5613db127170 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074dd20640 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 0x7f062803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074dd20640 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 0x7f062803bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f074002afd0 tx=0x7f074004e9d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f075021a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613db105460 con 0x5613db133af0 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.244+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36248/0 (socket says 172.21.15.66:36248) 2024-09-12T00:20:59.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 -- 172.21.15.66:0/2088336450 learned_addr learned my addr 172.21.15.66:0/2088336450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 -- 172.21.15.66:0/2088336450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db1344a0 con 0x5613db133af0 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 --2- 172.21.15.66:0/2088336450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0748021fd0 tx=0x7f07480168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a38f6f87addea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f06317fa640 1 -- 172.21.15.66:0/2088336450 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0748021400 con 0x5613db133af0 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f06317fa640 1 -- 172.21.15.66:0/2088336450 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748029350 con 0x5613db133af0 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f06317fa640 1 -- 172.21.15.66:0/2088336450 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07480215a0 con 0x5613db133af0 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/2088336450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 msgr2=0x5613db133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2088336450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0748021fd0 tx=0x7f07480168b0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/2088336450 shutdown_connections 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 --2- 172.21.15.66:0/2088336450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db133ed0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/2088336450 >> 172.21.15.66:0/2088336450 conn(0x5613db12ff20 msgr2=0x5613db12e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/2088336450 shutdown_connections 2024-09-12T00:20:59.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/2088336450 wait complete. 2024-09-12T00:20:59.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 Processor -- start 2024-09-12T00:20:59.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- start start 2024-09-12T00:20:59.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5613db134b00 con 0x5613db133af0 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36256/0 (socket says 172.21.15.66:36256) 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 learned_addr learned my addr 172.21.15.66:0/4004293891 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613db13b4d0 con 0x5613db133af0 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f074e521640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0748021fd0 tx=0x7f0748050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f061f7fe640 1 -- 172.21.15.66:0/4004293891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0748028bd0 con 0x5613db133af0 2024-09-12T00:20:59.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613db13b760 con 0x5613db133af0 2024-09-12T00:20:59.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f061f7fe640 1 -- 172.21.15.66:0/4004293891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0748028d70 con 0x5613db133af0 2024-09-12T00:20:59.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f061f7fe640 1 -- 172.21.15.66:0/4004293891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07480203b0 con 0x5613db133af0 2024-09-12T00:20:59.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.248+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613db13c110 con 0x5613db133af0 2024-09-12T00:20:59.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f061f7fe640 1 -- 172.21.15.66:0/4004293891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0748016040 con 0x5613db133af0 2024-09-12T00:20:59.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f061f7fe640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0618039a70 0x7f061803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f061f7fe640 1 -- 172.21.15.66:0/4004293891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0748032070 con 0x5613db133af0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074dd20640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0618039a70 0x7f061803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db146560 0x5613db148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db149170 con 0x5613db146560 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db146560 0x5613db148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074dd20640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0618039a70 0x7f061803bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5613db10d740 tx=0x7f0740021000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db146560 0x5613db148a20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 realm 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db149540 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db149e10 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14a1b0 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db14af10 0x5613db14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14d8c0 con 0x5613db14af10 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074e521640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db14af10 0x5613db14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.252+0000 7f074e521640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db14af10 0x5613db14d300 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f075021a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f075021a9c0 20 searching for the correct realm 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db14af10 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074e521640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0748021020 0x7f0748047440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f0748021020 2024-09-12T00:20:59.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074dd20640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0748021020 0x7f0748047440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074dd20640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0748021020 0x7f0748047440 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074dd20640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f074004d070 0x7f07400123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f074004d070 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f074004d070 0x7f07400123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.267 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f074004d070 0x7f07400123c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.256+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f074004d070 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f0748021020 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db14af10 2024-09-12T00:20:59.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db146560 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f0748021020 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db146560 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x7f0748021020 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db14af10 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f190 con 0x5613db14af10 2024-09-12T00:20:59.269 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f074004d070 2024-09-12T00:20:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db14af10 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.260+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db14af10 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db146560 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db146560 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.272 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f074004d070 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db14af10 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f0748021020 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db146560 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f074004d070 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db14af10 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.264+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f074004d070 2024-09-12T00:20:59.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f0748021020 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db14af10 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f074004d070 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x5613db146560 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0748065040 con 0x7f0748021020 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14e210 con 0x5613db146560 2024-09-12T00:20:59.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14eab0 con 0x5613db146560 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f5c0 con 0x5613db14af10 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 zone default found 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 4 Realm: () 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:59.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 zonegroup default 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.268+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db14f960 con 0x7f074004d070 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db151740 con 0x5613db14af10 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db151bd0 con 0x5613db14af10 2024-09-12T00:20:59.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 started sync module instance, tier type = 2024-09-12T00:20:59.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:59.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db150be0 con 0x7f0748021020 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643279955760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db151bd0 con 0x7f0748021020 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.272+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db152420 con 0x5613db146560 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643279955760] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643279961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1524a0 con 0x5613db146560 2024-09-12T00:20:59.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db152d30 con 0x5613db14af10 2024-09-12T00:20:59.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643279961040] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643279962096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1528c0 con 0x5613db14af10 2024-09-12T00:20:59.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.276+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db153740 con 0x7f0748021020 2024-09-12T00:20:59.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643279966864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1536b0 con 0x7f0748021020 2024-09-12T00:20:59.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db154660 con 0x5613db146560 2024-09-12T00:20:59.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643279962096] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643279966864] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643279969072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db152410 con 0x5613db146560 2024-09-12T00:20:59.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.280+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db154ad0 con 0x7f074004d070 2024-09-12T00:20:59.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643279969072] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643279970640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db154ad0 con 0x7f074004d070 2024-09-12T00:20:59.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1554e0 con 0x7f074004d070 2024-09-12T00:20:59.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643279974448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db155900 con 0x7f074004d070 2024-09-12T00:20:59.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.284+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1563b0 con 0x7f074004d070 2024-09-12T00:20:59.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643279970640] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643279974448] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643279971872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db155450 con 0x7f074004d070 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=0 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=1 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=2 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=3 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=4 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=5 2024-09-12T00:20:59.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.288+0000 7f075021a9c0 20 add_watcher() i=6 2024-09-12T00:20:59.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643279971872] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440b3040 con 0x7f074004d070 2024-09-12T00:20:59.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 add_watcher() i=7 2024-09-12T00:20:59.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:59.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db1594b0 con 0x5613db146560 2024-09-12T00:20:59.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07440b3040 con 0x5613db146560 2024-09-12T00:20:59.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643279978128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db156930 con 0x5613db146560 2024-09-12T00:20:59.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643279978128] v33'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f05ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 5 note: GC not initialized 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f05fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 Filter name: none 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f056ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.292+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db17c880 con 0x7f074004d070 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f07440d7040 con 0x7f074004d070 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:59.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db1832b0 con 0x7f074004d070 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x7f074004d070 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.296+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94643280162080 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5613db17e9c0 con 0x5613db146560 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94643279969072 notify 141733920808 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5613daebfca0 con 0x5613db146560 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f06317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94643279969072 notifier 4900 bl.length()=666 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f06317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f06317fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94643280162080 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f06317fa640 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0610003eb0 con 0x5613db146560 2024-09-12T00:20:59.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94643280162080 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f07440d9910 con 0x5613db146560 2024-09-12T00:20:59.305 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:59.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f05ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643279978128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db17a580 con 0x5613db146560 2024-09-12T00:20:59.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94643279978128] v33'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.300+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643279955760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db17a580 con 0x7f0748021020 2024-09-12T00:20:59.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94643279955760] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f075021a9c0 20 remove_watcher() i=0 2024-09-12T00:20:59.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f075021a9c0 2 removed watcher, disabling cache 2024-09-12T00:20:59.309 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643279961040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db17a580 con 0x5613db146560 2024-09-12T00:20:59.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94643279961040] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f075021a9c0 20 remove_watcher() i=1 2024-09-12T00:20:59.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.304+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643279962096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db151bd0 con 0x5613db14af10 2024-09-12T00:20:59.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f074e521640 1 -- 172.21.15.66:0/4004293891 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94643279962096] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0748055020 con 0x5613db14af10 2024-09-12T00:20:59.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f075021a9c0 20 remove_watcher() i=2 2024-09-12T00:20:59.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643279966864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db17a580 con 0x7f0748021020 2024-09-12T00:20:59.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f074dd20640 1 -- 172.21.15.66:0/4004293891 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94643279966864] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074001b030 con 0x7f0748021020 2024-09-12T00:20:59.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f075021a9c0 20 remove_watcher() i=3 2024-09-12T00:20:59.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.308+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643279969072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db153290 con 0x5613db146560 2024-09-12T00:20:59.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94643279969072] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x5613db146560 2024-09-12T00:20:59.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f075021a9c0 20 remove_watcher() i=4 2024-09-12T00:20:59.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643279970640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db17a580 con 0x7f074004d070 2024-09-12T00:20:59.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94643279970640] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x7f074004d070 2024-09-12T00:20:59.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f075021a9c0 20 remove_watcher() i=5 2024-09-12T00:20:59.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.312+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643279974448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db153b30 con 0x7f074004d070 2024-09-12T00:20:59.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94643279974448] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x7f074004d070 2024-09-12T00:20:59.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f075021a9c0 20 remove_watcher() i=6 2024-09-12T00:20:59.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643279971872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5613db153290 con 0x7f074004d070 2024-09-12T00:20:59.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94643279971872] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07440d7040 con 0x7f074004d070 2024-09-12T00:20:59.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f075021a9c0 20 remove_watcher() i=7 2024-09-12T00:20:59.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.316+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f074004d070 msgr2=0x7f07400123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f074004d070 0x7f07400123c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db146560 msgr2=0x5613db148a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db146560 0x5613db148a20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0748021020 msgr2=0x7f0748047440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0748021020 0x7f0748047440 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db14af10 msgr2=0x5613db14d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db14af10 0x5613db14d300 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0618039a70 msgr2=0x7f061803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0618039a70 0x7f061803bf30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5613db10d740 tx=0x7f0740021000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 msgr2=0x5613db13af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f074d51f640 1 -- 172.21.15.66:0/4004293891 reap_dead start 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0748021fd0 tx=0x7f0748050040 comp rx=0 tx=0).stop 2024-09-12T00:20:59.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 shutdown_connections 2024-09-12T00:20:59.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/4004293891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db133af0 0x5613db13af70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 >> 172.21.15.66:0/4004293891 conn(0x5613db12ff20 msgr2=0x5613db12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 shutdown_connections 2024-09-12T00:20:59.326 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/4004293891 wait complete. 2024-09-12T00:20:59.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 msgr2=0x7f062803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 0x7f062803bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f074002afd0 tx=0x7f074004e9d0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 msgr2=0x5613db127590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x5613db10d170 tx=0x7f074800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 shutdown_connections 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0628039a70 0x7f062803bf30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/516454747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613db127170 0x5613db127590 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 >> 172.21.15.66:0/516454747 conn(0x5613db11cb40 msgr2=0x5613db11cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 shutdown_connections 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/516454747 wait complete. 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 msgr2=0x5613db113800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 0x5613db113800 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 msgr2=0x5613db118370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 0x5613db118370 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 msgr2=0x7f063403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 0x7f063403bf30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07440ad000 tx=0x7f07440a5040 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 msgr2=0x5613db10c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0740000f90 tx=0x7f0740001260 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 shutdown_connections 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x5613db115f80 0x5613db118370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x5613db111410 0x5613db113800 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 --2- 172.21.15.66:0/682663391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5613daf8b770 0x5613db10c2b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 >> 172.21.15.66:0/682663391 conn(0x5613db011e90 msgr2=0x5613db0ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 shutdown_connections 2024-09-12T00:20:59.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.320+0000 7f075021a9c0 1 -- 172.21.15.66:0/682663391 wait complete. 2024-09-12T00:20:59.338 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.338 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.338 ERROR:root:0 2024-09-12T00:20:59.338 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:59.351 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000002f4819368fbee10c-0066e233eb-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:20:59.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T00:20:59.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T00:20:59.352 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-12T00:20:59.414 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:59.415 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.408+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff258d2c9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555942d32770 0x555942dc35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff258d2c9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555942c729c0 con 0x555942d32b50 2024-09-12T00:20:59.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff258d2c9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555942cc26d0 con 0x555942d32770 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256832640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555942d32770 0x555942dc35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256031640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x555942d32b50 0x555942dc5af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41952/0 (socket says 172.21.15.66:41952) 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256832640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555942d32770 0x555942dc35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36258/0 (socket says 172.21.15.66:36258) 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256031640 1 -- 172.21.15.66:0/3458052423 learned_addr learned my addr 172.21.15.66:0/3458052423 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256832640 1 -- 172.21.15.66:0/3458052423 >> v1:172.21.15.31:6789/0 conn(0x555942d32b50 legacy=0x555942dc5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256832640 1 -- 172.21.15.66:0/3458052423 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942c66ca0 con 0x555942d32770 2024-09-12T00:20:59.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff256832640 1 --2- 172.21.15.66:0/3458052423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942dc35a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff25000a420 tx=0x7ff25001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70d223e62554ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff255830640 1 -- 172.21.15.66:0/3458052423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500af070 con 0x555942d32770 2024-09-12T00:20:59.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff255830640 1 -- 172.21.15.66:0/3458052423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500aa530 con 0x555942d32770 2024-09-12T00:20:59.420 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.412+0000 7ff255830640 1 -- 172.21.15.66:0/3458052423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500aa850 con 0x555942d32770 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3458052423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 msgr2=0x555942dc35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/3458052423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942dc35a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff25000a420 tx=0x7ff25001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3458052423 shutdown_connections 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/3458052423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942dc35a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3458052423 >> 172.21.15.66:0/3458052423 conn(0x555942db8e90 msgr2=0x555942dbb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3458052423 shutdown_connections 2024-09-12T00:20:59.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.416+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3458052423 wait complete. 2024-09-12T00:20:59.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555942cc6680 con 0x555942d32770 2024-09-12T00:20:59.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36262/0 (socket says 172.21.15.66:36262) 2024-09-12T00:20:59.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 -- 172.21.15.66:0/2584255530 learned_addr learned my addr 172.21.15.66:0/2584255530 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 -- 172.21.15.66:0/2584255530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942c41da0 con 0x555942d32770 2024-09-12T00:20:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 --2- 172.21.15.66:0/2584255530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ad040 tx=0x7ff2500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101ba36a4c9d0e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff144e09640 1 -- 172.21.15.66:0/2584255530 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500af050 con 0x555942d32770 2024-09-12T00:20:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff144e09640 1 -- 172.21.15.66:0/2584255530 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500b0040 con 0x555942d32770 2024-09-12T00:20:59.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff144e09640 1 -- 172.21.15.66:0/2584255530 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500aaad0 con 0x555942d32770 2024-09-12T00:20:59.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/2584255530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 msgr2=0x555942eaba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/2584255530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ad040 tx=0x7ff2500033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/2584255530 shutdown_connections 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/2584255530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eaba40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/2584255530 >> 172.21.15.66:0/2584255530 conn(0x555942db8e90 msgr2=0x555942ea76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/2584255530 shutdown_connections 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/2584255530 wait complete. 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff258d2c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555942c68a50 con 0x555942d32770 2024-09-12T00:20:59.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36264/0 (socket says 172.21.15.66:36264) 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.432+0000 7ff256832640 1 -- 172.21.15.66:0/146646965 learned_addr learned my addr 172.21.15.66:0/146646965 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff256832640 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942eb34e0 con 0x555942d32770 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff256832640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff2500aa500 tx=0x7ff250017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 -- 172.21.15.66:0/146646965 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500b6c40 con 0x555942d32770 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 -- 172.21.15.66:0/146646965 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500b6de0 con 0x555942d32770 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555942eb3770 con 0x555942d32770 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 -- 172.21.15.66:0/146646965 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500bf590 con 0x555942d32770 2024-09-12T00:20:59.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555942eb4120 con 0x555942d32770 2024-09-12T00:20:59.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 -- 172.21.15.66:0/146646965 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff2500bf800 con 0x555942d32770 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 0x7ff13c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff143606640 1 -- 172.21.15.66:0/146646965 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff2500bb070 con 0x555942d32770 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff256031640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 0x7ff13c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 0x555942eba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942eba630 con 0x555942d32b50 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff257033640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 0x555942eba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff256031640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 0x7ff13c03bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff240001d80 tx=0x7ff2400012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff257033640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 0x555942eba0f0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff257033640 1 -- 172.21.15.66:0/146646965 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2480083f0 con 0x555942d32b50 2024-09-12T00:20:59.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.436+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ebaa70 con 0x555942d32b50 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 -- 172.21.15.66:0/146646965 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2480083f0 con 0x555942d32b50 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 0x555942ebec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ebf360 con 0x555942ebc880 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff256832640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 0x555942ebec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff256832640 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 0x555942ebec70 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff256832640 1 -- 172.21.15.66:0/146646965 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2500cf070 con 0x555942ebc880 2024-09-12T00:20:59.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ebb720 con 0x555942d32b50 2024-09-12T00:20:59.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 -- 172.21.15.66:0/146646965 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2480083f0 con 0x555942d32b50 2024-09-12T00:20:59.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ebbc00 con 0x555942ebc880 2024-09-12T00:20:59.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff256832640 1 -- 172.21.15.66:0/146646965 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2500cf070 con 0x555942ebc880 2024-09-12T00:20:59.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff258d2c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555942cd3450 con 0x555942ecdab0 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36270/0 (socket says 172.21.15.66:36270) 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 -- 172.21.15.66:0/377031622 learned_addr learned my addr 172.21.15.66:0/377031622 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 -- 172.21.15.66:0/377031622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942ece510 con 0x555942ecdab0 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff257033640 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x555942eb4310 tx=0x7ff24800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff140e01640 1 -- 172.21.15.66:0/377031622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff24801c020 con 0x555942ecdab0 2024-09-12T00:20:59.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff140e01640 1 -- 172.21.15.66:0/377031622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248007d20 con 0x555942ecdab0 2024-09-12T00:20:59.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.440+0000 7ff140e01640 1 -- 172.21.15.66:0/377031622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff248018440 con 0x555942ecdab0 2024-09-12T00:20:59.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555942eced70 con 0x555942ecdab0 2024-09-12T00:20:59.450 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555942ecf2e0 con 0x555942ecdab0 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff140e01640 1 -- 172.21.15.66:0/377031622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff24801f020 con 0x555942ecdab0 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff140e01640 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 0x7ff13003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff140e01640 1 -- 172.21.15.66:0/377031622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff248051d20 con 0x555942ecdab0 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff256832640 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 0x7ff13003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff256832640 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 0x7ff13003bf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x555942eb4440 tx=0x7ff2500beed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff258d2c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555942eac1d0 con 0x555942edb440 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36276/0 (socket says 172.21.15.66:36276) 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff257033640 1 -- 172.21.15.66:0/3046373231 learned_addr learned my addr 172.21.15.66:0/3046373231 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff257033640 1 -- 172.21.15.66:0/3046373231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942edbe30 con 0x555942edb440 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff257033640 1 --2- 172.21.15.66:0/3046373231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff248050070 tx=0x7ff248043130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14003aef6639ede6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff13a7fc640 1 -- 172.21.15.66:0/3046373231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff248021400 con 0x555942edb440 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff13a7fc640 1 -- 172.21.15.66:0/3046373231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248051040 con 0x555942edb440 2024-09-12T00:20:59.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.444+0000 7ff13a7fc640 1 -- 172.21.15.66:0/3046373231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff248029350 con 0x555942edb440 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3046373231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 msgr2=0x555942edb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/3046373231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff248050070 tx=0x7ff248043130 comp rx=0 tx=0).stop 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3046373231 shutdown_connections 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/3046373231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942edb840 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3046373231 >> 172.21.15.66:0/3046373231 conn(0x555942ed6860 msgr2=0x555942ed4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3046373231 shutdown_connections 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/3046373231 wait complete. 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 Processor -- start 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- start start 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555942eda390 con 0x555942edb440 2024-09-12T00:20:59.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff257033640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36288/0 (socket says 172.21.15.66:36288) 2024-09-12T00:20:59.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 learned_addr learned my addr 172.21.15.66:0/434752602 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555942ee1eb0 con 0x555942edb440 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff257033640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff248016a50 tx=0x7ff24804ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff138ff9640 1 -- 172.21.15.66:0/434752602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff248043030 con 0x555942edb440 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555942ee2140 con 0x555942edb440 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff138ff9640 1 -- 172.21.15.66:0/434752602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248051050 con 0x555942edb440 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff138ff9640 1 -- 172.21.15.66:0/434752602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff248020a50 con 0x555942edb440 2024-09-12T00:20:59.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555942ee2af0 con 0x555942edb440 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.448+0000 7ff138ff9640 1 -- 172.21.15.66:0/434752602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff248016040 con 0x555942edb440 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff138ff9640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff120039a70 0x7ff12003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff138ff9640 1 -- 172.21.15.66:0/434752602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7ff248031070 con 0x555942edb440 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256832640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff120039a70 0x7ff12003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942eecef0 0x555942eef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942eefb00 con 0x555942eecef0 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942eecef0 0x555942eef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256832640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff120039a70 0x7ff12003bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff2500bd4f0 tx=0x7ff2500db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942eecef0 0x555942eef3b0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff24000e5a0 con 0x555942eecef0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 realm 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942eec240 con 0x555942eecef0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff24000e5a0 con 0x555942eecef0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef0600 con 0x555942eecef0 2024-09-12T00:20:59.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff24000e5a0 con 0x555942eecef0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef0ed0 con 0x555942eecef0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff24000e5a0 con 0x555942eecef0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ef18f0 0x555942ef3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef43d0 con 0x555942ef18f0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ef18f0 0x555942ef3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ef18f0 0x555942ef3ce0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 20 searching for the correct realm 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff248021020 0x7ff248048420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.452+0000 7ff256832640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff248021020 0x7ff248048420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff248021020 0x7ff248048420 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff2500f8040 0x7ff2500e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff2500f8040 0x7ff2500e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff2500f8040 0x7ff2500e8240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24000e5a0 con 0x7ff2500f8040 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24000e5a0 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.456+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.460+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x555942eecef0 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.464+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942ef18f0 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff2500f8040 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff240029040 con 0x7ff2500f8040 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x555942eecef0 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555942ef5ca0 con 0x7ff248021020 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:59.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef4d50 con 0x555942eecef0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef55f0 con 0x555942eecef0 2024-09-12T00:20:59.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef60d0 con 0x555942ef18f0 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 zone default found 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 4 Realm: () 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:59.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 zonegroup default 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef6470 con 0x7ff2500f8040 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.468+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef8310 con 0x555942ef18f0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942ef86b0 con 0x555942ef18f0 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 20 started sync module instance, tier type = 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef7750 con 0x7ff248021020 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93841863439008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef8ae0 con 0x7ff248021020 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef9330 con 0x555942eecef0 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.472+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93841863439008] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93841863446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef9750 con 0x555942eecef0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef9fa0 con 0x555942ef18f0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93841863448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efa310 con 0x555942ef18f0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efae30 con 0x7ff248021020 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.476+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93841863446144] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93841863452928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efb220 con 0x7ff248021020 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efbbe0 con 0x555942eecef0 2024-09-12T00:20:59.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93841863448672] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93841863452928] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93841863447200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efb730 con 0x555942eecef0 2024-09-12T00:20:59.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.480+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efc480 con 0x7ff2500f8040 2024-09-12T00:20:59.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93841863447200] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93841863449952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efb730 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efc970 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(56 notify.6 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93841863449952] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93841863459904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efc930 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.484+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efd330 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93841863459904] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93841863458208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efd2f0 con 0x7ff2500f8040 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=0 2024-09-12T00:20:59.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=1 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=2 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=3 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=4 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=5 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.488+0000 7ff258d2c9c0 20 add_watcher() i=6 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93841863458208] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 add_watcher() i=7 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942f00750 con 0x555942eecef0 2024-09-12T00:20:59.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93841863462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942efdc70 con 0x555942eecef0 2024-09-12T00:20:59.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93841863462928] v33'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff10d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 5 note: GC not initialized 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff087fff640 20 reqs_thread_entry: start 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 Filter name: none 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff085ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.492+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942f23dc0 con 0x7ff2500f8040 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:59.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f2ab00 con 0x7ff2500f8040 2024-09-12T00:20:59.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93841863648624 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555942f261d0 con 0x555942eecef0 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 93841863447200 notify 141733920809 ret 0) ==== 678+0+0 (crc 0 0 0) 0x555942c729c0 con 0x555942eecef0 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff13a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 93841863447200 notifier 4907 bl.length()=636 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff13a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff13a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 93841863648624 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff13a7fc640 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff11c003eb0 con 0x555942eecef0 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.496+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 93841863648624 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff24003d7f0 con 0x555942eecef0 2024-09-12T00:20:59.505 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:59.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff10d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93841863462928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x555942eecef0 2024-09-12T00:20:59.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93841863462928] v33'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93841863439008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x7ff248021020 2024-09-12T00:20:59.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93841863439008] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff258d2c9c0 20 remove_watcher() i=0 2024-09-12T00:20:59.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff258d2c9c0 2 removed watcher, disabling cache 2024-09-12T00:20:59.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.500+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93841863446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x555942eecef0 2024-09-12T00:20:59.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93841863446144] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff258d2c9c0 20 remove_watcher() i=1 2024-09-12T00:20:59.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93841863448672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x555942ef18f0 2024-09-12T00:20:59.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff257033640 1 -- 172.21.15.66:0/434752602 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93841863448672] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff24805b040 con 0x555942ef18f0 2024-09-12T00:20:59.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff258d2c9c0 20 remove_watcher() i=2 2024-09-12T00:20:59.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.504+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93841863452928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x7ff248021020 2024-09-12T00:20:59.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff256832640 1 -- 172.21.15.66:0/434752602 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93841863452928] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2500f5040 con 0x7ff248021020 2024-09-12T00:20:59.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff258d2c9c0 20 remove_watcher() i=3 2024-09-12T00:20:59.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93841863447200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x555942eecef0 2024-09-12T00:20:59.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93841863447200] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x555942eecef0 2024-09-12T00:20:59.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff258d2c9c0 20 remove_watcher() i=4 2024-09-12T00:20:59.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.508+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93841863449952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x7ff2500f8040 2024-09-12T00:20:59.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.512+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93841863449952] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.512+0000 7ff258d2c9c0 20 remove_watcher() i=5 2024-09-12T00:20:59.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.512+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93841863459904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942f21af0 con 0x7ff2500f8040 2024-09-12T00:20:59.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93841863459904] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 20 remove_watcher() i=6 2024-09-12T00:20:59.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93841863458208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555942ef9330 con 0x7ff2500f8040 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93841863458208] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff240039040 con 0x7ff2500f8040 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 20 remove_watcher() i=7 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff2500f8040 msgr2=0x7ff2500e8240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7ff2500f8040 0x7ff2500e8240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942eecef0 msgr2=0x555942eef3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942eecef0 0x555942eef3b0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff248021020 msgr2=0x7ff248048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7ff248021020 0x7ff248048420 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ef18f0 msgr2=0x555942ef3ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ef18f0 0x555942ef3ce0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff120039a70 msgr2=0x7ff12003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff120039a70 0x7ff12003bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff2500bd4f0 tx=0x7ff2500db000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff256031640 1 -- 172.21.15.66:0/434752602 reap_dead start 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 msgr2=0x555942ee1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff248016a50 tx=0x7ff24804ffd0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 shutdown_connections 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/434752602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942edb440 0x555942ee1950 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 >> 172.21.15.66:0/434752602 conn(0x555942ed6860 msgr2=0x555942ed4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 shutdown_connections 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.516+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/434752602 wait complete. 2024-09-12T00:20:59.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 msgr2=0x7ff13003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 0x7ff13003bf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x555942eb4440 tx=0x7ff2500beed0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 msgr2=0x555942ecded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x555942eb4310 tx=0x7ff24800bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 shutdown_connections 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff130039ac0 0x7ff13003bf80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/377031622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942ecdab0 0x555942ecded0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 >> 172.21.15.66:0/377031622 conn(0x555942ec3460 msgr2=0x555942ec3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 shutdown_connections 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/377031622 wait complete. 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 msgr2=0x555942eba0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 0x555942eba0f0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 msgr2=0x555942ebec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 0x555942ebec70 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 msgr2=0x7ff13c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 0x7ff13c03bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff240001d80 tx=0x7ff2400012e0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 msgr2=0x555942eb2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff2500aa500 tx=0x7ff250017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 shutdown_connections 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555942ebc880 0x555942ebec70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555942d32b50 0x555942eba0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7ff13c039a70 0x7ff13c03bf30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 --2- 172.21.15.66:0/146646965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555942d32770 0x555942eb2f80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 >> 172.21.15.66:0/146646965 conn(0x555942db8e90 msgr2=0x555942ea6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 shutdown_connections 2024-09-12T00:20:59.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.520+0000 7ff258d2c9c0 1 -- 172.21.15.66:0/146646965 wait complete. 2024-09-12T00:20:59.538 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.538 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.539 ERROR:root:0 2024-09-12T00:20:59.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:59.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:59.539 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T00:20:59.620 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.621 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb7fd59c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c3f88db560 0x55c3f88dd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb7fd59c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3f878c9c0 con 0x55c3f88d7370 2024-09-12T00:20:59.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb7fd59c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x55c3f87dc6d0 con 0x55c3f88db560 2024-09-12T00:20:59.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb52da640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c3f88db560 0x55c3f88dd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb52da640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x55c3f88db560 0x55c3f88dd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36302/0 (socket says 172.21.15.66:36302) 2024-09-12T00:20:59.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb52da640 1 -- 172.21.15.66:0/3688005419 learned_addr learned my addr 172.21.15.66:0/3688005419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb5adb640 1 --1- 172.21.15.66:0/3688005419 >> v1:172.21.15.31:6789/0 conn(0x55c3f88d7370 0x55c3f88d7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41958/0 (socket says 172.21.15.66:41958) 2024-09-12T00:20:59.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb52da640 1 -- 172.21.15.66:0/3688005419 >> v1:172.21.15.31:6789/0 conn(0x55c3f88d7370 legacy=0x55c3f88d7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.616+0000 7fceb52da640 1 -- 172.21.15.66:0/3688005419 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f8780ca0 con 0x55c3f88db560 2024-09-12T00:20:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb52da640 1 --2- 172.21.15.66:0/3688005419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88db560 0x55c3f88dd950 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fceac00a4e0 tx=0x7fceac01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea3310edd484302 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb4ad9640 1 -- 172.21.15.66:0/3688005419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac0aa540 con 0x55c3f88db560 2024-09-12T00:20:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb4ad9640 1 -- 172.21.15.66:0/3688005419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0aa6e0 con 0x55c3f88db560 2024-09-12T00:20:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb4ad9640 1 -- 172.21.15.66:0/3688005419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac0aaa40 con 0x55c3f88db560 2024-09-12T00:20:59.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3688005419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88db560 msgr2=0x55c3f88dd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/3688005419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88db560 0x55c3f88dd950 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fceac00a4e0 tx=0x7fceac01b120 comp rx=0 tx=0).stop 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3688005419 shutdown_connections 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/3688005419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88db560 0x55c3f88dd950 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3688005419 >> 172.21.15.66:0/3688005419 conn(0x55c3f88d2e90 msgr2=0x55c3f88d52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3688005419 shutdown_connections 2024-09-12T00:20:59.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.620+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3688005419 wait complete. 2024-09-12T00:20:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb7fd59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb7fd59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c3f87e0680 con 0x55c3f88d7370 2024-09-12T00:20:59.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb5adb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb5adb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36312/0 (socket says 172.21.15.66:36312) 2024-09-12T00:20:59.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.636+0000 7fceb5adb640 1 -- 172.21.15.66:0/3942094801 learned_addr learned my addr 172.21.15.66:0/3942094801 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 -- 172.21.15.66:0/3942094801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f875bda0 con 0x55c3f88d7370 2024-09-12T00:20:59.644 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 --2- 172.21.15.66:0/3942094801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcea800b270 tx=0x7fcea800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7439abff1d02b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fcda3e07640 1 -- 172.21.15.66:0/3942094801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea800e5d0 con 0x55c3f88d7370 2024-09-12T00:20:59.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fcda3e07640 1 -- 172.21.15.66:0/3942094801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea800e770 con 0x55c3f88d7370 2024-09-12T00:20:59.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fcda3e07640 1 -- 172.21.15.66:0/3942094801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea800ea70 con 0x55c3f88d7370 2024-09-12T00:20:59.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3942094801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 msgr2=0x55c3f89bf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/3942094801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcea800b270 tx=0x7fcea800b670 comp rx=0 tx=0).stop 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3942094801 shutdown_connections 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/3942094801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89bf5e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3942094801 >> 172.21.15.66:0/3942094801 conn(0x55c3f88d2e90 msgr2=0x55c3f884c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3942094801 shutdown_connections 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/3942094801 wait complete. 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb7fd59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c3f8782a50 con 0x55c3f88d7370 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36316/0 (socket says 172.21.15.66:36316) 2024-09-12T00:20:59.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 -- 172.21.15.66:0/4222284486 learned_addr learned my addr 172.21.15.66:0/4222284486 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f89cd7b0 con 0x55c3f88d7370 2024-09-12T00:20:59.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.640+0000 7fceb5adb640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55c3f89bf140 tx=0x7fcea8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 -- 172.21.15.66:0/4222284486 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea800be70 con 0x55c3f88d7370 2024-09-12T00:20:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 -- 172.21.15.66:0/4222284486 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea800f9f0 con 0x55c3f88d7370 2024-09-12T00:20:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3f89cda40 con 0x55c3f88d7370 2024-09-12T00:20:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 -- 172.21.15.66:0/4222284486 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea800fcf0 con 0x55c3f88d7370 2024-09-12T00:20:59.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f89ce3f0 con 0x55c3f88d7370 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 -- 172.21.15.66:0/4222284486 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fcea8017070 con 0x55c3f88d7370 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 0x7fcd9c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fcda2604640 1 -- 172.21.15.66:0/4222284486 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fcea8015020 con 0x55c3f88d7370 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb52da640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 0x7fcd9c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 0x55c3f89d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f89d4ce0 con 0x55c3f89d23b0 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb62dc640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 0x55c3f89d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb52da640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 0x7fcd9c03bf80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fceac0ab000 tx=0x7fceac0a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb62dc640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 0x55c3f89d47a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb62dc640 1 -- 172.21.15.66:0/4222284486 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceb00083f0 con 0x55c3f89d23b0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f89d5130 con 0x55c3f89d23b0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb62dc640 1 -- 172.21.15.66:0/4222284486 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fceb00083f0 con 0x55c3f89d23b0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 0x55c3f89d9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f89d9a00 con 0x55c3f89d6f40 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb5adb640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 0x55c3f89d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.644+0000 7fceb5adb640 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 0x55c3f89d9330 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb5adb640 1 -- 172.21.15.66:0/4222284486 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcea802e070 con 0x55c3f89d6f40 2024-09-12T00:20:59.652 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f89d5de0 con 0x55c3f89d23b0 2024-09-12T00:20:59.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 -- 172.21.15.66:0/4222284486 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fceb00083f0 con 0x55c3f89d23b0 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f89d62c0 con 0x55c3f89d6f40 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb5adb640 1 -- 172.21.15.66:0/4222284486 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcea802e070 con 0x55c3f89d6f40 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c3f87ed450 con 0x55c3f89e8130 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36326/0 (socket says 172.21.15.66:36326) 2024-09-12T00:20:59.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 -- 172.21.15.66:0/855294827 learned_addr learned my addr 172.21.15.66:0/855294827 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 -- 172.21.15.66:0/855294827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f89e8b90 con 0x55c3f89e8130 2024-09-12T00:20:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb62dc640 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55c3f89cdfd0 tx=0x7fceb000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fcd9b7fe640 1 -- 172.21.15.66:0/855294827 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb001c020 con 0x55c3f89e8130 2024-09-12T00:20:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fcd9b7fe640 1 -- 172.21.15.66:0/855294827 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0007d00 con 0x55c3f89e8130 2024-09-12T00:20:59.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3f89e93f0 con 0x55c3f89e8130 2024-09-12T00:20:59.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fcd9b7fe640 1 -- 172.21.15.66:0/855294827 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb0018440 con 0x55c3f89e8130 2024-09-12T00:20:59.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.648+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f89e9960 con 0x55c3f89e8130 2024-09-12T00:20:59.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd9b7fe640 1 -- 172.21.15.66:0/855294827 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fceb001f020 con 0x55c3f89e8130 2024-09-12T00:20:59.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd9b7fe640 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 0x7fcd9003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd9b7fe640 1 -- 172.21.15.66:0/855294827 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fceb0051ea0 con 0x55c3f89e8130 2024-09-12T00:20:59.657 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb5adb640 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 0x7fcd9003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb5adb640 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 0x7fcd9003bf80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c10 tx=0x7fcea8044040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c3f89bfe30 con 0x55c3f89f5a80 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36332/0 (socket says 172.21.15.66:36332) 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb62dc640 1 -- 172.21.15.66:0/1607618496 learned_addr learned my addr 172.21.15.66:0/1607618496 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb62dc640 1 -- 172.21.15.66:0/1607618496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f89f6470 con 0x55c3f89f5a80 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb62dc640 1 --2- 172.21.15.66:0/1607618496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fceb0050130 tx=0x7fceb0043050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d699d474c032b570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd997fa640 1 -- 172.21.15.66:0/1607618496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb0021530 con 0x55c3f89f5a80 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd997fa640 1 -- 172.21.15.66:0/1607618496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0029350 con 0x55c3f89f5a80 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fcd997fa640 1 -- 172.21.15.66:0/1607618496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb0029c70 con 0x55c3f89f5a80 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/1607618496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 msgr2=0x55c3f89f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/1607618496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fceb0050130 tx=0x7fceb0043050 comp rx=0 tx=0).stop 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/1607618496 shutdown_connections 2024-09-12T00:20:59.660 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/1607618496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89f5e80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/1607618496 >> 172.21.15.66:0/1607618496 conn(0x55c3f89f0ea0 msgr2=0x55c3f89ef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/1607618496 shutdown_connections 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/1607618496 wait complete. 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.652+0000 7fceb7fd59c0 1 Processor -- start 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 -- start start 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c3f89f49d0 con 0x55c3f89f5a80 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb62dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36344/0 (socket says 172.21.15.66:36344) 2024-09-12T00:20:59.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 learned_addr learned my addr 172.21.15.66:0/142135086 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f89fc520 con 0x55c3f89f5a80 2024-09-12T00:20:59.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb62dc640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fceb0016aa0 tx=0x7fceb0050090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 -- 172.21.15.66:0/142135086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb0028300 con 0x55c3f89f5a80 2024-09-12T00:20:59.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 -- 172.21.15.66:0/142135086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb00284a0 con 0x55c3f89f5a80 2024-09-12T00:20:59.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3f89fc7b0 con 0x55c3f89f5a80 2024-09-12T00:20:59.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 -- 172.21.15.66:0/142135086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb00289c0 con 0x55c3f89f5a80 2024-09-12T00:20:59.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f89fd160 con 0x55c3f89f5a80 2024-09-12T00:20:59.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 -- 172.21.15.66:0/142135086 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fceb0016040 con 0x55c3f89f5a80 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd80039a70 0x7fcd8003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fcd877fe640 1 -- 172.21.15.66:0/142135086 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fceb0031070 con 0x55c3f89f5a80 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb5adb640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd80039a70 0x7fcd8003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f8a07490 0x55c3f8a09950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0a0a0 con 0x55c3f8a07490 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb52da640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f8a07490 0x55c3f8a09950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.656+0000 7fceb5adb640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd80039a70 0x7fcd8003bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcea8017d00 tx=0x7fcea804b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f8a07490 0x55c3f8a09950 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 realm 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0a4d0 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0ada0 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0b140 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f8a0bea0 0x55c3f8a0e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0e8a0 con 0x55c3f8a0bea0 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f8a0bea0 0x55c3f8a0e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f8a0bea0 0x55c3f8a0e290 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 20 searching for the correct realm 2024-09-12T00:20:59.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10170 con 0x55c3f8a0bea0 2024-09-12T00:20:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fceb0021020 0x7fceb002ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10170 con 0x7fceb0021020 2024-09-12T00:20:59.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb5adb640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fceb0021020 0x7fceb002ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb5adb640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fceb0021020 0x7fceb002ca40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb5adb640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcea8056040 0x7fcea801d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10170 con 0x7fcea8056040 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.660+0000 7fceb52da640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcea8056040 0x7fcea801d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcea8056040 0x7fcea801d7e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10170 con 0x55c3f8a07490 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10170 con 0x55c3f8a07490 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.664+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.668+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a0bea0 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fcea8056040 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.672+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x55c3f8a07490 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7fceac0cc040 con 0x7fceb0021020 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:59.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0f2f0 con 0x55c3f8a07490 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a0fb40 con 0x55c3f8a07490 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a10510 con 0x55c3f8a0bea0 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 zone default found 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 4 Realm: () 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 zonegroup default 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a108f0 con 0x7fcea8056040 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a12720 con 0x55c3f8a0bea0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a12b90 con 0x55c3f8a0bea0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 started sync module instance, tier type = 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:59.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.676+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a11bc0 con 0x7fceb0021020 2024-09-12T00:20:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94300178290448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a12ff0 con 0x7fceb0021020 2024-09-12T00:20:59.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a13840 con 0x55c3f8a07490 2024-09-12T00:20:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94300178290448] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94300178297744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a13c60 con 0x55c3f8a07490 2024-09-12T00:20:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.680+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a144b0 con 0x55c3f8a0bea0 2024-09-12T00:20:59.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94300178300272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a14840 con 0x55c3f8a0bea0 2024-09-12T00:20:59.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a15360 con 0x7fceb0021020 2024-09-12T00:20:59.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94300178297744] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94300178304560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a15750 con 0x7fceb0021020 2024-09-12T00:20:59.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a16110 con 0x55c3f8a07490 2024-09-12T00:20:59.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94300178300272] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.691 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.684+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94300178304560] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94300178298800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a15c60 con 0x55c3f8a07490 2024-09-12T00:20:59.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a164f0 con 0x7fcea8056040 2024-09-12T00:20:59.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94300178298800] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94300178301584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a16110 con 0x7fcea8056040 2024-09-12T00:20:59.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.688+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a16f30 con 0x7fcea8056040 2024-09-12T00:20:59.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.692+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94300178301584] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.692+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.692+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94300178308464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a16f30 con 0x7fcea8056040 2024-09-12T00:20:59.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.692+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a178f0 con 0x7fcea8056040 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.692+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94300178308464] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94300178312288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a178f0 con 0x7fcea8056040 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=0 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=1 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=2 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=3 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=4 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=5 2024-09-12T00:20:59.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=6 2024-09-12T00:20:59.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94300178312288] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x7fcea8056040 2024-09-12T00:20:59.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 20 add_watcher() i=7 2024-09-12T00:20:59.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:59.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a1abd0 con 0x55c3f8a07490 2024-09-12T00:20:59.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.696+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94300178314672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a17e80 con 0x55c3f8a07490 2024-09-12T00:20:59.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94300178314672] v33'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fceac0bc040 con 0x55c3f8a07490 2024-09-12T00:20:59.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fcd677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:59.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:59.704 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 5 note: GC not initialized 2024-09-12T00:20:59.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fcd667fc640 20 reqs_thread_entry: start 2024-09-12T00:20:59.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:59.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 20 Filter name: none 2024-09-12T00:20:59.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fccd7fff640 20 reqs_thread_entry: start 2024-09-12T00:20:59.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:59.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.700+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a3e1f0 con 0x7fcea8056040 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fceac0d4040 con 0x7fcea8056040 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:59.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a44bf0 con 0x7fcea8056040 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x7fcea8056040 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.704+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94300178499168 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40300 con 0x55c3f8a07490 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 94300178298800 notify 141733920810 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55c3f8780ca0 con 0x55c3f8a07490 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fcd997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94300178298800 notifier 4914 bl.length()=649 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fcd997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fcd997fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 94300178499168 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fceac0d4040 con 0x55c3f8a07490 2024-09-12T00:20:59.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fcd997fa640 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fcd78003eb0 con 0x55c3f8a07490 2024-09-12T00:20:59.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x55c3f8a07490 2024-09-12T00:20:59.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 94300178499168 notify 141733920810 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fceac0cdb80 con 0x55c3f8a07490 2024-09-12T00:20:59.714 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:59.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fcd677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94300178314672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40ac0 con 0x55c3f8a07490 2024-09-12T00:20:59.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94300178314672] v33'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x55c3f8a07490 2024-09-12T00:20:59.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.708+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94300178290448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40ac0 con 0x7fceb0021020 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94300178290448] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb7fd59c0 20 remove_watcher() i=0 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb7fd59c0 2 removed watcher, disabling cache 2024-09-12T00:20:59.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94300178297744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40ac0 con 0x55c3f8a07490 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94300178297744] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x55c3f8a07490 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb7fd59c0 20 remove_watcher() i=1 2024-09-12T00:20:59.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.712+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94300178300272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40ac0 con 0x55c3f8a0bea0 2024-09-12T00:20:59.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb62dc640 1 -- 172.21.15.66:0/142135086 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94300178300272] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceb0055060 con 0x55c3f8a0bea0 2024-09-12T00:20:59.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb7fd59c0 20 remove_watcher() i=2 2024-09-12T00:20:59.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94300178304560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a40ac0 con 0x7fceb0021020 2024-09-12T00:20:59.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb5adb640 1 -- 172.21.15.66:0/142135086 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94300178304560] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea802e070 con 0x7fceb0021020 2024-09-12T00:20:59.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb7fd59c0 20 remove_watcher() i=3 2024-09-12T00:20:59.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.716+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94300178298800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a3bf40 con 0x55c3f8a07490 2024-09-12T00:20:59.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94300178298800] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x55c3f8a07490 2024-09-12T00:20:59.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb7fd59c0 20 remove_watcher() i=4 2024-09-12T00:20:59.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94300178301584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a3bf40 con 0x7fcea8056040 2024-09-12T00:20:59.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94300178301584] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x7fcea8056040 2024-09-12T00:20:59.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb7fd59c0 20 remove_watcher() i=5 2024-09-12T00:20:59.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.720+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94300178308464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a3bf40 con 0x7fcea8056040 2024-09-12T00:20:59.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94300178308464] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x7fcea8056040 2024-09-12T00:20:59.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 20 remove_watcher() i=6 2024-09-12T00:20:59.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94300178312288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c3f8a3bf40 con 0x7fcea8056040 2024-09-12T00:20:59.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94300178312288] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac0d4040 con 0x7fcea8056040 2024-09-12T00:20:59.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 20 remove_watcher() i=7 2024-09-12T00:20:59.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcea8056040 msgr2=0x7fcea801d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fcea8056040 0x7fcea801d7e0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f8a07490 msgr2=0x55c3f8a09950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f8a07490 0x55c3f8a09950 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fceb0021020 msgr2=0x7fceb002ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7fceb0021020 0x7fceb002ca40 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f8a0bea0 msgr2=0x55c3f8a0e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f8a0bea0 0x55c3f8a0e290 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd80039a70 msgr2=0x7fcd8003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd80039a70 0x7fcd8003bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcea8017d00 tx=0x7fcea804b000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb52da640 1 -- 172.21.15.66:0/142135086 reap_dead start 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 msgr2=0x55c3f89fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.724+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fceb0016aa0 tx=0x7fceb0050090 comp rx=0 tx=0).stop 2024-09-12T00:20:59.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 shutdown_connections 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/142135086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89f5a80 0x55c3f89fbfc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 >> 172.21.15.66:0/142135086 conn(0x55c3f89f0ea0 msgr2=0x55c3f89ef0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 shutdown_connections 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/142135086 wait complete. 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 msgr2=0x7fcd9003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 0x7fcd9003bf80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c10 tx=0x7fcea8044040 comp rx=0 tx=0).stop 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 msgr2=0x55c3f89e8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x55c3f89cdfd0 tx=0x7fceb000bf50 comp rx=0 tx=0).stop 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 shutdown_connections 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd90039ac0 0x7fcd9003bf80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/855294827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f89e8130 0x55c3f89e8550 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 >> 172.21.15.66:0/855294827 conn(0x55c3f89ddae0 msgr2=0x55c3f89ddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 shutdown_connections 2024-09-12T00:20:59.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/855294827 wait complete. 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 msgr2=0x55c3f89d47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 0x55c3f89d47a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 msgr2=0x55c3f89d9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 0x55c3f89d9330 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 msgr2=0x7fcd9c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 0x7fcd9c03bf80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fceac0ab000 tx=0x7fceac0a5000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 msgr2=0x55c3f89cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55c3f89bf140 tx=0x7fcea8000ee0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 shutdown_connections 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x55c3f89d6f40 0x55c3f89d9330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x55c3f89d23b0 0x55c3f89d47a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fcd9c039ac0 0x7fcd9c03bf80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 --2- 172.21.15.66:0/4222284486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c3f88d7370 0x55c3f89cd250 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 >> 172.21.15.66:0/4222284486 conn(0x55c3f88d2e90 msgr2=0x55c3f89be290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 shutdown_connections 2024-09-12T00:20:59.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.728+0000 7fceb7fd59c0 1 -- 172.21.15.66:0/4222284486 wait complete. 2024-09-12T00:20:59.745 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.745 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.745 ERROR:root:0 2024-09-12T00:20:59.745 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:59.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T00:20:59.746 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T00:20:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:59.821 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:59.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f893823d9c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555e6599b770 0x555e6599bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f893823d9c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e6584d9c0 con 0x555e6599e8b0 2024-09-12T00:20:59.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f893823d9c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x555e6589d6d0 con 0x555e6599b770 2024-09-12T00:20:59.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f8935d43640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x555e6599b770 0x555e6599bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f8935542640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x555e6599e8b0 0x555e659a0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:41968/0 (socket says 172.21.15.66:41968) 2024-09-12T00:20:59.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.816+0000 7f8935542640 1 -- 172.21.15.66:0/2700762764 learned_addr learned my addr 172.21.15.66:0/2700762764 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:20:59.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8935d43640 1 -- 172.21.15.66:0/2700762764 >> v1:172.21.15.31:6789/0 conn(0x555e6599e8b0 legacy=0x555e659a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8935d43640 1 -- 172.21.15.66:0/2700762764 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e65841ca0 con 0x555e6599b770 2024-09-12T00:20:59.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8935d43640 1 --2- 172.21.15.66:0/2700762764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e6599bb50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f892000a420 tx=0x7f892001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe3ef84137729c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8934d41640 1 -- 172.21.15.66:0/2700762764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200af070 con 0x555e6599b770 2024-09-12T00:20:59.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8934d41640 1 -- 172.21.15.66:0/2700762764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200aa530 con 0x555e6599b770 2024-09-12T00:20:59.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.820+0000 7f8934d41640 1 -- 172.21.15.66:0/2700762764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200aa850 con 0x555e6599b770 2024-09-12T00:20:59.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 -- 172.21.15.66:0/2700762764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 msgr2=0x555e6599bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2700762764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e6599bb50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f892000a420 tx=0x7f892001afd0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 -- 172.21.15.66:0/2700762764 shutdown_connections 2024-09-12T00:20:59.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2700762764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e6599bb50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 -- 172.21.15.66:0/2700762764 >> 172.21.15.66:0/2700762764 conn(0x555e6590f080 msgr2=0x555e6590f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 -- 172.21.15.66:0/2700762764 shutdown_connections 2024-09-12T00:20:59.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.824+0000 7f893823d9c0 1 -- 172.21.15.66:0/2700762764 wait complete. 2024-09-12T00:20:59.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e658a1680 con 0x555e6599b770 2024-09-12T00:20:59.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36366/0 (socket says 172.21.15.66:36366) 2024-09-12T00:20:59.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 -- 172.21.15.66:0/280222262 learned_addr learned my addr 172.21.15.66:0/280222262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 -- 172.21.15.66:0/280222262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6581cda0 con 0x555e6599b770 2024-09-12T00:20:59.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 --2- 172.21.15.66:0/280222262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f89200ad040 tx=0x7f89200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58a758f3430df54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8823e07640 1 -- 172.21.15.66:0/280222262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200af040 con 0x555e6599b770 2024-09-12T00:20:59.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8823e07640 1 -- 172.21.15.66:0/280222262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200aaa60 con 0x555e6599b770 2024-09-12T00:20:59.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8823e07640 1 -- 172.21.15.66:0/280222262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200aad40 con 0x555e6599b770 2024-09-12T00:20:59.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- 172.21.15.66:0/280222262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 msgr2=0x555e65a86a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 --2- 172.21.15.66:0/280222262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f89200ad040 tx=0x7f89200033b0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- 172.21.15.66:0/280222262 shutdown_connections 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 --2- 172.21.15.66:0/280222262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a86a80 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- 172.21.15.66:0/280222262 >> 172.21.15.66:0/280222262 conn(0x555e6590f080 msgr2=0x555e65a82720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- 172.21.15.66:0/280222262 shutdown_connections 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- 172.21.15.66:0/280222262 wait complete. 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f893823d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e65843a50 con 0x555e6599b770 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36368/0 (socket says 172.21.15.66:36368) 2024-09-12T00:20:59.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.840+0000 7f8935d43640 1 -- 172.21.15.66:0/2117969728 learned_addr learned my addr 172.21.15.66:0/2117969728 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.849 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8935d43640 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e65a8e4f0 con 0x555e6599b770 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8935d43640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f89200b8040 tx=0x7f8920017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 -- 172.21.15.66:0/2117969728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200c5070 con 0x555e6599b770 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 -- 172.21.15.66:0/2117969728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200c1690 con 0x555e6599b770 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e65a8e780 con 0x555e6599b770 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 -- 172.21.15.66:0/2117969728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89200c1970 con 0x555e6599b770 2024-09-12T00:20:59.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e65a8f1b0 con 0x555e6599b770 2024-09-12T00:20:59.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 -- 172.21.15.66:0/2117969728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f89200c8070 con 0x555e6599b770 2024-09-12T00:20:59.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 0x7f881c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8822604640 1 -- 172.21.15.66:0/2117969728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f89200bb070 con 0x555e6599b770 2024-09-12T00:20:59.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8935542640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 0x7f881c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 0x555e65a95100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65a95640 con 0x555e6599e8b0 2024-09-12T00:20:59.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8936544640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 0x555e65a95100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8935542640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 0x7f881c03bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8928001d80 tx=0x7f89280012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.844+0000 7f8936544640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 0x555e65a95100 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 -- 172.21.15.66:0/2117969728 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89300083f0 con 0x555e6599e8b0 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65a8f5a0 con 0x555e6599e8b0 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 -- 172.21.15.66:0/2117969728 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89300083f0 con 0x555e6599e8b0 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 0x555e65a99cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65a9a3c0 con 0x555e65a97900 2024-09-12T00:20:59.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8935d43640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 0x555e65a99cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8935d43640 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 0x555e65a99cf0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8935d43640 1 -- 172.21.15.66:0/2117969728 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89200d1070 con 0x555e65a97900 2024-09-12T00:20:59.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65a967d0 con 0x555e6599e8b0 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 -- 172.21.15.66:0/2117969728 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89300083f0 con 0x555e6599e8b0 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65a96c30 con 0x555e65a97900 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8935d43640 1 -- 172.21.15.66:0/2117969728 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89200d1070 con 0x555e65a97900 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f893823d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e658ae450 con 0x555e65aa8ab0 2024-09-12T00:20:59.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36382/0 (socket says 172.21.15.66:36382) 2024-09-12T00:20:59.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 -- 172.21.15.66:0/3034627065 learned_addr learned my addr 172.21.15.66:0/3034627065 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.848+0000 7f8936544640 1 -- 172.21.15.66:0/3034627065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e65aa9510 con 0x555e65aa8ab0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8936544640 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x555e65a8ee50 tx=0x7f893000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 -- 172.21.15.66:0/3034627065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8930007cb0 con 0x555e65aa8ab0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 -- 172.21.15.66:0/3034627065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930007e50 con 0x555e65aa8ab0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e65aa9d70 con 0x555e65aa8ab0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 -- 172.21.15.66:0/3034627065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89300195a0 con 0x555e65aa8ab0 2024-09-12T00:20:59.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e65aaa2e0 con 0x555e65aa8ab0 2024-09-12T00:20:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 -- 172.21.15.66:0/3034627065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8930016050 con 0x555e65aa8ab0 2024-09-12T00:20:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 0x7f881003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f881b7fe640 1 -- 172.21.15.66:0/3034627065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8930051e00 con 0x555e65aa8ab0 2024-09-12T00:20:59.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8935d43640 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 0x7f881003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8935d43640 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 0x7f881003bf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89200b47c0 tx=0x7f89200eb040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f893823d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e65a871f0 con 0x555e65ab6420 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36386/0 (socket says 172.21.15.66:36386) 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8936544640 1 -- 172.21.15.66:0/1936720556 learned_addr learned my addr 172.21.15.66:0/1936720556 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.852+0000 7f8936544640 1 -- 172.21.15.66:0/1936720556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e65ab6e10 con 0x555e65ab6420 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 --2- 172.21.15.66:0/1936720556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8930024fd0 tx=0x7f8930014f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c0088b05e552e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88197fa640 1 -- 172.21.15.66:0/1936720556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8930019c60 con 0x555e65ab6420 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88197fa640 1 -- 172.21.15.66:0/1936720556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930018c90 con 0x555e65ab6420 2024-09-12T00:20:59.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88197fa640 1 -- 172.21.15.66:0/1936720556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8930019e00 con 0x555e65ab6420 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/1936720556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 msgr2=0x555e65ab6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 --2- 172.21.15.66:0/1936720556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8930024fd0 tx=0x7f8930014f80 comp rx=0 tx=0).stop 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/1936720556 shutdown_connections 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 --2- 172.21.15.66:0/1936720556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65ab6820 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/1936720556 >> 172.21.15.66:0/1936720556 conn(0x555e65ab1840 msgr2=0x555e65aafa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/1936720556 shutdown_connections 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/1936720556 wait complete. 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 Processor -- start 2024-09-12T00:20:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- start start 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65abc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555e65ab5370 con 0x555e65ab6420 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65abc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65abc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:36388/0 (socket says 172.21.15.66:36388) 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 learned_addr learned my addr 172.21.15.66:0/3068510694 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:20:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e65abce50 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f8936544640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65abc8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f893004efa0 tx=0x7f89300500b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88077fe640 1 -- 172.21.15.66:0/3068510694 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8930032030 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e65abd0e0 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88077fe640 1 -- 172.21.15.66:0/3068510694 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930017550 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f88077fe640 1 -- 172.21.15.66:0/3068510694 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8930022bb0 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.856+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e65abda90 con 0x555e65ab6420 2024-09-12T00:20:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f88077fe640 1 -- 172.21.15.66:0/3068510694 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8930035030 con 0x555e65ab6420 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f88077fe640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8800039a70 0x7f880003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f88077fe640 1 -- 172.21.15.66:0/3068510694 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8930033070 con 0x555e65ab6420 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935d43640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8800039a70 0x7f880003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e65ac7e80 0x555e65aca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65acaa60 con 0x555e65ac7e80 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e65ac7e80 0x555e65aca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935d43640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8800039a70 0x7f880003bf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89200d83f0 tx=0x7f89200e1000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e65ac7e80 0x555e65aca310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f892800e5a0 con 0x555e65ac7e80 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 realm 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ac7290 con 0x555e65ac7e80 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f892800e5a0 con 0x555e65ac7e80 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65acb560 con 0x555e65ac7e80 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f892800e5a0 con 0x555e65ac7e80 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65acbe30 con 0x555e65ac7e80 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f892800e5a0 con 0x555e65ac7e80 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65acc850 0x555e65acec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65acf330 con 0x555e65acc850 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8936544640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65acc850 0x555e65acec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8936544640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65acc850 0x555e65acec40 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 20 searching for the correct realm 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.860+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8936544640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8930041070 0x7f89300489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.871 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935d43640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8930041070 0x7f89300489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.873 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935d43640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8930041070 0x7f89300489f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935d43640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89200f9040 0x7f89200b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89200f9040 0x7f89200b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89200f9040 0x7f89200b4830 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892800e5a0 con 0x7f89200f9040 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892800e5a0 con 0x555e65ac7e80 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.864+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.876 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.878 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.868+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x555e65ac7e80 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.872+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65acc850 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f89200f9040 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8928029040 con 0x7f89200f9040 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x555e65ac7e80 2024-09-12T00:20:59.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0c00 con 0x7f8930041070 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65acfc80 con 0x555e65ac7e80 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad0520 con 0x555e65ac7e80 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad1030 con 0x555e65acc850 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 zone default found 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 4 Realm: () 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:20:59.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 zonegroup default 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad13d0 con 0x7f89200f9040 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.876+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad31e0 con 0x555e65acc850 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad3610 con 0x555e65acc850 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:59.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 20 started sync module instance, tier type = 2024-09-12T00:20:59.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:20:59.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad2680 con 0x7f8930041070 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93863921131984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad3610 con 0x7f8930041070 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad3e60 con 0x555e65ac7e80 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.880+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93863921131984] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93863921137248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad3f30 con 0x555e65ac7e80 2024-09-12T00:20:59.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad47e0 con 0x555e65acc850 2024-09-12T00:20:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93863921137248] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93863921138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad4350 con 0x555e65acc850 2024-09-12T00:20:59.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.884+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad5260 con 0x7f8930041070 2024-09-12T00:20:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93863921143152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad5190 con 0x7f8930041070 2024-09-12T00:20:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6170 con 0x555e65ac7e80 2024-09-12T00:20:59.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 93863921138304] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93863921143152] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93863921145424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6170 con 0x555e65ac7e80 2024-09-12T00:20:59.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.888+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6a10 con 0x7f89200f9040 2024-09-12T00:20:59.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.892+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93863921145424] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.892+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.892+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93863921139360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6620 con 0x7f89200f9040 2024-09-12T00:20:59.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.892+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6fe0 con 0x7f89200f9040 2024-09-12T00:20:59.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93863921139360] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93863921148272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad71c0 con 0x7f89200f9040 2024-09-12T00:20:59.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad7a10 con 0x7f89200f9040 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(58 notify.7 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93863921152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad7db0 con 0x7f89200f9040 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=0 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=1 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=2 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=3 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=4 2024-09-12T00:20:59.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=5 2024-09-12T00:20:59.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93863921148272] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.904 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.896+0000 7f893823d9c0 20 add_watcher() i=6 2024-09-12T00:20:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93863921152928] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 20 add_watcher() i=7 2024-09-12T00:20:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:59.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad6d10 con 0x555e65ac7e80 2024-09-12T00:20:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93863921151248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65ad8330 con 0x555e65ac7e80 2024-09-12T00:20:59.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93863921151248] v33'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f87e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 5 note: GC not initialized 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f87e67fc640 20 reqs_thread_entry: start 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f893823d9c0 20 Filter name: none 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.900+0000 7f8757fff640 20 reqs_thread_entry: start 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:59.908 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65afe450 con 0x7f89200f9040 2024-09-12T00:20:59.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T00:20:59.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T00:20:59.909 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:59.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b05180 con 0x7f89200f9040 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.904+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93863921339376 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555e65b00850 con 0x555e65ac7e80 2024-09-12T00:20:59.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== watch-notify(notify (1) cookie 93863921145424 notify 141733920811 ret 0) ==== 691+0+0 (crc 0 0 0) 0x555e6584d9c0 con 0x555e65ac7e80 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f88197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 93863921145424 notifier 4921 bl.length()=649 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f88197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f88197fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(64 notify.4 [notify cookie 93863921339376 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f88197fa640 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f87f8003eb0 con 0x555e65ac7e80 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== watch-notify(notify_complete (2) cookie 93863921339376 notify 141733920811 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f892803d720 con 0x555e65ac7e80 2024-09-12T00:20:59.913 INFO:teuthology.orchestra.run.smithi066.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T00:20:57.062970Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T00:20:57.062956Z","tags":[],"group_ids":[]} 2024-09-12T00:20:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f87e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:59.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93863921151248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x555e65ac7e80 2024-09-12T00:20:59.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93863921151248] v33'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.908+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93863921131984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x7f8930041070 2024-09-12T00:20:59.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93863921131984] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f893823d9c0 20 remove_watcher() i=0 2024-09-12T00:20:59.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f893823d9c0 2 removed watcher, disabling cache 2024-09-12T00:20:59.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93863921137248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x555e65ac7e80 2024-09-12T00:20:59.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93863921137248] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f893823d9c0 20 remove_watcher() i=1 2024-09-12T00:20:59.919 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.912+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93863921138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x555e65acc850 2024-09-12T00:20:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f8936544640 1 -- 172.21.15.66:0/3068510694 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93863921138304] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8930051030 con 0x555e65acc850 2024-09-12T00:20:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f893823d9c0 20 remove_watcher() i=2 2024-09-12T00:20:59.921 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93863921143152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65afc180 con 0x7f8930041070 2024-09-12T00:20:59.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f8935d43640 1 -- 172.21.15.66:0/3068510694 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93863921143152] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89200d1070 con 0x7f8930041070 2024-09-12T00:20:59.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f893823d9c0 20 remove_watcher() i=3 2024-09-12T00:20:59.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.916+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93863921145424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65afc180 con 0x555e65ac7e80 2024-09-12T00:20:59.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93863921145424] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x555e65ac7e80 2024-09-12T00:20:59.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f893823d9c0 20 remove_watcher() i=4 2024-09-12T00:20:59.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93863921139360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x7f89200f9040 2024-09-12T00:20:59.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93863921139360] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f893823d9c0 20 remove_watcher() i=5 2024-09-12T00:20:59.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.920+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93863921148272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65b01010 con 0x7f89200f9040 2024-09-12T00:20:59.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93863921148272] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f893823d9c0 20 remove_watcher() i=6 2024-09-12T00:20:59.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93863921152928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555e65afc180 con 0x7f89200f9040 2024-09-12T00:20:59.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93863921152928] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8928039040 con 0x7f89200f9040 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f893823d9c0 20 remove_watcher() i=7 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.924+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89200f9040 msgr2=0x7f89200b4830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f89200f9040 0x7f89200b4830 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e65ac7e80 msgr2=0x555e65aca310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e65ac7e80 0x555e65aca310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8930041070 msgr2=0x7f89300489f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f8930041070 0x7f89300489f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65acc850 msgr2=0x555e65acec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65acc850 0x555e65acec40 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8800039a70 msgr2=0x7f880003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8800039a70 0x7f880003bf30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f89200d83f0 tx=0x7f89200e1000 comp rx=0 tx=0).stop 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 msgr2=0x555e65abc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3068510694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65ab6420 0x555e65abc8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f893004efa0 tx=0x7f89300500b0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f8935542640 1 -- 172.21.15.66:0/3068510694 reap_dead start 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 shutdown_connections 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 >> 172.21.15.66:0/3068510694 conn(0x555e65ab1840 msgr2=0x555e65aafa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 shutdown_connections 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3068510694 wait complete. 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 msgr2=0x7f881003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 0x7f881003bf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f89200b47c0 tx=0x7f89200eb040 comp rx=0 tx=0).stop 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 msgr2=0x555e65aa8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x555e65a8ee50 tx=0x7f893000af40 comp rx=0 tx=0).stop 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 shutdown_connections 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8810039ac0 0x7f881003bf80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/3034627065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e65aa8ab0 0x555e65aa8ed0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 >> 172.21.15.66:0/3034627065 conn(0x555e65a9e460 msgr2=0x555e65a9e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 shutdown_connections 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/3034627065 wait complete. 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 msgr2=0x555e65a95100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 0x555e65a95100 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 msgr2=0x555e65a99cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 0x555e65a99cf0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 msgr2=0x7f881c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 0x7f881c03bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8928001d80 tx=0x7f89280012e0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 msgr2=0x555e65a8df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f89200b8040 tx=0x7f8920017d70 comp rx=0 tx=0).stop 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 shutdown_connections 2024-09-12T00:20:59.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x555e65a97900 0x555e65a99cf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x555e6599e8b0 0x555e65a95100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f881c039ac0 0x7f881c03bf80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 --2- 172.21.15.66:0/2117969728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555e6599b770 0x555e65a8df90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 >> 172.21.15.66:0/2117969728 conn(0x555e6590f080 msgr2=0x555e65a811b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 shutdown_connections 2024-09-12T00:20:59.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:20:59.928+0000 7f893823d9c0 1 -- 172.21.15.66:0/2117969728 wait complete. 2024-09-12T00:20:59.946 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.946 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T00:20:57.062970Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T00:20:57.062956Z', 'tags': [], 'group_ids': []} 2024-09-12T00:20:59.946 ERROR:root:0 2024-09-12T00:20:59.946 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T00:20:59.962 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:59.963 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:20:59.974 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:59.974 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T00:20:59.989 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:20:59.989 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.001 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.002 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-12T00:21:00.020 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-12T00:21:00.021 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.034 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.034 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-12T00:21:00.052 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.052 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.065 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.065 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-12T00:21:00.086 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-12T00:21:00.086 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.103 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.104 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-12T00:21:00.127 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-12T00:21:00.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.139 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.140 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-12T00:21:00.161 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.162 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.174 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-12T00:21:00.192 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.206 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.206 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-12T00:21:00.231 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.231 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.245 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.245 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.261 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T00:21:00.262 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T00:21:00.276 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T00:21:00.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T00:21:00.328 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-12T00:21:00.328 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T00:21:00.343 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:21:00.300393Z', 'creation_time': '2024-09-12T00:21:00.291371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T00:21:00.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T00:21:00.360 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:21:00.300393Z', 'creation_time': '2024-09-12T00:21:00.291371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T00:21:00.372 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T00:21:00.389 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:21:00.300393Z', 'creation_time': '2024-09-12T00:21:00.291371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T00:21:00.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-12T00:21:00.403 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000641c45c167df9bb7-0066e233ec-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:21:00.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-12T00:21:00.435 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-12T00:21:00.461 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:21:00.482 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11'} 2024-09-12T00:21:00.513 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.565 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11'} 2024-09-12T00:21:00.598 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.598 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-12T00:21:00.628 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.650 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-12T00:21:00.670 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:21:00.670 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T00:21:00.686 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0f94cb3c-a22e-48d3-91ff-0e4df7c90757', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'marker': '631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T00:21:00.584157Z', 'creation_time': '2024-09-12T00:21:00.291371Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-12T00:22:00.811 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-12T00:22:00.855 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.856 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-12T00:22:00.894 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.894 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T00:22:00.908 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-12T00:22:00.922 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.922 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-12T00:22:00.936 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.937 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-12T00:22:00.950 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.950 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-12T00:22:00.964 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T00:00:00.000000Z', 'epoch': 1726099200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T00:22:00.964 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-12T00:22:00.983 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:00.983 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T00:22:00.997 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-12T00:22:00.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T00:22:01.021 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:22:01.035 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T00:22:01.059 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:22:01.436 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T00:22:01.450 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000bda96df70641fe21-0066e23429-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:01.636 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T00:22:01.651 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T00:22:01.661 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T00:22:01.675 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T00:22:01.829 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-12T00:22:01.933 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:01.933 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T00:22:01.951 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-12T00:22:01.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T00:22:01.969 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T00:22:01.994 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T00:22:02.009 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000548edd7c0ca3d72c-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.053 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-12T00:22:02.138 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:02.138 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T00:22:02.152 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000d2599edf2a3771b6-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.152 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-12T00:22:02.164 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '9e56bc75-e06d-484a-a616-57879b8b0bec'}]}} 2024-09-12T00:22:02.165 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-12T00:22:02.197 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T00:22:02.197 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T00:22:02.210 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T00:22:02.211 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-12T00:22:02.224 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000287ceaaea033cec4-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-12T00:22:02.238 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000001811e6ce1e487be2-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T00:22:02.277 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T00:22:02.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-12T00:22:02.290 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000065cb9a419ccbcc17-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-12T00:22:02.303 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000594bc4261547872c-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.304 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-12T00:22:02.317 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T00:22:02.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-12T00:22:02.329 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000006fc25bb8c31fe95b-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-12T00:22:02.342 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003510c65b6c5ae2ad-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-12T00:22:02.354 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000617d64d158d7c3a7-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-12T00:22:02.365 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000074a6a7b0fffdcc0f-0066e2342a-4229-default', 'HostId': '4229-default-default'} 2024-09-12T00:22:02.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-12T00:22:02.394 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:02.395 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T00:22:02.407 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-12T00:22:02.407 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-12T00:22:02.424 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:02.425 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T00:22:02.437 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-12T00:22:02.437 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-12T00:22:02.455 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T00:22:02.460 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T00:22:02.471 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T00:22:02.471 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:22:02.472 INFO:tasks.rgw.client.0.smithi066.stdout:2024-09-12T00:22:02.472+0000 7f412eeca640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29630) UID: 0 2024-09-12T00:22:02.472 INFO:tasks.rgw.client.0.smithi066.stdout:2024-09-12T00:22:02.472+0000 7f4132712a40 -1 shutting down 2024-09-12T00:22:31.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T00:22:32.978 INFO:tasks.rgw.client.0:Stopped 2024-09-12T00:22:32.978 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T00:22:32.985 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T00:22:33.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T00:22:33.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T00:22:33.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T00:22:33.097 DEBUG:teuthology.orchestra.run.smithi066:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T00:22:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:33.177 INFO:teuthology.orchestra.run.smithi066.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c7b1619c0 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56357af7a7b0 0x56357b00b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c7b1619c0 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56357aeba9c0 con 0x56357af7ab90 2024-09-12T00:22:33.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c7b1619c0 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x56357af0a6d0 con 0x56357af7a7b0 2024-09-12T00:22:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c78c67640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x56357af7a7b0 0x56357b00b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c78466640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x56357af7ab90 0x56357b00dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.66:35210/0 (socket says 172.21.15.66:35210) 2024-09-12T00:22:33.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c78466640 1 -- 172.21.15.66:0/2331481088 learned_addr learned my addr 172.21.15.66:0/2331481088 (peer_addr_for_me v1:172.21.15.66:0/0) 2024-09-12T00:22:33.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c78c67640 1 -- 172.21.15.66:0/2331481088 >> v1:172.21.15.31:6789/0 conn(0x56357af7ab90 legacy=0x56357b00dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.175+0000 7f1c78c67640 1 -- 172.21.15.66:0/2331481088 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357aeaeca0 con 0x56357af7a7b0 2024-09-12T00:22:33.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.179+0000 7f1c78c67640 1 --2- 172.21.15.66:0/2331481088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b00b560 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800a420 tx=0x7f1c6801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c27f6fc772f393 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.179+0000 7f1c77c65640 1 -- 172.21.15.66:0/2331481088 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680af070 con 0x56357af7a7b0 2024-09-12T00:22:33.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.179+0000 7f1c77c65640 1 -- 172.21.15.66:0/2331481088 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680aa530 con 0x56357af7a7b0 2024-09-12T00:22:33.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.179+0000 7f1c77c65640 1 -- 172.21.15.66:0/2331481088 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680aa850 con 0x56357af7a7b0 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2331481088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 msgr2=0x56357b00b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2331481088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b00b560 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800a420 tx=0x7f1c6801afd0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2331481088 shutdown_connections 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2331481088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b00b560 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2331481088 >> 172.21.15.66:0/2331481088 conn(0x56357b000e90 msgr2=0x56357b0032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2331481088 shutdown_connections 2024-09-12T00:22:33.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.183+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2331481088 wait complete. 2024-09-12T00:22:33.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56357af0e680 con 0x56357af7a7b0 2024-09-12T00:22:33.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c78c67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c78c67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:38938/0 (socket says 172.21.15.66:38938) 2024-09-12T00:22:33.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c78c67640 1 -- 172.21.15.66:0/2911529962 learned_addr learned my addr 172.21.15.66:0/2911529962 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:22:33.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c78c67640 1 -- 172.21.15.66:0/2911529962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357ae89da0 con 0x56357af7a7b0 2024-09-12T00:22:33.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c78c67640 1 --2- 172.21.15.66:0/2911529962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1c68018c00 tx=0x7f1c680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d64a1ecde2c52e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1b66e0d640 1 -- 172.21.15.66:0/2911529962 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680af050 con 0x56357af7a7b0 2024-09-12T00:22:33.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1b66e0d640 1 -- 172.21.15.66:0/2911529962 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680b0040 con 0x56357af7a7b0 2024-09-12T00:22:33.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1b66e0d640 1 -- 172.21.15.66:0/2911529962 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680aabb0 con 0x56357af7a7b0 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2911529962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 msgr2=0x56357b0f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2911529962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1c68018c00 tx=0x7f1c680033b0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2911529962 shutdown_connections 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2911529962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0f3a50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2911529962 >> 172.21.15.66:0/2911529962 conn(0x56357b000e90 msgr2=0x56357b0ef690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2911529962 shutdown_connections 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2911529962 wait complete. 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.199+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56357aeb0a50 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78c67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78c67640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:38952/0 (socket says 172.21.15.66:38952) 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78c67640 1 -- 172.21.15.66:0/3615123405 learned_addr learned my addr 172.21.15.66:0/3615123405 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78c67640 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357b0fb4a0 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78c67640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1c68019680 tx=0x7f1c68017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 -- 172.21.15.66:0/3615123405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680c4070 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56357b0fb730 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 -- 172.21.15.66:0/3615123405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680b6ce0 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 -- 172.21.15.66:0/3615123405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c680c0470 con 0x56357af7a7b0 2024-09-12T00:22:33.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357b0fc0e0 con 0x56357af7a7b0 2024-09-12T00:22:33.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 -- 172.21.15.66:0/3615123405 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1c680c7070 con 0x56357af7a7b0 2024-09-12T00:22:33.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 0x7f1b6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1b6560a640 1 -- 172.21.15.66:0/3615123405 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1c680bb070 con 0x56357af7a7b0 2024-09-12T00:22:33.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c78466640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 0x7f1b6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 0x56357b1020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.203+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b1025f0 con 0x56357af7ab90 2024-09-12T00:22:33.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 0x56357b1020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c78466640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 0x7f1b6003bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c004180 tx=0x7f1c6c001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 0x56357b1020b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 -- 172.21.15.66:0/3615123405 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c700083f0 con 0x56357af7ab90 2024-09-12T00:22:33.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b102a60 con 0x56357af7ab90 2024-09-12T00:22:33.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 -- 172.21.15.66:0/3615123405 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c700083f0 con 0x56357af7ab90 2024-09-12T00:22:33.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 0x56357b106c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:3 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b107330 con 0x56357b104870 2024-09-12T00:22:33.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c78c67640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 0x56357b106c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c78c67640 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 0x56357b106c60 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c78c67640 1 -- 172.21.15.66:0/3615123405 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(3 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c680d0070 con 0x56357b104870 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b103710 con 0x56357af7ab90 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 -- 172.21.15.66:0/3615123405 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c700083f0 con 0x56357af7ab90 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b103bd0 con 0x56357b104870 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c78c67640 1 -- 172.21.15.66:0/3615123405 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(5 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c680d0070 con 0x56357b104870 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c7b1619c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56357af1b450 con 0x56357b115a40 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:38956/0 (socket says 172.21.15.66:38956) 2024-09-12T00:22:33.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.207+0000 7f1c79468640 1 -- 172.21.15.66:0/2501792726 learned_addr learned my addr 172.21.15.66:0/2501792726 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:22:33.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c79468640 1 -- 172.21.15.66:0/2501792726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357b1164a0 con 0x56357b115a40 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c79468640 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x56357b0fc2d0 tx=0x7f1c7000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 -- 172.21.15.66:0/2501792726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c7001c020 con 0x56357b115a40 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 -- 172.21.15.66:0/2501792726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70007d00 con 0x56357b115a40 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56357b116d00 con 0x56357b115a40 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 -- 172.21.15.66:0/2501792726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c70018440 con 0x56357b115a40 2024-09-12T00:22:33.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357b117270 con 0x56357b115a40 2024-09-12T00:22:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 -- 172.21.15.66:0/2501792726 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1c7001f020 con 0x56357b115a40 2024-09-12T00:22:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 0x7f1b5003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1b5e7fc640 1 -- 172.21.15.66:0/2501792726 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1c70051d90 con 0x56357b115a40 2024-09-12T00:22:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c78c67640 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 0x7f1b5003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c78c67640 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 0x7f1b5003bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c680d1df0 tx=0x7f1c680b47b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.211+0000 7f1c7b1619c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56357b0f41e0 con 0x56357b123350 2024-09-12T00:22:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:38970/0 (socket says 172.21.15.66:38970) 2024-09-12T00:22:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 -- 172.21.15.66:0/1036723379 learned_addr learned my addr 172.21.15.66:0/1036723379 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:22:33.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 -- 172.21.15.66:0/1036723379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357b123d20 con 0x56357b123350 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- 172.21.15.66:0/1036723379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1c700500e0 tx=0x7f1c70016970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb32b907115be4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1b4ffff640 1 -- 172.21.15.66:0/1036723379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c70021400 con 0x56357b123350 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1b4ffff640 1 -- 172.21.15.66:0/1036723379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70029c50 con 0x56357b123350 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1b4ffff640 1 -- 172.21.15.66:0/1036723379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c700215a0 con 0x56357b123350 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/1036723379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 msgr2=0x56357b123730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/1036723379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1c700500e0 tx=0x7f1c70016970 comp rx=0 tx=0).stop 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/1036723379 shutdown_connections 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/1036723379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b123730 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/1036723379 >> 172.21.15.66:0/1036723379 conn(0x56357b11e770 msgr2=0x56357b11c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/1036723379 shutdown_connections 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/1036723379 wait complete. 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 Processor -- start 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- start start 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c7b1619c0 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56357b1222a0 con 0x56357b123350 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b129880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.66:38986/0 (socket says 172.21.15.66:38986) 2024-09-12T00:22:33.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 learned_addr learned my addr 172.21.15.66:0/510980935 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357b129de0 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.215+0000 7f1c79468640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b129880 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1c70016cd0 tx=0x7f1c70050040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 -- 172.21.15.66:0/510980935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c70039070 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56357b12a070 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 -- 172.21.15.66:0/510980935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c700289c0 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 -- 172.21.15.66:0/510980935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c70028ca0 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357b12aa20 con 0x56357b123350 2024-09-12T00:22:33.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 -- 172.21.15.66:0/510980935 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1c7003c070 con 0x56357b123350 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b44039a70 0x7f1b4403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1b4e7fc640 1 -- 172.21.15.66:0/510980935 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f1c70031070 con 0x56357b123350 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78c67640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b44039a70 0x7f1b4403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357b134e50 0x56357b1372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b137a30 con 0x56357b134e50 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357b134e50 0x56357b1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78c67640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b44039a70 0x7f1b4403bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801ae00 tx=0x7f1c680db000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357b134e50 0x56357b1372e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6c00e640 con 0x56357b134e50 2024-09-12T00:22:33.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 realm 2024-09-12T00:22:33.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b134200 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6c00e640 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b138530 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6c00e640 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b138e00 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c6c00e640 con 0x56357b134e50 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b139820 0x56357b13bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.219+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:5 5.0 5:047e9ace:::zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b13c2e0 con 0x56357b139820 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b139820 0x56357b13bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b139820 0x56357b13bc10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== osd_op_reply(5 zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c7003b030 con 0x56357b139820 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c7b1619c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c7b1619c0 20 searching for the correct realm 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c7003b030 con 0x56357b139820 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1c70021020 0x7f1c70034a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78c67640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1c70021020 0x7f1c70034a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78c67640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1c70021020 0x7f1c70034a30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78c67640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1c680c9070 0x7f1c680eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78466640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1c680c9070 0x7f1c680eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78466640 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1c680c9070 0x7f1c680eb900 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c00e640 con 0x7f1c680c9070 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.223+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c00e640 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.232 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.233 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.227+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 3 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 4 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x56357b134e50 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.231+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 5 ==== osd_op_reply(30 [pgnls start_epoch 33 out=82b] v33'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b139820 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c680c9070 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 7 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c6c029040 con 0x7f1c680c9070 2024-09-12T00:22:33.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x56357b134e50 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56357b13dbb0 con 0x7f1c70021020 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got zone_info.631e6d39-d415-492d-aa86-21cdd5f9473d 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.235+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b13cc60 con 0x56357b134e50 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b13c8a0 con 0x56357b134e50 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:40 5.16 5:685cf786:::zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b13d0a0 con 0x56357b139820 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 11 ==== osd_op_reply(40 zonegroup_info.0f94cb3c-a22e-48d3-91ff-0e4df7c90757 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 zone default found 2024-09-12T00:22:33.243 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 4 Realm: () 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 4 ZoneGroup: default (0f94cb3c-a22e-48d3-91ff-0e4df7c90757) 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 4 Zone: default (631e6d39-d415-492d-aa86-21cdd5f9473d) 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 zonegroup default 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b13e490 con 0x7f1c680c9070 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b140250 con 0x56357b139820 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados->read ofs=0 len=0 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b140270 con 0x56357b139820 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 started sync module instance, tier type = 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 20 started zone id=631e6d39-d415-492d-aa86-21cdd5f9473d (name=default) with tier type = 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.239+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b13fca0 con 0x7f1c70021020 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 8 ==== osd_op_reply(44 notify.0 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94787698159824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b140750 con 0x7f1c70021020 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1411b0 con 0x56357b134e50 2024-09-12T00:22:33.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94787698159824] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 16 ==== osd_op_reply(46 notify.1 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94787698161056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1415d0 con 0x56357b134e50 2024-09-12T00:22:33.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.243+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b141f90 con 0x56357b139820 2024-09-12T00:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 14 ==== osd_op_reply(48 notify.2 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94787698170592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b141f00 con 0x56357b139820 2024-09-12T00:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b142eb0 con 0x7f1c70021020 2024-09-12T00:22:33.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94787698161056] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 10 ==== osd_op_reply(50 notify.3 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94787698174368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1432a0 con 0x7f1c70021020 2024-09-12T00:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b143c60 con 0x56357b134e50 2024-09-12T00:22:33.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.247+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94787698170592] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94787698174368] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 18 ==== osd_op_reply(52 notify.4 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94787698172800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b140dd0 con 0x56357b134e50 2024-09-12T00:22:33.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b143c60 con 0x7f1c680c9070 2024-09-12T00:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94787698172800] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 9 ==== osd_op_reply(54 notify.5 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94787698180720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b143c60 con 0x7f1c680c9070 2024-09-12T00:22:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.251+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b144e20 con 0x7f1c680c9070 2024-09-12T00:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.255+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94787698180720] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.255+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 11 ==== osd_op_reply(56 notify.6 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.255+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94787698177968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b144e20 con 0x7f1c680c9070 2024-09-12T00:22:33.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.255+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b145670 con 0x7f1c680c9070 2024-09-12T00:22:33.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94787698177968] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 13 ==== osd_op_reply(58 notify.7 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94787698182992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b145520 con 0x7f1c680c9070 2024-09-12T00:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=0 2024-09-12T00:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=1 2024-09-12T00:22:33.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=2 2024-09-12T00:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=3 2024-09-12T00:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=4 2024-09-12T00:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=5 2024-09-12T00:22:33.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=6 2024-09-12T00:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94787698182992] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 20 add_watcher() i=7 2024-09-12T00:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:33.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b148a60 con 0x56357b134e50 2024-09-12T00:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.259+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94787698184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b145f20 con 0x56357b134e50 2024-09-12T00:22:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94787698184112] v33'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1b2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c7b1619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c7b1619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:33.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1512f0 con 0x56357b134e50 2024-09-12T00:22:33.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.263+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b151940 con 0x7f1c680c9070 2024-09-12T00:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.268 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b151da0 con 0x56357b139820 2024-09-12T00:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b151cd0 con 0x56357b134e50 2024-09-12T00:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'281 uv168 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.271 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.267+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1522e0 con 0x7f1c70021020 2024-09-12T00:22:33.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.271+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'90 uv58 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.273 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.271+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152770 con 0x56357b139820 2024-09-12T00:22:33.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.271+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.271+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152710 con 0x56357b134e50 2024-09-12T00:22:33.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.275+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.275+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152710 con 0x7f1c680c9070 2024-09-12T00:22:33.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.275+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.275+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1527a0 con 0x7f1c70021020 2024-09-12T00:22:33.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.279+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.279+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152830 con 0x56357b139820 2024-09-12T00:22:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.279+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.279+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528f0 con 0x7f1c70021020 2024-09-12T00:22:33.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.283+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'91 uv60 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.283+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528f0 con 0x7f1c680c9070 2024-09-12T00:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.283+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'43 uv26 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.283+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x7f1c70021020 2024-09-12T00:22:33.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.287+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.287+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x7f1c680c9070 2024-09-12T00:22:33.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.287+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'76 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.287+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b134e50 2024-09-12T00:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'282 uv170 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b139820 2024-09-12T00:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'83 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x7f1c70021020 2024-09-12T00:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'92 uv62 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.291+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b139820 2024-09-12T00:22:33.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.295+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.295+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b134e50 2024-09-12T00:22:33.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.295+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.295+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b134e50 2024-09-12T00:22:33.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.299+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'283 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.301 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.299+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b152ec0 con 0x56357b139820 2024-09-12T00:22:33.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.299+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'84 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.299+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528c0 con 0x7f1c70021020 2024-09-12T00:22:33.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'49 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528c0 con 0x56357b139820 2024-09-12T00:22:33.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528c0 con 0x56357b139820 2024-09-12T00:22:33.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'50 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.303+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528c0 con 0x56357b139820 2024-09-12T00:22:33.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.307+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.307+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1528c0 con 0x56357b139820 2024-09-12T00:22:33.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.307+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.307+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x7f1c680c9070 2024-09-12T00:22:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.311+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.311+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x56357b139820 2024-09-12T00:22:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.311+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'45 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.311+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x7f1c680c9070 2024-09-12T00:22:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.315+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.315+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x56357b139820 2024-09-12T00:22:33.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.315+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'85 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.315+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x7f1c680c9070 2024-09-12T00:22:33.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.319+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'77 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.319+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b153090 con 0x7f1c70021020 2024-09-12T00:22:33.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.319+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1b2e7e4640 20 reqs_thread_entry: start 2024-09-12T00:22:33.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c7b1619c0 20 init_complete bucket index max shards: 11 2024-09-12T00:22:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c7b1619c0 20 Filter name: none 2024-09-12T00:22:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1b277fe640 20 reqs_thread_entry: start 2024-09-12T00:22:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:22:33.325 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x56357b139820 2024-09-12T00:22:33.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 28 ==== osd_op_reply(94 gc.20 [call] v33'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.327 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.323+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x56357b139820 2024-09-12T00:22:33.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 29 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:96 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16e3a0 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 30 ==== osd_op_reply(96 gc.20 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:97 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 31 ==== osd_op_reply(97 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:98 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 32 ==== osd_op_reply(98 gc.20 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.330 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:99 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x56357b139820 2024-09-12T00:22:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 33 ==== osd_op_reply(99 gc.20 [call] v33'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:22:33.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.327+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:100 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x7f1c70021020 2024-09-12T00:22:33.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 19 ==== osd_op_reply(100 gc.21 [call] v33'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:101 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x7f1c70021020 2024-09-12T00:22:33.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 20 ==== osd_op_reply(101 gc.21 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.333 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:102 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16e3a0 con 0x7f1c70021020 2024-09-12T00:22:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 21 ==== osd_op_reply(102 gc.21 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.334 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:103 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x7f1c70021020 2024-09-12T00:22:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 22 ==== osd_op_reply(103 gc.21 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:104 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b16f3b0 con 0x7f1c70021020 2024-09-12T00:22:33.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 23 ==== osd_op_reply(104 gc.21 [call out=1715b] v0'0 uv50 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process iterating over entry tag='631e6d39-d415-492d-aa86-21cdd5f9473d.4229.8911714577588886505', time=2024-09-12T00:22:16.433822+0000, chain.objs.size()=7 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_1 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:105 3.32s0 3:4eb165c3:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14f070 con 0x56357b139820 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_2 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:106 3.25s0 3:a7744921:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1726b0 con 0x56357b134e50 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_3 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:107 3.2es0 3:768ee879:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b175090 con 0x7f1c70021020 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_4 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:108 3.34s0 3:2d046a34:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b177960 con 0x56357b134e50 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_5 2024-09-12T00:22:33.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:109 3.12s0 3:4b2cb352:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b175090 con 0x7f1c70021020 2024-09-12T00:22:33.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_6 2024-09-12T00:22:33.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:110 3.es0 3:702ffb3f:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17ca30 con 0x7f1c70021020 2024-09-12T00:22:33.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_7 2024-09-12T00:22:33.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.331+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:111 3.22s0 3:46aefeaa:::631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.335+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 24 ==== osd_op_reply(107 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_3 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.335+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 25 ==== osd_op_reply(110 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_6 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 28 ==== osd_op_reply(106 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_2 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 34 ==== osd_op_reply(111 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_7 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 26 ==== osd_op_reply(109 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_5 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 29 ==== osd_op_reply(108 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_4 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 35 ==== osd_op_reply(105 631e6d39-d415-492d-aa86-21cdd5f9473d.4229.11__shadow_.rg2nkLQd6k3KItASPxDMRCvpEq5hdBg_1 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c7b1619c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:22:33.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.339+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:112 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c70021020 2024-09-12T00:22:33.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.343+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 27 ==== osd_op_reply(112 gc.21 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.343+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:113 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c70021020 2024-09-12T00:22:33.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 28 ==== osd_op_reply(113 gc.21 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:22:33.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:114 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 36 ==== osd_op_reply(114 gc.22 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:115 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 37 ==== osd_op_reply(115 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:116 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 38 ==== osd_op_reply(116 gc.22 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:117 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 39 ==== osd_op_reply(117 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:118 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 40 ==== osd_op_reply(118 gc.22 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.347+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:119 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 41 ==== osd_op_reply(119 gc.22 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:22:33.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:120 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 42 ==== osd_op_reply(120 gc.23 [call] v33'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:121 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 43 ==== osd_op_reply(121 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:122 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 44 ==== osd_op_reply(122 gc.23 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:123 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 45 ==== osd_op_reply(123 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:124 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.351+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 46 ==== osd_op_reply(124 gc.23 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:125 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 47 ==== osd_op_reply(125 gc.23 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:22:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:126 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 48 ==== osd_op_reply(126 gc.24 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:127 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 49 ==== osd_op_reply(127 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:128 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 50 ==== osd_op_reply(128 gc.24 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:129 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 51 ==== osd_op_reply(129 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.355+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:130 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 52 ==== osd_op_reply(130 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:131 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 53 ==== osd_op_reply(131 gc.24 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:22:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:132 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 54 ==== osd_op_reply(132 gc.25 [call] v33'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:133 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 55 ==== osd_op_reply(133 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:134 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 56 ==== osd_op_reply(134 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.359+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:135 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 57 ==== osd_op_reply(135 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:136 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 58 ==== osd_op_reply(136 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:137 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 59 ==== osd_op_reply(137 gc.25 [call] v33'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:22:33.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.363+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:138 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 22 ==== osd_op_reply(138 gc.26 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:139 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 23 ==== osd_op_reply(139 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:140 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 24 ==== osd_op_reply(140 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:141 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 25 ==== osd_op_reply(141 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.367+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:142 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 26 ==== osd_op_reply(142 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:143 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 27 ==== osd_op_reply(143 gc.26 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:22:33.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.371+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:144 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 60 ==== osd_op_reply(144 gc.27 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:145 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 61 ==== osd_op_reply(145 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:146 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 62 ==== osd_op_reply(146 gc.27 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:147 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 63 ==== osd_op_reply(147 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:148 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 64 ==== osd_op_reply(148 gc.27 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:149 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 65 ==== osd_op_reply(149 gc.27 [call] v33'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:22:33.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.375+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:150 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 28 ==== osd_op_reply(150 gc.28 [call] v33'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:151 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 29 ==== osd_op_reply(151 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:152 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 30 ==== osd_op_reply(152 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.379+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:153 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 31 ==== osd_op_reply(153 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:154 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 32 ==== osd_op_reply(154 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.383+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:155 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.387+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 33 ==== osd_op_reply(155 gc.28 [call] v33'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.387+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:22:33.389 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.387+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:156 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.387+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 66 ==== osd_op_reply(156 gc.29 [call] v33'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.387+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:157 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 67 ==== osd_op_reply(157 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:158 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 68 ==== osd_op_reply(158 gc.29 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:159 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 69 ==== osd_op_reply(159 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:160 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 70 ==== osd_op_reply(160 gc.29 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.391+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:161 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x56357b139820 2024-09-12T00:22:33.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 71 ==== osd_op_reply(161 gc.29 [call] v33'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:22:33.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:162 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 34 ==== osd_op_reply(162 gc.30 [call] v33'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:163 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 35 ==== osd_op_reply(163 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.395+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:164 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 36 ==== osd_op_reply(164 gc.30 [call out=24b] v0'0 uv78 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:165 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 37 ==== osd_op_reply(165 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:166 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 38 ==== osd_op_reply(166 gc.30 [call out=15b] v0'0 uv78 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.399+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:167 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c680c9070 2024-09-12T00:22:33.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 39 ==== osd_op_reply(167 gc.30 [call] v33'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:22:33.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:168 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17f730 con 0x7f1c70021020 2024-09-12T00:22:33.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 29 ==== osd_op_reply(168 gc.31 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:169 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 30 ==== osd_op_reply(169 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.403+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:170 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 31 ==== osd_op_reply(170 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:171 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 32 ==== osd_op_reply(171 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:172 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 33 ==== osd_op_reply(172 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.407+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:173 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 34 ==== osd_op_reply(173 gc.31 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:22:33.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:174 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 30 ==== osd_op_reply(174 gc.0 [call] v33'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:175 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 31 ==== osd_op_reply(175 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:176 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 32 ==== osd_op_reply(176 gc.0 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.411+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:177 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 33 ==== osd_op_reply(177 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 34 ==== osd_op_reply(178 gc.0 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.418 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 35 ==== osd_op_reply(179 gc.0 [call] v33'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:22:33.419 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.415+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:180 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 40 ==== osd_op_reply(180 gc.1 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:181 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 41 ==== osd_op_reply(181 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:182 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 42 ==== osd_op_reply(182 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:183 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 43 ==== osd_op_reply(183 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.419+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 44 ==== osd_op_reply(184 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.423+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.423+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c680c9070 2024-09-12T00:22:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.423+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 45 ==== osd_op_reply(185 gc.1 [call] v33'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.423+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:22:33.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.423+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:186 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 72 ==== osd_op_reply(186 gc.2 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:187 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 73 ==== osd_op_reply(187 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:188 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 74 ==== osd_op_reply(188 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:189 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 75 ==== osd_op_reply(189 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 76 ==== osd_op_reply(190 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b139820 2024-09-12T00:22:33.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.427+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 77 ==== osd_op_reply(191 gc.2 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:22:33.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:192 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 36 ==== osd_op_reply(192 gc.3 [call] v33'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:193 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 37 ==== osd_op_reply(193 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.434 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:194 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 38 ==== osd_op_reply(194 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:195 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 39 ==== osd_op_reply(195 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 40 ==== osd_op_reply(196 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.431+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x56357b134e50 2024-09-12T00:22:33.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.435+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 41 ==== osd_op_reply(197 gc.3 [call] v33'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.435+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:22:33.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.435+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:198 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14ea10 con 0x7f1c70021020 2024-09-12T00:22:33.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 35 ==== osd_op_reply(198 gc.4 [call] v33'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:199 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17c250 con 0x7f1c70021020 2024-09-12T00:22:33.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 36 ==== osd_op_reply(199 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:200 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17d9a0 con 0x7f1c70021020 2024-09-12T00:22:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 37 ==== osd_op_reply(200 gc.4 [call out=24b] v0'0 uv93 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:201 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 38 ==== osd_op_reply(201 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 39 ==== osd_op_reply(202 gc.4 [call out=15b] v0'0 uv93 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.439+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 40 ==== osd_op_reply(203 gc.4 [call] v33'94 uv94 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:22:33.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:204 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 78 ==== osd_op_reply(204 gc.5 [call] v33'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:205 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 79 ==== osd_op_reply(205 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.443+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:206 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b139820 2024-09-12T00:22:33.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 80 ==== osd_op_reply(206 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:207 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 81 ==== osd_op_reply(207 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:208 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 82 ==== osd_op_reply(208 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:209 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 83 ==== osd_op_reply(209 gc.5 [call] v33'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:22:33.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.447+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:210 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 42 ==== osd_op_reply(210 gc.6 [call] v33'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:211 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 43 ==== osd_op_reply(211 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:212 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b134e50 2024-09-12T00:22:33.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 44 ==== osd_op_reply(212 gc.6 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:213 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 45 ==== osd_op_reply(213 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:214 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 46 ==== osd_op_reply(214 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.451+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:215 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.455+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 47 ==== osd_op_reply(215 gc.6 [call] v33'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.455+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:22:33.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.455+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:216 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 46 ==== osd_op_reply(216 gc.7 [call] v33'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:217 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 47 ==== osd_op_reply(217 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:218 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c680c9070 2024-09-12T00:22:33.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 48 ==== osd_op_reply(218 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.459+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:219 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 49 ==== osd_op_reply(219 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:220 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 50 ==== osd_op_reply(220 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.465 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.463+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:221 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 51 ==== osd_op_reply(221 gc.7 [call] v33'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:22:33.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:222 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 41 ==== osd_op_reply(222 gc.8 [call] v33'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:223 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 42 ==== osd_op_reply(223 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:224 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c70021020 2024-09-12T00:22:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 43 ==== osd_op_reply(224 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.467+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:225 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 44 ==== osd_op_reply(225 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:226 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 45 ==== osd_op_reply(226 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:227 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 46 ==== osd_op_reply(227 gc.8 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:22:33.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.471+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:228 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 84 ==== osd_op_reply(228 gc.9 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:229 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 85 ==== osd_op_reply(229 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:230 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b139820 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 86 ==== osd_op_reply(230 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:231 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 87 ==== osd_op_reply(231 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:232 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 88 ==== osd_op_reply(232 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.475+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:233 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 89 ==== osd_op_reply(233 gc.9 [call] v33'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:22:33.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:234 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 47 ==== osd_op_reply(234 gc.10 [call] v33'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:235 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 48 ==== osd_op_reply(235 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.479+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:236 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c70021020 2024-09-12T00:22:33.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 49 ==== osd_op_reply(236 gc.10 [call out=24b] v0'0 uv95 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:237 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 50 ==== osd_op_reply(237 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:238 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 51 ==== osd_op_reply(238 gc.10 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:239 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 52 ==== osd_op_reply(239 gc.10 [call] v33'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:22:33.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.483+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:240 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.487+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 52 ==== osd_op_reply(240 gc.11 [call] v33'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.487+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:241 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.487+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 53 ==== osd_op_reply(241 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:242 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c680c9070 2024-09-12T00:22:33.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 54 ==== osd_op_reply(242 gc.11 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:243 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 55 ==== osd_op_reply(243 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:244 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 56 ==== osd_op_reply(244 gc.11 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.491+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:245 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.495+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 57 ==== osd_op_reply(245 gc.11 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.495+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:22:33.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.495+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:246 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 53 ==== osd_op_reply(246 gc.12 [call] v33'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:247 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 54 ==== osd_op_reply(247 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:248 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c70021020 2024-09-12T00:22:33.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 55 ==== osd_op_reply(248 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:249 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 56 ==== osd_op_reply(249 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 57 ==== osd_op_reply(250 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.499+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 58 ==== osd_op_reply(251 gc.12 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:22:33.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:252 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 58 ==== osd_op_reply(252 gc.13 [call] v33'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:253 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 59 ==== osd_op_reply(253 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.503+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:254 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c680c9070 2024-09-12T00:22:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 60 ==== osd_op_reply(254 gc.13 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:255 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 61 ==== osd_op_reply(255 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 62 ==== osd_op_reply(256 gc.13 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.507+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c680c9070 2024-09-12T00:22:33.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 63 ==== osd_op_reply(257 gc.13 [call] v33'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:22:33.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:258 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 48 ==== osd_op_reply(258 gc.14 [call] v33'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:259 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 49 ==== osd_op_reply(259 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.511+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:260 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b134e50 2024-09-12T00:22:33.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 50 ==== osd_op_reply(260 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:261 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 51 ==== osd_op_reply(261 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 52 ==== osd_op_reply(262 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.515+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.519+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 53 ==== osd_op_reply(263 gc.14 [call] v33'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.519+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:22:33.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.519+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:264 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 90 ==== osd_op_reply(264 gc.15 [call] v33'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:265 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 91 ==== osd_op_reply(265 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:266 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b139820 2024-09-12T00:22:33.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 92 ==== osd_op_reply(266 gc.15 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:267 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 93 ==== osd_op_reply(267 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 94 ==== osd_op_reply(268 gc.15 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.523+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.527+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 95 ==== osd_op_reply(269 gc.15 [call] v33'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.527+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:22:33.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.527+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:270 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.527+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 59 ==== osd_op_reply(270 gc.16 [call] v33'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.527+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:271 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 60 ==== osd_op_reply(271 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:272 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x7f1c70021020 2024-09-12T00:22:33.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 61 ==== osd_op_reply(272 gc.16 [call out=24b] v0'0 uv97 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.532 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:273 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 62 ==== osd_op_reply(273 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 63 ==== osd_op_reply(274 gc.16 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.531+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x7f1c70021020 2024-09-12T00:22:33.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 64 ==== osd_op_reply(275 gc.16 [call] v33'98 uv98 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:22:33.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:276 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 96 ==== osd_op_reply(276 gc.17 [call] v33'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:277 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 97 ==== osd_op_reply(277 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:278 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b139820 2024-09-12T00:22:33.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 98 ==== osd_op_reply(278 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.535+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:279 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 99 ==== osd_op_reply(279 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:280 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 100 ==== osd_op_reply(280 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:281 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b139820 2024-09-12T00:22:33.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 101 ==== osd_op_reply(281 gc.17 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:22:33.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.539+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:282 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 54 ==== osd_op_reply(282 gc.18 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:283 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 55 ==== osd_op_reply(283 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:284 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 56 ==== osd_op_reply(284 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:285 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 57 ==== osd_op_reply(285 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:286 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 58 ==== osd_op_reply(286 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.543+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:287 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.547+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 59 ==== osd_op_reply(287 gc.18 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.547+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:22:33.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.547+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:288 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 60 ==== osd_op_reply(288 gc.19 [call] v33'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:289 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 61 ==== osd_op_reply(289 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:290 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17eda0 con 0x56357b134e50 2024-09-12T00:22:33.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 62 ==== osd_op_reply(290 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:291 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 63 ==== osd_op_reply(291 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:22:33.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.551+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:292 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.555+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 64 ==== osd_op_reply(292 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.555+0000 7f1c7b1619c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:22:33.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.555+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:293 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b17e9b0 con 0x56357b134e50 2024-09-12T00:22:33.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.555+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 65 ==== osd_op_reply(293 gc.19 [call] v33'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.559+0000 7f1b2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:33.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.559+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94787698184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b14e260 con 0x56357b134e50 2024-09-12T00:22:33.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.559+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94787698184112] v33'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.559+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94787698159824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b144f70 con 0x7f1c70021020 2024-09-12T00:22:33.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94787698159824] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c7b1619c0 20 remove_watcher() i=0 2024-09-12T00:22:33.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c7b1619c0 2 removed watcher, disabling cache 2024-09-12T00:22:33.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94787698161056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b144f70 con 0x56357b134e50 2024-09-12T00:22:33.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94787698161056] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c7b1619c0 20 remove_watcher() i=1 2024-09-12T00:22:33.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.563+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94787698170592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b13f5a0 con 0x56357b139820 2024-09-12T00:22:33.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c79468640 1 -- 172.21.15.66:0/510980935 <== osd.3 v2:172.21.15.66:6816/2782209626 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94787698170592] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c70064040 con 0x56357b139820 2024-09-12T00:22:33.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c7b1619c0 20 remove_watcher() i=2 2024-09-12T00:22:33.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94787698174368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b13f5a0 con 0x7f1c70021020 2024-09-12T00:22:33.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c78c67640 1 -- 172.21.15.66:0/510980935 <== osd.2 v2:172.21.15.66:6800/1272812173 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94787698174368] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c680d0070 con 0x7f1c70021020 2024-09-12T00:22:33.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c7b1619c0 20 remove_watcher() i=3 2024-09-12T00:22:33.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.567+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94787698172800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1429a0 con 0x56357b134e50 2024-09-12T00:22:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.571+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.1 v2:172.21.15.66:6808/1373122057 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94787698172800] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x56357b134e50 2024-09-12T00:22:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.571+0000 7f1c7b1619c0 20 remove_watcher() i=4 2024-09-12T00:22:33.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.571+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94787698180720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b13f5a0 con 0x7f1c680c9070 2024-09-12T00:22:33.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.575+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 64 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94787698180720] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.575+0000 7f1c7b1619c0 20 remove_watcher() i=5 2024-09-12T00:22:33.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.575+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94787698177968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b142380 con 0x7f1c680c9070 2024-09-12T00:22:33.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 65 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94787698177968] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c7b1619c0 20 remove_watcher() i=6 2024-09-12T00:22:33.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94787698182992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56357b1429a0 con 0x7f1c680c9070 2024-09-12T00:22:33.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 <== osd.0 v2:172.21.15.31:6800/3108862692 66 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94787698182992] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c6c039040 con 0x7f1c680c9070 2024-09-12T00:22:33.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c7b1619c0 20 remove_watcher() i=7 2024-09-12T00:22:33.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1c680c9070 msgr2=0x7f1c680eb900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.579+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7f1c680c9070 0x7f1c680eb900 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357b134e50 msgr2=0x56357b1372e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357b134e50 0x56357b1372e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1c70021020 msgr2=0x7f1c70034a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f1c70021020 0x7f1c70034a30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b139820 msgr2=0x56357b13bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b139820 0x56357b13bc10 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b44039a70 msgr2=0x7f1b4403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b44039a70 0x7f1b4403bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801ae00 tx=0x7f1c680db000 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 msgr2=0x56357b129880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/510980935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b123350 0x56357b129880 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1c70016cd0 tx=0x7f1c70050040 comp rx=0 tx=0).stop 2024-09-12T00:22:33.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 reap_dead start 2024-09-12T00:22:33.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c78466640 1 -- 172.21.15.66:0/510980935 reap_dead start 2024-09-12T00:22:33.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 shutdown_connections 2024-09-12T00:22:33.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 >> 172.21.15.66:0/510980935 conn(0x56357b11e770 msgr2=0x56357b11c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 shutdown_connections 2024-09-12T00:22:33.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/510980935 wait complete. 2024-09-12T00:22:33.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 msgr2=0x7f1b5003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 0x7f1b5003bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c680d1df0 tx=0x7f1c680b47b0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 msgr2=0x56357b115e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x56357b0fc2d0 tx=0x7f1c7000bf50 comp rx=0 tx=0).stop 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 shutdown_connections 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b50039ac0 0x7f1b5003bf80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/2501792726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357b115a40 0x56357b115e60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 >> 172.21.15.66:0/2501792726 conn(0x56357b10b3f0 msgr2=0x56357b10b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 shutdown_connections 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/2501792726 wait complete. 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 msgr2=0x56357b1020b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 0x56357b1020b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 msgr2=0x56357b106c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 0x56357b106c60 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 msgr2=0x7f1b6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 0x7f1b6003bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c004180 tx=0x7f1c6c001340 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 msgr2=0x56357b0faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1c68019680 tx=0x7f1c68017d70 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 shutdown_connections 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x56357b104870 0x56357b106c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x56357af7ab90 0x56357b1020b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f1b60039a70 0x7f1b6003bf30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 --2- 172.21.15.66:0/3615123405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56357af7a7b0 0x56357b0faf40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 >> 172.21.15.66:0/3615123405 conn(0x56357b000e90 msgr2=0x56357b0ee120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 shutdown_connections 2024-09-12T00:22:33.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T00:22:33.583+0000 7f1c7b1619c0 1 -- 172.21.15.66:0/3615123405 wait complete. 2024-09-12T00:22:33.601 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T00:22:33.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:22:33.610 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:22:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f9056a4b640 1 Processor -- start 2024-09-12T00:22:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f9056a4b640 1 -- start start 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f9056a4b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9050111890 0x7f9050132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f9056a4b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9050073a90 con 0x7f9050110da0 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f9056a4b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f90500696e0 con 0x7f9050111890 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9050111890 0x7f9050132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9050110da0 0x7f9050111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50890/0 (socket says 172.21.15.31:50890) 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9050111890 0x7f9050132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45456/0 (socket says 172.21.15.31:45456) 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904ffff640 1 -- 172.21.15.31:0/1284239672 learned_addr learned my addr 172.21.15.31:0/1284239672 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904f7fe640 1 -- 172.21.15.31:0/1284239672 >> v1:172.21.15.31:6789/0 conn(0x7f9050110da0 legacy=0x7f9050111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904f7fe640 1 -- 172.21.15.31:0/1284239672 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905006dd50 con 0x7f9050111890 2024-09-12T00:22:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904f7fe640 1 --2- 172.21.15.31:0/1284239672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050111890 0x7f9050132450 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9044009740 tx=0x7f904401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0236ce7eafaa2de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904effd640 1 -- 172.21.15.31:0/1284239672 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440b0070 con 0x7f9050111890 2024-09-12T00:22:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904effd640 1 -- 172.21.15.31:0/1284239672 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440ab530 con 0x7f9050111890 2024-09-12T00:22:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.743+0000 7f904effd640 1 -- 172.21.15.31:0/1284239672 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90440ab830 con 0x7f9050111890 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/1284239672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050111890 msgr2=0x7f9050132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 --2- 172.21.15.31:0/1284239672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050111890 0x7f9050132450 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9044009740 tx=0x7f904401c370 comp rx=0 tx=0).stop 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/1284239672 shutdown_connections 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 --2- 172.21.15.31:0/1284239672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050111890 0x7f9050132450 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/1284239672 >> 172.21.15.31:0/1284239672 conn(0x7f9050070900 msgr2=0x7f9050072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/1284239672 shutdown_connections 2024-09-12T00:22:33.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/1284239672 wait complete. 2024-09-12T00:22:33.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 Processor -- start 2024-09-12T00:22:33.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- start start 2024-09-12T00:22:33.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9050135330 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45468/0 (socket says 172.21.15.31:45468) 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904ffff640 1 -- 172.21.15.31:0/3968477932 learned_addr learned my addr 172.21.15.31:0/3968477932 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904ffff640 1 -- 172.21.15.31:0/3968477932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905012fd80 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904ffff640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f904000c480 tx=0x7f904000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9040017070 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9040005c20 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905012f950 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90400070d0 con 0x7f9050110da0 2024-09-12T00:22:33.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.747+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9050122a30 con 0x7f9050110da0 2024-09-12T00:22:33.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f904001a070 con 0x7f9050110da0 2024-09-12T00:22:33.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9050111180 con 0x7f9050110da0 2024-09-12T00:22:33.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f904cff9640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 0x7f903c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:33.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f904004eb10 con 0x7f9050110da0 2024-09-12T00:22:33.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f904f7fe640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 0x7f903c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:33.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.751+0000 7f904f7fe640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 0x7f903c03d6c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad000 tx=0x7f90440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:33.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.755+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f904001ada0 con 0x7f9050110da0 2024-09-12T00:22:33.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.923+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9050130060 con 0x7f903c03b200 2024-09-12T00:22:33.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.967+0000 7f904cff9640 1 -- 172.21.15.31:0/3968477932 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665821 (secure 0 0 0) 0x7f90440ab500 con 0x7f903c03b200 2024-09-12T00:22:33.975 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:33.982 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:22:33.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 msgr2=0x7f903c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 0x7f903c03d6c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f90440ad000 tx=0x7f90440a6000 comp rx=0 tx=0).stop 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 msgr2=0x7f9050130c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f904000c480 tx=0x7f904000c940 comp rx=0 tx=0).stop 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 shutdown_connections 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f903c03b200 0x7f903c03d6c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 --2- 172.21.15.31:0/3968477932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9050110da0 0x7f9050130c40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 >> 172.21.15.31:0/3968477932 conn(0x7f9050070900 msgr2=0x7f905012ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 shutdown_connections 2024-09-12T00:22:33.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:33.975+0000 7f9056a4b640 1 -- 172.21.15.31:0/3968477932 wait complete. 2024-09-12T00:22:33.998 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T00:22:32.615627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5185,"num_read_kb":4735,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190396,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296964,"statfs":{"total":386547056640,"available":386352091136,"internally_reserved":0,"allocated":41676800,"data_stored":40498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":153216793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006361"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.406715+0000","last_change":"2024-09-12T00:18:44.202329+0000","last_active":"2024-09-12T00:21:00.406715+0000","last_peered":"2024-09-12T00:21:00.406715+0000","last_clean":"2024-09-12T00:21:00.406715+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:21:00.406715+0000","last_undegraded":"2024-09-12T00:21:00.406715+0000","last_fullsized":"2024-09-12T00:21:00.406715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903656+0000","last_change":"2024-09-12T00:18:46.211272+0000","last_active":"2024-09-12T00:22:01.903656+0000","last_peered":"2024-09-12T00:22:01.903656+0000","last_clean":"2024-09-12T00:22:01.903656+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:22:01.903656+0000","last_undegraded":"2024-09-12T00:22:01.903656+0000","last_fullsized":"2024-09-12T00:22:01.903656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.762232+0000","last_change":"2024-09-12T00:18:44.198567+0000","last_active":"2024-09-12T00:19:31.762232+0000","last_peered":"2024-09-12T00:19:31.762232+0000","last_clean":"2024-09-12T00:19:31.762232+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:19:31.762232+0000","last_undegraded":"2024-09-12T00:19:31.762232+0000","last_fullsized":"2024-09-12T00:19:31.762232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.320029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.728342+0000","last_change":"2024-09-12T00:18:44.210055+0000","last_active":"2024-09-12T00:21:00.728342+0000","last_peered":"2024-09-12T00:21:00.728342+0000","last_clean":"2024-09-12T00:21:00.728342+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:21:00.728342+0000","last_undegraded":"2024-09-12T00:21:00.728342+0000","last_fullsized":"2024-09-12T00:21:00.728342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:52.123986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.423882+0000","last_change":"2024-09-12T00:18:44.194458+0000","last_active":"2024-09-12T00:22:01.423882+0000","last_peered":"2024-09-12T00:22:01.423882+0000","last_clean":"2024-09-12T00:22:01.423882+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:01.423882+0000","last_undegraded":"2024-09-12T00:22:01.423882+0000","last_fullsized":"2024-09-12T00:22:01.423882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286428+0000","last_change":"2024-09-12T00:18:44.206065+0000","last_active":"2024-09-12T00:19:24.286428+0000","last_peered":"2024-09-12T00:19:24.286428+0000","last_clean":"2024-09-12T00:19:24.286428+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:19:24.286428+0000","last_undegraded":"2024-09-12T00:19:24.286428+0000","last_fullsized":"2024-09-12T00:19:24.286428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:40.433166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.032972+0000","last_change":"2024-09-12T00:18:46.205029+0000","last_active":"2024-09-12T00:22:02.032972+0000","last_peered":"2024-09-12T00:22:02.032972+0000","last_clean":"2024-09-12T00:22:02.032972+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:22:02.032972+0000","last_undegraded":"2024-09-12T00:22:02.032972+0000","last_fullsized":"2024-09-12T00:22:02.032972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267456+0000","last_change":"2024-09-12T00:18:44.218601+0000","last_active":"2024-09-12T00:19:24.267456+0000","last_peered":"2024-09-12T00:19:24.267456+0000","last_clean":"2024-09-12T00:19:24.267456+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:19:24.267456+0000","last_undegraded":"2024-09-12T00:19:24.267456+0000","last_fullsized":"2024-09-12T00:19:24.267456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903829+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.903829+0000","last_peered":"2024-09-12T00:22:01.903829+0000","last_clean":"2024-09-12T00:22:01.903829+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.903829+0000","last_undegraded":"2024-09-12T00:22:01.903829+0000","last_fullsized":"2024-09-12T00:22:01.903829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:35.703562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278516+0000","last_change":"2024-09-12T00:18:44.193805+0000","last_active":"2024-09-12T00:19:24.278516+0000","last_peered":"2024-09-12T00:19:24.278516+0000","last_clean":"2024-09-12T00:19:24.278516+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:19:24.278516+0000","last_undegraded":"2024-09-12T00:19:24.278516+0000","last_fullsized":"2024-09-12T00:19:24.278516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:36.997859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279902+0000","last_change":"2024-09-12T00:18:46.207506+0000","last_active":"2024-09-12T00:19:24.279902+0000","last_peered":"2024-09-12T00:19:24.279902+0000","last_clean":"2024-09-12T00:19:24.279902+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:19:24.279902+0000","last_undegraded":"2024-09-12T00:19:24.279902+0000","last_fullsized":"2024-09-12T00:19:24.279902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.213594+0000","last_change":"2024-09-12T00:18:44.218215+0000","last_active":"2024-09-12T00:19:30.213594+0000","last_peered":"2024-09-12T00:19:30.213594+0000","last_clean":"2024-09-12T00:19:30.213594+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:19:30.213594+0000","last_undegraded":"2024-09-12T00:19:30.213594+0000","last_fullsized":"2024-09-12T00:19:30.213594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685897+0000","last_change":"2024-09-12T00:18:46.186627+0000","last_active":"2024-09-12T00:22:01.685897+0000","last_peered":"2024-09-12T00:22:01.685897+0000","last_clean":"2024-09-12T00:22:01.685897+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:22:01.685897+0000","last_undegraded":"2024-09-12T00:22:01.685897+0000","last_fullsized":"2024-09-12T00:22:01.685897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290994+0000","last_change":"2024-09-12T00:18:44.212848+0000","last_active":"2024-09-12T00:19:24.290994+0000","last_peered":"2024-09-12T00:19:24.290994+0000","last_clean":"2024-09-12T00:19:24.290994+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:19:24.290994+0000","last_undegraded":"2024-09-12T00:19:24.290994+0000","last_fullsized":"2024-09-12T00:19:24.290994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:33.310089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.925305+0000","last_change":"2024-09-12T00:18:46.194590+0000","last_active":"2024-09-12T00:22:01.925305+0000","last_peered":"2024-09-12T00:22:01.925305+0000","last_clean":"2024-09-12T00:22:01.925305+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:22:01.925305+0000","last_undegraded":"2024-09-12T00:22:01.925305+0000","last_fullsized":"2024-09-12T00:22:01.925305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279673+0000","last_change":"2024-09-12T00:18:44.202523+0000","last_active":"2024-09-12T00:19:24.279673+0000","last_peered":"2024-09-12T00:19:24.279673+0000","last_clean":"2024-09-12T00:19:24.279673+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:19:24.279673+0000","last_undegraded":"2024-09-12T00:19:24.279673+0000","last_fullsized":"2024-09-12T00:19:24.279673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904113+0000","last_change":"2024-09-12T00:18:46.203242+0000","last_active":"2024-09-12T00:22:01.904113+0000","last_peered":"2024-09-12T00:22:01.904113+0000","last_clean":"2024-09-12T00:22:01.904113+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:22:01.904113+0000","last_undegraded":"2024-09-12T00:22:01.904113+0000","last_fullsized":"2024-09-12T00:22:01.904113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:24.643819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.284256+0000","last_change":"2024-09-12T00:18:44.214172+0000","last_active":"2024-09-12T00:19:24.284256+0000","last_peered":"2024-09-12T00:19:24.284256+0000","last_clean":"2024-09-12T00:19:24.284256+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:19:24.284256+0000","last_undegraded":"2024-09-12T00:19:24.284256+0000","last_fullsized":"2024-09-12T00:19:24.284256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035956+0000","last_change":"2024-09-12T00:18:46.196617+0000","last_active":"2024-09-12T00:22:02.035956+0000","last_peered":"2024-09-12T00:22:02.035956+0000","last_clean":"2024-09-12T00:22:02.035956+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:22:02.035956+0000","last_undegraded":"2024-09-12T00:22:02.035956+0000","last_fullsized":"2024-09-12T00:22:02.035956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602719+0000","last_change":"2024-09-12T00:18:44.204026+0000","last_active":"2024-09-12T00:21:12.602719+0000","last_peered":"2024-09-12T00:21:12.602719+0000","last_clean":"2024-09-12T00:21:12.602719+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:21:12.602719+0000","last_undegraded":"2024-09-12T00:21:12.602719+0000","last_fullsized":"2024-09-12T00:21:12.602719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092738+0000","last_change":"2024-09-12T00:18:46.189741+0000","last_active":"2024-09-12T00:22:02.092738+0000","last_peered":"2024-09-12T00:22:02.092738+0000","last_clean":"2024-09-12T00:22:02.092738+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:22:02.092738+0000","last_undegraded":"2024-09-12T00:22:02.092738+0000","last_fullsized":"2024-09-12T00:22:02.092738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550714+0000","last_change":"2024-09-12T00:18:44.216492+0000","last_active":"2024-09-12T00:19:24.550714+0000","last_peered":"2024-09-12T00:19:24.550714+0000","last_clean":"2024-09-12T00:19:24.550714+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:19:24.550714+0000","last_undegraded":"2024-09-12T00:19:24.550714+0000","last_fullsized":"2024-09-12T00:19:24.550714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.545686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'5","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602774+0000","last_change":"2024-09-12T00:18:46.187100+0000","last_active":"2024-09-12T00:21:12.602774+0000","last_peered":"2024-09-12T00:21:12.602774+0000","last_clean":"2024-09-12T00:21:12.602774+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:21:12.602774+0000","last_undegraded":"2024-09-12T00:21:12.602774+0000","last_fullsized":"2024-09-12T00:21:12.602774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.865459+0000","last_change":"2024-09-12T00:18:44.194821+0000","last_active":"2024-09-12T00:22:01.865459+0000","last_peered":"2024-09-12T00:22:01.865459+0000","last_clean":"2024-09-12T00:22:01.865459+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:22:01.865459+0000","last_undegraded":"2024-09-12T00:22:01.865459+0000","last_fullsized":"2024-09-12T00:22:01.865459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:26.427367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.466162+0000","last_change":"2024-09-12T00:18:46.181776+0000","last_active":"2024-09-12T00:19:31.466162+0000","last_peered":"2024-09-12T00:19:31.466162+0000","last_clean":"2024-09-12T00:19:31.466162+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:19:31.466162+0000","last_undegraded":"2024-09-12T00:19:31.466162+0000","last_fullsized":"2024-09-12T00:19:31.466162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:14.676977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285925+0000","last_change":"2024-09-12T00:18:44.204366+0000","last_active":"2024-09-12T00:19:24.285925+0000","last_peered":"2024-09-12T00:19:24.285925+0000","last_clean":"2024-09-12T00:19:24.285925+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:19:24.285925+0000","last_undegraded":"2024-09-12T00:19:24.285925+0000","last_fullsized":"2024-09-12T00:19:24.285925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.910617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'42","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.252668+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:20:58.252668+0000","last_peered":"2024-09-12T00:20:58.252668+0000","last_clean":"2024-09-12T00:20:58.252668+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:20:58.252668+0000","last_undegraded":"2024-09-12T00:20:58.252668+0000","last_fullsized":"2024-09-12T00:20:58.252668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017652+0000","last_change":"2024-09-12T00:18:46.192637+0000","last_active":"2024-09-12T00:22:02.017652+0000","last_peered":"2024-09-12T00:22:02.017652+0000","last_clean":"2024-09-12T00:22:02.017652+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:22:02.017652+0000","last_undegraded":"2024-09-12T00:22:02.017652+0000","last_fullsized":"2024-09-12T00:22:02.017652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:10.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597537+0000","last_change":"2024-09-12T00:18:44.208808+0000","last_active":"2024-09-12T00:21:07.597537+0000","last_peered":"2024-09-12T00:21:07.597537+0000","last_clean":"2024-09-12T00:21:07.597537+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:21:07.597537+0000","last_undegraded":"2024-09-12T00:21:07.597537+0000","last_fullsized":"2024-09-12T00:21:07.597537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.580130+0000","last_change":"2024-09-12T00:19:24.287113+0000","last_active":"2024-09-12T00:19:27.580130+0000","last_peered":"2024-09-12T00:19:27.580130+0000","last_clean":"2024-09-12T00:19:27.580130+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:19:27.580130+0000","last_undegraded":"2024-09-12T00:19:27.580130+0000","last_fullsized":"2024-09-12T00:19:27.580130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:38.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.467228+0000","last_change":"2024-09-12T00:18:46.189086+0000","last_active":"2024-09-12T00:19:31.467228+0000","last_peered":"2024-09-12T00:19:31.467228+0000","last_clean":"2024-09-12T00:19:31.467228+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:19:31.467228+0000","last_undegraded":"2024-09-12T00:19:31.467228+0000","last_fullsized":"2024-09-12T00:19:31.467228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:41.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277544+0000","last_change":"2024-09-12T00:18:44.204623+0000","last_active":"2024-09-12T00:19:24.277544+0000","last_peered":"2024-09-12T00:19:24.277544+0000","last_clean":"2024-09-12T00:19:24.277544+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:19:24.277544+0000","last_undegraded":"2024-09-12T00:19:24.277544+0000","last_fullsized":"2024-09-12T00:19:24.277544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:49.492628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550915+0000","last_change":"2024-09-12T00:18:48.218518+0000","last_active":"2024-09-12T00:19:24.550915+0000","last_peered":"2024-09-12T00:19:24.550915+0000","last_clean":"2024-09-12T00:19:24.550915+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:19:24.550915+0000","last_undegraded":"2024-09-12T00:19:24.550915+0000","last_fullsized":"2024-09-12T00:19:24.550915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.252605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":383,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453635+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:21:58.453635+0000","last_peered":"2024-09-12T00:21:58.453635+0000","last_clean":"2024-09-12T00:21:58.453635+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:21:58.453635+0000","last_undegraded":"2024-09-12T00:21:58.453635+0000","last_fullsized":"2024-09-12T00:21:58.453635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093892+0000","last_change":"2024-09-12T00:18:46.211042+0000","last_active":"2024-09-12T00:22:02.093892+0000","last_peered":"2024-09-12T00:22:02.093892+0000","last_clean":"2024-09-12T00:22:02.093892+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:02.093892+0000","last_undegraded":"2024-09-12T00:22:02.093892+0000","last_fullsized":"2024-09-12T00:22:02.093892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269812+0000","last_change":"2024-09-12T00:18:44.191237+0000","last_active":"2024-09-12T00:19:24.269812+0000","last_peered":"2024-09-12T00:19:24.269812+0000","last_clean":"2024-09-12T00:19:24.269812+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:19:24.269812+0000","last_undegraded":"2024-09-12T00:19:24.269812+0000","last_fullsized":"2024-09-12T00:19:24.269812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:50.165029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883493+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:20:59.883493+0000","last_peered":"2024-09-12T00:20:59.883493+0000","last_clean":"2024-09-12T00:20:59.883493+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:20:59.883493+0000","last_undegraded":"2024-09-12T00:20:59.883493+0000","last_fullsized":"2024-09-12T00:20:59.883493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.244083+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:20:58.244083+0000","last_peered":"2024-09-12T00:20:58.244083+0000","last_clean":"2024-09-12T00:20:58.244083+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:20:58.244083+0000","last_undegraded":"2024-09-12T00:20:58.244083+0000","last_fullsized":"2024-09-12T00:20:58.244083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.103038+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:02.103038+0000","last_peered":"2024-09-12T00:22:02.103038+0000","last_clean":"2024-09-12T00:22:02.103038+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:02.103038+0000","last_undegraded":"2024-09-12T00:22:02.103038+0000","last_fullsized":"2024-09-12T00:22:02.103038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.270303+0000","last_change":"2024-09-12T00:18:46.214495+0000","last_active":"2024-09-12T00:20:15.270303+0000","last_peered":"2024-09-12T00:20:15.270303+0000","last_clean":"2024-09-12T00:20:15.270303+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:20:15.270303+0000","last_undegraded":"2024-09-12T00:20:15.270303+0000","last_fullsized":"2024-09-12T00:20:15.270303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:26.250264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.890256+0000","last_change":"2024-09-12T00:18:44.202781+0000","last_active":"2024-09-12T00:22:01.890256+0000","last_peered":"2024-09-12T00:22:01.890256+0000","last_clean":"2024-09-12T00:22:01.890256+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:01.890256+0000","last_undegraded":"2024-09-12T00:22:01.890256+0000","last_fullsized":"2024-09-12T00:22:01.890256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272688+0000","last_change":"2024-09-12T00:18:48.204648+0000","last_active":"2024-09-12T00:19:24.272688+0000","last_peered":"2024-09-12T00:19:24.272688+0000","last_clean":"2024-09-12T00:19:24.272688+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:19:24.272688+0000","last_undegraded":"2024-09-12T00:19:24.272688+0000","last_fullsized":"2024-09-12T00:19:24.272688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:46.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'48","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596167+0000","last_change":"2024-09-12T00:18:50.230605+0000","last_active":"2024-09-12T00:21:02.596167+0000","last_peered":"2024-09-12T00:21:02.596167+0000","last_clean":"2024-09-12T00:21:02.596167+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:21:02.596167+0000","last_undegraded":"2024-09-12T00:21:02.596167+0000","last_fullsized":"2024-09-12T00:21:02.596167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:38.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":43,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.022794+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.022794+0000","last_peered":"2024-09-12T00:22:02.022794+0000","last_clean":"2024-09-12T00:22:02.022794+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.022794+0000","last_undegraded":"2024-09-12T00:22:02.022794+0000","last_fullsized":"2024-09-12T00:22:02.022794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:06.675976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'5","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599274+0000","last_change":"2024-09-12T00:18:46.194904+0000","last_active":"2024-09-12T00:20:57.599274+0000","last_peered":"2024-09-12T00:20:57.599274+0000","last_clean":"2024-09-12T00:20:57.599274+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:20:57.599274+0000","last_undegraded":"2024-09-12T00:20:57.599274+0000","last_fullsized":"2024-09-12T00:20:57.599274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596353+0000","last_change":"2024-09-12T00:18:44.198188+0000","last_active":"2024-09-12T00:21:02.596353+0000","last_peered":"2024-09-12T00:21:02.596353+0000","last_clean":"2024-09-12T00:21:02.596353+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:21:02.596353+0000","last_undegraded":"2024-09-12T00:21:02.596353+0000","last_fullsized":"2024-09-12T00:21:02.596353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:18.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544308+0000","last_change":"2024-09-12T00:18:48.205812+0000","last_active":"2024-09-12T00:19:24.544308+0000","last_peered":"2024-09-12T00:19:24.544308+0000","last_clean":"2024-09-12T00:19:24.544308+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:19:24.544308+0000","last_undegraded":"2024-09-12T00:19:24.544308+0000","last_fullsized":"2024-09-12T00:19:24.544308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.485115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.227739+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:20:58.227739+0000","last_peered":"2024-09-12T00:20:58.227739+0000","last_clean":"2024-09-12T00:20:58.227739+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:20:58.227739+0000","last_undegraded":"2024-09-12T00:20:58.227739+0000","last_fullsized":"2024-09-12T00:20:58.227739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544349+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:19:24.544349+0000","last_peered":"2024-09-12T00:19:24.544349+0000","last_clean":"2024-09-12T00:19:24.544349+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:19:24.544349+0000","last_undegraded":"2024-09-12T00:19:24.544349+0000","last_fullsized":"2024-09-12T00:19:24.544349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:09.229873+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:20:09.229873+0000","last_peered":"2024-09-12T00:20:09.229873+0000","last_clean":"2024-09-12T00:20:09.229873+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:20:09.229873+0000","last_undegraded":"2024-09-12T00:20:09.229873+0000","last_fullsized":"2024-09-12T00:20:09.229873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.249738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092735+0000","last_change":"2024-09-12T00:18:46.190345+0000","last_active":"2024-09-12T00:22:02.092735+0000","last_peered":"2024-09-12T00:22:02.092735+0000","last_clean":"2024-09-12T00:22:02.092735+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:02.092735+0000","last_undegraded":"2024-09-12T00:22:02.092735+0000","last_fullsized":"2024-09-12T00:22:02.092735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:58.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.210951+0000","last_change":"2024-09-12T00:18:44.213120+0000","last_active":"2024-09-12T00:19:30.210951+0000","last_peered":"2024-09-12T00:19:30.210951+0000","last_clean":"2024-09-12T00:19:30.210951+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:19:30.210951+0000","last_undegraded":"2024-09-12T00:19:30.210951+0000","last_fullsized":"2024-09-12T00:19:30.210951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:49.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.551564+0000","last_change":"2024-09-12T00:18:48.206891+0000","last_active":"2024-09-12T00:19:24.551564+0000","last_peered":"2024-09-12T00:19:24.551564+0000","last_clean":"2024-09-12T00:19:24.551564+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:19:24.551564+0000","last_undegraded":"2024-09-12T00:19:24.551564+0000","last_fullsized":"2024-09-12T00:19:24.551564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.261684+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:20:58.261684+0000","last_peered":"2024-09-12T00:20:58.261684+0000","last_clean":"2024-09-12T00:20:58.261684+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:20:58.261684+0000","last_undegraded":"2024-09-12T00:20:58.261684+0000","last_fullsized":"2024-09-12T00:20:58.261684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.032481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":350,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.457576+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:02.457576+0000","last_peered":"2024-09-12T00:22:02.457576+0000","last_clean":"2024-09-12T00:22:02.457576+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:02.457576+0000","last_undegraded":"2024-09-12T00:22:02.457576+0000","last_fullsized":"2024-09-12T00:22:02.457576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548388+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:19:24.548388+0000","last_peered":"2024-09-12T00:19:24.548388+0000","last_clean":"2024-09-12T00:19:24.548388+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:19:24.548388+0000","last_undegraded":"2024-09-12T00:19:24.548388+0000","last_fullsized":"2024-09-12T00:19:24.548388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:44.410375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903715+0000","last_change":"2024-09-12T00:18:46.184028+0000","last_active":"2024-09-12T00:22:01.903715+0000","last_peered":"2024-09-12T00:22:01.903715+0000","last_clean":"2024-09-12T00:22:01.903715+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:01.903715+0000","last_undegraded":"2024-09-12T00:22:01.903715+0000","last_fullsized":"2024-09-12T00:22:01.903715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291451+0000","last_change":"2024-09-12T00:18:44.210945+0000","last_active":"2024-09-12T00:19:24.291451+0000","last_peered":"2024-09-12T00:19:24.291451+0000","last_clean":"2024-09-12T00:19:24.291451+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:19:24.291451+0000","last_undegraded":"2024-09-12T00:19:24.291451+0000","last_fullsized":"2024-09-12T00:19:24.291451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.463659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.574695+0000","last_change":"2024-09-12T00:19:24.275470+0000","last_active":"2024-09-12T00:19:27.574695+0000","last_peered":"2024-09-12T00:19:27.574695+0000","last_clean":"2024-09-12T00:19:27.574695+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:19:27.574695+0000","last_undegraded":"2024-09-12T00:19:27.574695+0000","last_fullsized":"2024-09-12T00:19:27.574695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:26.076062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":135,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.264136+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:20:58.264136+0000","last_peered":"2024-09-12T00:20:58.264136+0000","last_clean":"2024-09-12T00:20:58.264136+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:20:58.264136+0000","last_undegraded":"2024-09-12T00:20:58.264136+0000","last_fullsized":"2024-09-12T00:20:58.264136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.313371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543403+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:19:24.543403+0000","last_peered":"2024-09-12T00:19:24.543403+0000","last_clean":"2024-09-12T00:19:24.543403+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:19:24.543403+0000","last_undegraded":"2024-09-12T00:19:24.543403+0000","last_fullsized":"2024-09-12T00:19:24.543403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394734+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.394734+0000","last_peered":"2024-09-12T00:22:02.394734+0000","last_clean":"2024-09-12T00:22:02.394734+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.394734+0000","last_undegraded":"2024-09-12T00:22:02.394734+0000","last_fullsized":"2024-09-12T00:22:02.394734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:35.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.019375+0000","last_change":"2024-09-12T00:19:24.302900+0000","last_active":"2024-09-12T00:22:02.019375+0000","last_peered":"2024-09-12T00:22:02.019375+0000","last_clean":"2024-09-12T00:22:02.019375+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:02.019375+0000","last_undegraded":"2024-09-12T00:22:02.019375+0000","last_fullsized":"2024-09-12T00:22:02.019375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:27.149764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548407+0000","last_change":"2024-09-12T00:18:44.182390+0000","last_active":"2024-09-12T00:19:24.548407+0000","last_peered":"2024-09-12T00:19:24.548407+0000","last_clean":"2024-09-12T00:19:24.548407+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:19:24.548407+0000","last_undegraded":"2024-09-12T00:19:24.548407+0000","last_fullsized":"2024-09-12T00:19:24.548407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.955106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275681+0000","last_change":"2024-09-12T00:18:48.205192+0000","last_active":"2024-09-12T00:19:24.275681+0000","last_peered":"2024-09-12T00:19:24.275681+0000","last_clean":"2024-09-12T00:19:24.275681+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:19:24.275681+0000","last_undegraded":"2024-09-12T00:19:24.275681+0000","last_fullsized":"2024-09-12T00:19:24.275681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:53.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601657+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:21:07.601657+0000","last_peered":"2024-09-12T00:21:07.601657+0000","last_clean":"2024-09-12T00:21:07.601657+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:21:07.601657+0000","last_undegraded":"2024-09-12T00:21:07.601657+0000","last_fullsized":"2024-09-12T00:21:07.601657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.841795+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:20:57.841795+0000","last_peered":"2024-09-12T00:20:57.841795+0000","last_clean":"2024-09-12T00:20:57.841795+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:20:57.841795+0000","last_undegraded":"2024-09-12T00:20:57.841795+0000","last_fullsized":"2024-09-12T00:20:57.841795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949230+0000","last_change":"2024-09-12T00:18:46.214384+0000","last_active":"2024-09-12T00:20:55.949230+0000","last_peered":"2024-09-12T00:20:55.949230+0000","last_clean":"2024-09-12T00:20:55.949230+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:20:55.949230+0000","last_undegraded":"2024-09-12T00:20:55.949230+0000","last_fullsized":"2024-09-12T00:20:55.949230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:32.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.763687+0000","last_change":"2024-09-12T00:18:44.195641+0000","last_active":"2024-09-12T00:19:31.763687+0000","last_peered":"2024-09-12T00:19:31.763687+0000","last_clean":"2024-09-12T00:19:31.763687+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:19:31.763687+0000","last_undegraded":"2024-09-12T00:19:31.763687+0000","last_fullsized":"2024-09-12T00:19:31.763687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:32.850697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544223+0000","last_change":"2024-09-12T00:18:48.206321+0000","last_active":"2024-09-12T00:19:24.544223+0000","last_peered":"2024-09-12T00:19:24.544223+0000","last_clean":"2024-09-12T00:19:24.544223+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:19:24.544223+0000","last_undegraded":"2024-09-12T00:19:24.544223+0000","last_fullsized":"2024-09-12T00:19:24.544223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.756623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276459+0000","last_change":"2024-09-12T00:18:50.208134+0000","last_active":"2024-09-12T00:20:58.276459+0000","last_peered":"2024-09-12T00:20:58.276459+0000","last_clean":"2024-09-12T00:20:58.276459+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:20:58.276459+0000","last_undegraded":"2024-09-12T00:20:58.276459+0000","last_fullsized":"2024-09-12T00:20:58.276459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:41.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":433,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394603+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:02.394603+0000","last_peered":"2024-09-12T00:22:02.394603+0000","last_clean":"2024-09-12T00:22:02.394603+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:02.394603+0000","last_undegraded":"2024-09-12T00:22:02.394603+0000","last_fullsized":"2024-09-12T00:22:02.394603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600068+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:21:02.600068+0000","last_peered":"2024-09-12T00:21:02.600068+0000","last_clean":"2024-09-12T00:21:02.600068+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:21:02.600068+0000","last_undegraded":"2024-09-12T00:21:02.600068+0000","last_fullsized":"2024-09-12T00:21:02.600068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:32.549319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950683+0000","last_change":"2024-09-12T00:18:46.190811+0000","last_active":"2024-09-12T00:20:55.950683+0000","last_peered":"2024-09-12T00:20:55.950683+0000","last_clean":"2024-09-12T00:20:55.950683+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:20:55.950683+0000","last_undegraded":"2024-09-12T00:20:55.950683+0000","last_fullsized":"2024-09-12T00:20:55.950683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280196+0000","last_change":"2024-09-12T00:18:44.209954+0000","last_active":"2024-09-12T00:19:24.280196+0000","last_peered":"2024-09-12T00:19:24.280196+0000","last_clean":"2024-09-12T00:19:24.280196+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:19:24.280196+0000","last_undegraded":"2024-09-12T00:19:24.280196+0000","last_fullsized":"2024-09-12T00:19:24.280196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:56.345709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883129+0000","last_change":"2024-09-12T00:18:48.204097+0000","last_active":"2024-09-12T00:20:59.883129+0000","last_peered":"2024-09-12T00:20:59.883129+0000","last_clean":"2024-09-12T00:20:59.883129+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:20:59.883129+0000","last_undegraded":"2024-09-12T00:20:59.883129+0000","last_fullsized":"2024-09-12T00:20:59.883129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.662454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":470,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.261927+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:02.261927+0000","last_peered":"2024-09-12T00:22:02.261927+0000","last_clean":"2024-09-12T00:22:02.261927+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:02.261927+0000","last_undegraded":"2024-09-12T00:22:02.261927+0000","last_fullsized":"2024-09-12T00:22:02.261927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.229253+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:00.229253+0000","last_peered":"2024-09-12T00:21:00.229253+0000","last_clean":"2024-09-12T00:21:00.229253+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:00.229253+0000","last_undegraded":"2024-09-12T00:21:00.229253+0000","last_fullsized":"2024-09-12T00:21:00.229253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.526537+0000","last_change":"2024-09-12T00:18:46.211756+0000","last_active":"2024-09-12T00:22:01.526537+0000","last_peered":"2024-09-12T00:22:01.526537+0000","last_clean":"2024-09-12T00:22:01.526537+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:01.526537+0000","last_undegraded":"2024-09-12T00:22:01.526537+0000","last_fullsized":"2024-09-12T00:22:01.526537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:58.473396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277734+0000","last_change":"2024-09-12T00:18:44.204521+0000","last_active":"2024-09-12T00:19:24.277734+0000","last_peered":"2024-09-12T00:19:24.277734+0000","last_clean":"2024-09-12T00:19:24.277734+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:19:24.277734+0000","last_undegraded":"2024-09-12T00:19:24.277734+0000","last_fullsized":"2024-09-12T00:19:24.277734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.066094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298901+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:19:24.298901+0000","last_peered":"2024-09-12T00:19:24.298901+0000","last_clean":"2024-09-12T00:19:24.298901+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:19:24.298901+0000","last_undegraded":"2024-09-12T00:19:24.298901+0000","last_fullsized":"2024-09-12T00:19:24.298901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'38","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.254646+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:20:58.254646+0000","last_peered":"2024-09-12T00:20:58.254646+0000","last_clean":"2024-09-12T00:20:58.254646+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:20:58.254646+0000","last_undegraded":"2024-09-12T00:20:58.254646+0000","last_fullsized":"2024-09-12T00:20:58.254646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.191021+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.191021+0000","last_peered":"2024-09-12T00:22:02.191021+0000","last_clean":"2024-09-12T00:22:02.191021+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.191021+0000","last_undegraded":"2024-09-12T00:22:02.191021+0000","last_fullsized":"2024-09-12T00:22:02.191021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:07.414020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:32.603727+0000","last_change":"2024-09-12T00:19:24.294913+0000","last_active":"2024-09-12T00:21:32.603727+0000","last_peered":"2024-09-12T00:21:32.603727+0000","last_clean":"2024-09-12T00:21:32.603727+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:21:32.603727+0000","last_undegraded":"2024-09-12T00:21:32.603727+0000","last_fullsized":"2024-09-12T00:21:32.603727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:01.472976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269684+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:19:24.269684+0000","last_peered":"2024-09-12T00:19:24.269684+0000","last_clean":"2024-09-12T00:19:24.269684+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:19:24.269684+0000","last_undegraded":"2024-09-12T00:19:24.269684+0000","last_fullsized":"2024-09-12T00:19:24.269684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285652+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:19:24.285652+0000","last_peered":"2024-09-12T00:19:24.285652+0000","last_clean":"2024-09-12T00:19:24.285652+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:19:24.285652+0000","last_undegraded":"2024-09-12T00:19:24.285652+0000","last_fullsized":"2024-09-12T00:19:24.285652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.079086+0000","last_change":"2024-09-12T00:18:44.210973+0000","last_active":"2024-09-12T00:22:02.079086+0000","last_peered":"2024-09-12T00:22:02.079086+0000","last_clean":"2024-09-12T00:22:02.079086+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:02.079086+0000","last_undegraded":"2024-09-12T00:22:02.079086+0000","last_fullsized":"2024-09-12T00:22:02.079086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:48.534399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.282323+0000","last_change":"2024-09-12T00:18:48.211948+0000","last_active":"2024-09-12T00:19:24.282323+0000","last_peered":"2024-09-12T00:19:24.282323+0000","last_clean":"2024-09-12T00:19:24.282323+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:19:24.282323+0000","last_undegraded":"2024-09-12T00:19:24.282323+0000","last_fullsized":"2024-09-12T00:19:24.282323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'82","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272194+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:20:58.272194+0000","last_peered":"2024-09-12T00:20:58.272194+0000","last_clean":"2024-09-12T00:20:58.272194+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:20:58.272194+0000","last_undegraded":"2024-09-12T00:20:58.272194+0000","last_fullsized":"2024-09-12T00:20:58.272194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.876704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547510+0000","last_change":"2024-09-12T00:18:52.245007+0000","last_active":"2024-09-12T00:19:24.547510+0000","last_peered":"2024-09-12T00:19:24.547510+0000","last_clean":"2024-09-12T00:19:24.547510+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:19:24.547510+0000","last_undegraded":"2024-09-12T00:19:24.547510+0000","last_fullsized":"2024-09-12T00:19:24.547510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:17.254061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.119534+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.119534+0000","last_peered":"2024-09-12T00:22:02.119534+0000","last_clean":"2024-09-12T00:22:02.119534+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.119534+0000","last_undegraded":"2024-09-12T00:22:02.119534+0000","last_fullsized":"2024-09-12T00:22:02.119534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:46.601602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091794+0000","last_change":"2024-09-12T00:18:46.188276+0000","last_active":"2024-09-12T00:22:02.091794+0000","last_peered":"2024-09-12T00:22:02.091794+0000","last_clean":"2024-09-12T00:22:02.091794+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:22:02.091794+0000","last_undegraded":"2024-09-12T00:22:02.091794+0000","last_fullsized":"2024-09-12T00:22:02.091794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.432662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.273369+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:19:24.273369+0000","last_peered":"2024-09-12T00:19:24.273369+0000","last_clean":"2024-09-12T00:19:24.273369+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:19:24.273369+0000","last_undegraded":"2024-09-12T00:19:24.273369+0000","last_fullsized":"2024-09-12T00:19:24.273369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.949260+0000","last_change":"2024-09-12T00:18:44.198633+0000","last_active":"2024-09-12T00:20:14.949260+0000","last_peered":"2024-09-12T00:20:14.949260+0000","last_clean":"2024-09-12T00:20:14.949260+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:20:14.949260+0000","last_undegraded":"2024-09-12T00:20:14.949260+0000","last_fullsized":"2024-09-12T00:20:14.949260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.301077+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:19:24.301077+0000","last_peered":"2024-09-12T00:19:24.301077+0000","last_clean":"2024-09-12T00:19:24.301077+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:19:24.301077+0000","last_undegraded":"2024-09-12T00:19:24.301077+0000","last_fullsized":"2024-09-12T00:19:24.301077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.126928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":490,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453795+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:21:58.453795+0000","last_peered":"2024-09-12T00:21:58.453795+0000","last_clean":"2024-09-12T00:21:58.453795+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:21:58.453795+0000","last_undegraded":"2024-09-12T00:21:58.453795+0000","last_fullsized":"2024-09-12T00:21:58.453795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.974846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291239+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:19:24.291239+0000","last_peered":"2024-09-12T00:19:24.291239+0000","last_clean":"2024-09-12T00:19:24.291239+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:19:24.291239+0000","last_undegraded":"2024-09-12T00:19:24.291239+0000","last_fullsized":"2024-09-12T00:19:24.291239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:27.494970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.967961+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:20:14.967961+0000","last_peered":"2024-09-12T00:20:14.967961+0000","last_clean":"2024-09-12T00:20:14.967961+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:20:14.967961+0000","last_undegraded":"2024-09-12T00:20:14.967961+0000","last_fullsized":"2024-09-12T00:20:14.967961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.417808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020186+0000","last_change":"2024-09-12T00:18:46.211820+0000","last_active":"2024-09-12T00:22:02.020186+0000","last_peered":"2024-09-12T00:22:02.020186+0000","last_clean":"2024-09-12T00:22:02.020186+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:02.020186+0000","last_undegraded":"2024-09-12T00:22:02.020186+0000","last_fullsized":"2024-09-12T00:22:02.020186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:43.510871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270254+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:19:24.270254+0000","last_peered":"2024-09-12T00:19:24.270254+0000","last_clean":"2024-09-12T00:19:24.270254+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:19:24.270254+0000","last_undegraded":"2024-09-12T00:19:24.270254+0000","last_fullsized":"2024-09-12T00:19:24.270254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.542991+0000","last_change":"2024-09-12T00:18:44.198208+0000","last_active":"2024-09-12T00:19:24.542991+0000","last_peered":"2024-09-12T00:19:24.542991+0000","last_clean":"2024-09-12T00:19:24.542991+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:19:24.542991+0000","last_undegraded":"2024-09-12T00:19:24.542991+0000","last_fullsized":"2024-09-12T00:19:24.542991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:02.437476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275369+0000","last_change":"2024-09-12T00:18:48.197273+0000","last_active":"2024-09-12T00:19:24.275369+0000","last_peered":"2024-09-12T00:19:24.275369+0000","last_clean":"2024-09-12T00:19:24.275369+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:19:24.275369+0000","last_undegraded":"2024-09-12T00:19:24.275369+0000","last_fullsized":"2024-09-12T00:19:24.275369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:31.361645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.454216+0000","last_change":"2024-09-12T00:18:50.235509+0000","last_active":"2024-09-12T00:21:58.454216+0000","last_peered":"2024-09-12T00:21:58.454216+0000","last_clean":"2024-09-12T00:21:58.454216+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:21:58.454216+0000","last_undegraded":"2024-09-12T00:21:58.454216+0000","last_fullsized":"2024-09-12T00:21:58.454216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.659270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545528+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:19:24.545528+0000","last_peered":"2024-09-12T00:19:24.545528+0000","last_clean":"2024-09-12T00:19:24.545528+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:19:24.545528+0000","last_undegraded":"2024-09-12T00:19:24.545528+0000","last_fullsized":"2024-09-12T00:19:24.545528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.515768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274180+0000","last_change":"2024-09-12T00:18:46.200898+0000","last_active":"2024-09-12T00:20:15.274180+0000","last_peered":"2024-09-12T00:20:15.274180+0000","last_clean":"2024-09-12T00:20:15.274180+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:20:15.274180+0000","last_undegraded":"2024-09-12T00:20:15.274180+0000","last_fullsized":"2024-09-12T00:20:15.274180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:07.775807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285725+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:19:24.285725+0000","last_peered":"2024-09-12T00:19:24.285725+0000","last_clean":"2024-09-12T00:19:24.285725+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:19:24.285725+0000","last_undegraded":"2024-09-12T00:19:24.285725+0000","last_fullsized":"2024-09-12T00:19:24.285725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270457+0000","last_change":"2024-09-12T00:18:44.210883+0000","last_active":"2024-09-12T00:19:24.270457+0000","last_peered":"2024-09-12T00:19:24.270457+0000","last_clean":"2024-09-12T00:19:24.270457+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:19:24.270457+0000","last_undegraded":"2024-09-12T00:19:24.270457+0000","last_fullsized":"2024-09-12T00:19:24.270457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547239+0000","last_change":"2024-09-12T00:18:48.208984+0000","last_active":"2024-09-12T00:19:24.547239+0000","last_peered":"2024-09-12T00:19:24.547239+0000","last_clean":"2024-09-12T00:19:24.547239+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:19:24.547239+0000","last_undegraded":"2024-09-12T00:19:24.547239+0000","last_fullsized":"2024-09-12T00:19:24.547239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.522290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.833142+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.833142+0000","last_peered":"2024-09-12T00:22:00.833142+0000","last_clean":"2024-09-12T00:22:00.833142+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.833142+0000","last_undegraded":"2024-09-12T00:22:00.833142+0000","last_fullsized":"2024-09-12T00:22:00.833142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:49.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299271+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:19:24.299271+0000","last_peered":"2024-09-12T00:19:24.299271+0000","last_clean":"2024-09-12T00:19:24.299271+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:19:24.299271+0000","last_undegraded":"2024-09-12T00:19:24.299271+0000","last_fullsized":"2024-09-12T00:19:24.299271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:40.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.160041+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:00.160041+0000","last_peered":"2024-09-12T00:21:00.160041+0000","last_clean":"2024-09-12T00:21:00.160041+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:00.160041+0000","last_undegraded":"2024-09-12T00:21:00.160041+0000","last_fullsized":"2024-09-12T00:21:00.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:16.953577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685978+0000","last_change":"2024-09-12T00:18:46.213096+0000","last_active":"2024-09-12T00:22:01.685978+0000","last_peered":"2024-09-12T00:22:01.685978+0000","last_clean":"2024-09-12T00:22:01.685978+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:01.685978+0000","last_undegraded":"2024-09-12T00:22:01.685978+0000","last_fullsized":"2024-09-12T00:22:01.685978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:49.858730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271876+0000","last_change":"2024-09-12T00:18:44.194766+0000","last_active":"2024-09-12T00:19:24.271876+0000","last_peered":"2024-09-12T00:19:24.271876+0000","last_clean":"2024-09-12T00:19:24.271876+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:19:24.271876+0000","last_undegraded":"2024-09-12T00:19:24.271876+0000","last_fullsized":"2024-09-12T00:19:24.271876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545007+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:19:24.545007+0000","last_peered":"2024-09-12T00:19:24.545007+0000","last_clean":"2024-09-12T00:19:24.545007+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:19:24.545007+0000","last_undegraded":"2024-09-12T00:19:24.545007+0000","last_fullsized":"2024-09-12T00:19:24.545007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597116+0000","last_change":"2024-09-12T00:18:48.207153+0000","last_active":"2024-09-12T00:20:52.597116+0000","last_peered":"2024-09-12T00:20:52.597116+0000","last_clean":"2024-09-12T00:20:52.597116+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:20:52.597116+0000","last_undegraded":"2024-09-12T00:20:52.597116+0000","last_fullsized":"2024-09-12T00:20:52.597116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:40.156001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276330+0000","last_change":"2024-09-12T00:18:50.224303+0000","last_active":"2024-09-12T00:20:58.276330+0000","last_peered":"2024-09-12T00:20:58.276330+0000","last_clean":"2024-09-12T00:20:58.276330+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:20:58.276330+0000","last_undegraded":"2024-09-12T00:20:58.276330+0000","last_fullsized":"2024-09-12T00:20:58.276330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.322839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268956+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:19:24.268956+0000","last_peered":"2024-09-12T00:19:24.268956+0000","last_clean":"2024-09-12T00:19:24.268956+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:19:24.268956+0000","last_undegraded":"2024-09-12T00:19:24.268956+0000","last_fullsized":"2024-09-12T00:19:24.268956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.028206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:32.516814+0000","last_change":"2024-09-12T00:19:24.290331+0000","last_active":"2024-09-12T00:19:32.516814+0000","last_peered":"2024-09-12T00:19:32.516814+0000","last_clean":"2024-09-12T00:19:32.516814+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:19:32.516814+0000","last_undegraded":"2024-09-12T00:19:32.516814+0000","last_fullsized":"2024-09-12T00:19:32.516814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547212+0000","last_change":"2024-09-12T00:18:44.199819+0000","last_active":"2024-09-12T00:19:24.547212+0000","last_peered":"2024-09-12T00:19:24.547212+0000","last_clean":"2024-09-12T00:19:24.547212+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:19:24.547212+0000","last_undegraded":"2024-09-12T00:19:24.547212+0000","last_fullsized":"2024-09-12T00:19:24.547212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:41.074307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292863+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:19:24.292863+0000","last_peered":"2024-09-12T00:19:24.292863+0000","last_clean":"2024-09-12T00:19:24.292863+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:19:24.292863+0000","last_undegraded":"2024-09-12T00:19:24.292863+0000","last_fullsized":"2024-09-12T00:19:24.292863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.303925+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:19:24.303925+0000","last_peered":"2024-09-12T00:19:24.303925+0000","last_clean":"2024-09-12T00:19:24.303925+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:19:24.303925+0000","last_undegraded":"2024-09-12T00:19:24.303925+0000","last_fullsized":"2024-09-12T00:19:24.303925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.689100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274457+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:19:24.274457+0000","last_peered":"2024-09-12T00:19:24.274457+0000","last_clean":"2024-09-12T00:19:24.274457+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:19:24.274457+0000","last_undegraded":"2024-09-12T00:19:24.274457+0000","last_fullsized":"2024-09-12T00:19:24.274457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.218218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":371,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453469+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:21:58.453469+0000","last_peered":"2024-09-12T00:21:58.453469+0000","last_clean":"2024-09-12T00:21:58.453469+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:21:58.453469+0000","last_undegraded":"2024-09-12T00:21:58.453469+0000","last_fullsized":"2024-09-12T00:21:58.453469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949445+0000","last_change":"2024-09-12T00:18:46.215890+0000","last_active":"2024-09-12T00:20:55.949445+0000","last_peered":"2024-09-12T00:20:55.949445+0000","last_clean":"2024-09-12T00:20:55.949445+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:20:55.949445+0000","last_undegraded":"2024-09-12T00:20:55.949445+0000","last_fullsized":"2024-09-12T00:20:55.949445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:46.309362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.873890+0000","last_change":"2024-09-12T00:18:44.212538+0000","last_active":"2024-09-12T00:22:01.873890+0000","last_peered":"2024-09-12T00:22:01.873890+0000","last_clean":"2024-09-12T00:22:01.873890+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:01.873890+0000","last_undegraded":"2024-09-12T00:22:01.873890+0000","last_fullsized":"2024-09-12T00:22:01.873890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.256228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548363+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:19:24.548363+0000","last_peered":"2024-09-12T00:19:24.548363+0000","last_clean":"2024-09-12T00:19:24.548363+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:19:24.548363+0000","last_undegraded":"2024-09-12T00:19:24.548363+0000","last_fullsized":"2024-09-12T00:19:24.548363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291763+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:19:24.291763+0000","last_peered":"2024-09-12T00:19:24.291763+0000","last_clean":"2024-09-12T00:19:24.291763+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:19:24.291763+0000","last_undegraded":"2024-09-12T00:19:24.291763+0000","last_fullsized":"2024-09-12T00:19:24.291763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287632+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:19:24.287632+0000","last_peered":"2024-09-12T00:19:24.287632+0000","last_clean":"2024-09-12T00:19:24.287632+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:19:24.287632+0000","last_undegraded":"2024-09-12T00:19:24.287632+0000","last_fullsized":"2024-09-12T00:19:24.287632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:13.589684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":401,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.426978+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:02.426978+0000","last_peered":"2024-09-12T00:22:02.426978+0000","last_clean":"2024-09-12T00:22:02.426978+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:02.426978+0000","last_undegraded":"2024-09-12T00:22:02.426978+0000","last_fullsized":"2024-09-12T00:22:02.426978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:31.647959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.112613+0000","last_change":"2024-09-12T00:18:46.192554+0000","last_active":"2024-09-12T00:22:02.112613+0000","last_peered":"2024-09-12T00:22:02.112613+0000","last_clean":"2024-09-12T00:22:02.112613+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:02.112613+0000","last_undegraded":"2024-09-12T00:22:02.112613+0000","last_fullsized":"2024-09-12T00:22:02.112613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:28.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288209+0000","last_change":"2024-09-12T00:18:44.208784+0000","last_active":"2024-09-12T00:19:24.288209+0000","last_peered":"2024-09-12T00:19:24.288209+0000","last_clean":"2024-09-12T00:19:24.288209+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:19:24.288209+0000","last_undegraded":"2024-09-12T00:19:24.288209+0000","last_fullsized":"2024-09-12T00:19:24.288209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:59.889965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298936+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:19:24.298936+0000","last_peered":"2024-09-12T00:19:24.298936+0000","last_clean":"2024-09-12T00:19:24.298936+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:19:24.298936+0000","last_undegraded":"2024-09-12T00:19:24.298936+0000","last_fullsized":"2024-09-12T00:19:24.298936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.854016+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:20:59.854016+0000","last_peered":"2024-09-12T00:20:59.854016+0000","last_clean":"2024-09-12T00:20:59.854016+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:20:59.854016+0000","last_undegraded":"2024-09-12T00:20:59.854016+0000","last_fullsized":"2024-09-12T00:20:59.854016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:13.228327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'89","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.240753+0000","last_change":"2024-09-12T00:18:50.216704+0000","last_active":"2024-09-12T00:20:58.240753+0000","last_peered":"2024-09-12T00:20:58.240753+0000","last_clean":"2024-09-12T00:20:58.240753+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:20:58.240753+0000","last_undegraded":"2024-09-12T00:20:58.240753+0000","last_fullsized":"2024-09-12T00:20:58.240753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:30.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545585+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:19:24.545585+0000","last_peered":"2024-09-12T00:19:24.545585+0000","last_clean":"2024-09-12T00:19:24.545585+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:19:24.545585+0000","last_undegraded":"2024-09-12T00:19:24.545585+0000","last_fullsized":"2024-09-12T00:19:24.545585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.985554+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:01.985554+0000","last_peered":"2024-09-12T00:22:01.985554+0000","last_clean":"2024-09-12T00:22:01.985554+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:01.985554+0000","last_undegraded":"2024-09-12T00:22:01.985554+0000","last_fullsized":"2024-09-12T00:22:01.985554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:58.559812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904828+0000","last_change":"2024-09-12T00:18:46.189861+0000","last_active":"2024-09-12T00:22:01.904828+0000","last_peered":"2024-09-12T00:22:01.904828+0000","last_clean":"2024-09-12T00:22:01.904828+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:01.904828+0000","last_undegraded":"2024-09-12T00:22:01.904828+0000","last_fullsized":"2024-09-12T00:22:01.904828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291694+0000","last_change":"2024-09-12T00:18:44.220926+0000","last_active":"2024-09-12T00:19:24.291694+0000","last_peered":"2024-09-12T00:19:24.291694+0000","last_clean":"2024-09-12T00:19:24.291694+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:19:24.291694+0000","last_undegraded":"2024-09-12T00:19:24.291694+0000","last_fullsized":"2024-09-12T00:19:24.291694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:45.017062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279723+0000","last_change":"2024-09-12T00:18:48.216343+0000","last_active":"2024-09-12T00:19:24.279723+0000","last_peered":"2024-09-12T00:19:24.279723+0000","last_clean":"2024-09-12T00:19:24.279723+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:19:24.279723+0000","last_undegraded":"2024-09-12T00:19:24.279723+0000","last_fullsized":"2024-09-12T00:19:24.279723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:54.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.260323+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:20:58.260323+0000","last_peered":"2024-09-12T00:20:58.260323+0000","last_clean":"2024-09-12T00:20:58.260323+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:20:58.260323+0000","last_undegraded":"2024-09-12T00:20:58.260323+0000","last_fullsized":"2024-09-12T00:20:58.260323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.846790+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.846790+0000","last_peered":"2024-09-12T00:20:57.846790+0000","last_clean":"2024-09-12T00:20:57.846790+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.846790+0000","last_undegraded":"2024-09-12T00:20:57.846790+0000","last_fullsized":"2024-09-12T00:20:57.846790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.924187+0000","last_change":"2024-09-12T00:18:46.217714+0000","last_active":"2024-09-12T00:22:01.924187+0000","last_peered":"2024-09-12T00:22:01.924187+0000","last_clean":"2024-09-12T00:22:01.924187+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:01.924187+0000","last_undegraded":"2024-09-12T00:22:01.924187+0000","last_fullsized":"2024-09-12T00:22:01.924187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272131+0000","last_change":"2024-09-12T00:18:44.211179+0000","last_active":"2024-09-12T00:19:24.272131+0000","last_peered":"2024-09-12T00:19:24.272131+0000","last_clean":"2024-09-12T00:19:24.272131+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:19:24.272131+0000","last_undegraded":"2024-09-12T00:19:24.272131+0000","last_fullsized":"2024-09-12T00:19:24.272131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.906157+0000","last_change":"2024-09-12T00:18:46.194089+0000","last_active":"2024-09-12T00:22:01.906157+0000","last_peered":"2024-09-12T00:22:01.906157+0000","last_clean":"2024-09-12T00:22:01.906157+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:01.906157+0000","last_undegraded":"2024-09-12T00:22:01.906157+0000","last_fullsized":"2024-09-12T00:22:01.906157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278439+0000","last_change":"2024-09-12T00:18:44.197793+0000","last_active":"2024-09-12T00:19:24.278439+0000","last_peered":"2024-09-12T00:19:24.278439+0000","last_clean":"2024-09-12T00:19:24.278439+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:19:24.278439+0000","last_undegraded":"2024-09-12T00:19:24.278439+0000","last_fullsized":"2024-09-12T00:19:24.278439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:28.573321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267773+0000","last_change":"2024-09-12T00:18:48.200680+0000","last_active":"2024-09-12T00:19:24.267773+0000","last_peered":"2024-09-12T00:19:24.267773+0000","last_clean":"2024-09-12T00:19:24.267773+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:19:24.267773+0000","last_undegraded":"2024-09-12T00:19:24.267773+0000","last_fullsized":"2024-09-12T00:19:24.267773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'42","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.999610+0000","last_change":"2024-09-12T00:18:50.224287+0000","last_active":"2024-09-12T00:22:00.999610+0000","last_peered":"2024-09-12T00:22:00.999610+0000","last_clean":"2024-09-12T00:22:00.999610+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:22:00.999610+0000","last_undegraded":"2024-09-12T00:22:00.999610+0000","last_fullsized":"2024-09-12T00:22:00.999610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":85,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.705857+0000","last_change":"2024-09-12T00:18:46.214462+0000","last_active":"2024-09-12T00:22:01.705857+0000","last_peered":"2024-09-12T00:22:01.705857+0000","last_clean":"2024-09-12T00:22:01.705857+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:22:01.705857+0000","last_undegraded":"2024-09-12T00:22:01.705857+0000","last_fullsized":"2024-09-12T00:22:01.705857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:37.657684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.472192+0000","last_change":"2024-09-12T00:18:44.196857+0000","last_active":"2024-09-12T00:22:01.472192+0000","last_peered":"2024-09-12T00:22:01.472192+0000","last_clean":"2024-09-12T00:22:01.472192+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:01.472192+0000","last_undegraded":"2024-09-12T00:22:01.472192+0000","last_fullsized":"2024-09-12T00:22:01.472192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.238155+0000","last_change":"2024-09-12T00:18:50.204600+0000","last_active":"2024-09-12T00:20:58.238155+0000","last_peered":"2024-09-12T00:20:58.238155+0000","last_clean":"2024-09-12T00:20:58.238155+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:20:58.238155+0000","last_undegraded":"2024-09-12T00:20:58.238155+0000","last_fullsized":"2024-09-12T00:20:58.238155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.683615+0000","last_change":"2024-09-12T00:18:46.191419+0000","last_active":"2024-09-12T00:22:01.683615+0000","last_peered":"2024-09-12T00:22:01.683615+0000","last_clean":"2024-09-12T00:22:01.683615+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:22:01.683615+0000","last_undegraded":"2024-09-12T00:22:01.683615+0000","last_fullsized":"2024-09-12T00:22:01.683615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:24.777789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.956540+0000","last_change":"2024-09-12T00:18:44.218418+0000","last_active":"2024-09-12T00:19:30.956540+0000","last_peered":"2024-09-12T00:19:30.956540+0000","last_clean":"2024-09-12T00:19:30.956540+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:19:30.956540+0000","last_undegraded":"2024-09-12T00:19:30.956540+0000","last_fullsized":"2024-09-12T00:19:30.956540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:11.461908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550826+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:19:24.550826+0000","last_peered":"2024-09-12T00:19:24.550826+0000","last_clean":"2024-09-12T00:19:24.550826+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:19:24.550826+0000","last_undegraded":"2024-09-12T00:19:24.550826+0000","last_fullsized":"2024-09-12T00:19:24.550826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:10.736641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272148+0000","last_change":"2024-09-12T00:18:50.216262+0000","last_active":"2024-09-12T00:20:58.272148+0000","last_peered":"2024-09-12T00:20:58.272148+0000","last_clean":"2024-09-12T00:20:58.272148+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:20:58.272148+0000","last_undegraded":"2024-09-12T00:20:58.272148+0000","last_fullsized":"2024-09-12T00:20:58.272148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'15","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035728+0000","last_change":"2024-09-12T00:18:46.211034+0000","last_active":"2024-09-12T00:22:02.035728+0000","last_peered":"2024-09-12T00:22:02.035728+0000","last_clean":"2024-09-12T00:22:02.035728+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:22:02.035728+0000","last_undegraded":"2024-09-12T00:22:02.035728+0000","last_fullsized":"2024-09-12T00:22:02.035728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272298+0000","last_change":"2024-09-12T00:18:44.193399+0000","last_active":"2024-09-12T00:19:24.272298+0000","last_peered":"2024-09-12T00:19:24.272298+0000","last_clean":"2024-09-12T00:19:24.272298+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:19:24.272298+0000","last_undegraded":"2024-09-12T00:19:24.272298+0000","last_fullsized":"2024-09-12T00:19:24.272298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293437+0000","last_change":"2024-09-12T00:19:24.291735+0000","last_active":"2024-09-12T00:19:24.293437+0000","last_peered":"2024-09-12T00:19:24.293437+0000","last_clean":"2024-09-12T00:19:24.293437+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:19:24.293437+0000","last_undegraded":"2024-09-12T00:19:24.293437+0000","last_fullsized":"2024-09-12T00:19:24.293437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:24.444471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:22.613326+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:21:22.613326+0000","last_peered":"2024-09-12T00:21:22.613326+0000","last_clean":"2024-09-12T00:21:22.613326+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:21:22.613326+0000","last_undegraded":"2024-09-12T00:21:22.613326+0000","last_fullsized":"2024-09-12T00:21:22.613326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.520849+0000","last_change":"2024-09-12T00:18:46.214392+0000","last_active":"2024-09-12T00:22:01.520849+0000","last_peered":"2024-09-12T00:22:01.520849+0000","last_clean":"2024-09-12T00:22:01.520849+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:22:01.520849+0000","last_undegraded":"2024-09-12T00:22:01.520849+0000","last_fullsized":"2024-09-12T00:22:01.520849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.180192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.769730+0000","last_change":"2024-09-12T00:18:44.202045+0000","last_active":"2024-09-12T00:19:31.769730+0000","last_peered":"2024-09-12T00:19:31.769730+0000","last_clean":"2024-09-12T00:19:31.769730+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:19:31.769730+0000","last_undegraded":"2024-09-12T00:19:31.769730+0000","last_fullsized":"2024-09-12T00:19:31.769730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276461+0000","last_change":"2024-09-12T00:18:48.196567+0000","last_active":"2024-09-12T00:19:24.276461+0000","last_peered":"2024-09-12T00:19:24.276461+0000","last_clean":"2024-09-12T00:19:24.276461+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:19:24.276461+0000","last_undegraded":"2024-09-12T00:19:24.276461+0000","last_fullsized":"2024-09-12T00:19:24.276461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:59.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.830301+0000","last_change":"2024-09-12T00:18:50.222960+0000","last_active":"2024-09-12T00:20:57.830301+0000","last_peered":"2024-09-12T00:20:57.830301+0000","last_clean":"2024-09-12T00:20:57.830301+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:20:57.830301+0000","last_undegraded":"2024-09-12T00:20:57.830301+0000","last_fullsized":"2024-09-12T00:20:57.830301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:40.015121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547263+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:19:24.547263+0000","last_peered":"2024-09-12T00:19:24.547263+0000","last_clean":"2024-09-12T00:19:24.547263+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:19:24.547263+0000","last_undegraded":"2024-09-12T00:19:24.547263+0000","last_fullsized":"2024-09-12T00:19:24.547263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:36.813068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.688555+0000","last_change":"2024-09-12T00:18:46.199141+0000","last_active":"2024-09-12T00:22:01.688555+0000","last_peered":"2024-09-12T00:22:01.688555+0000","last_clean":"2024-09-12T00:22:01.688555+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:01.688555+0000","last_undegraded":"2024-09-12T00:22:01.688555+0000","last_fullsized":"2024-09-12T00:22:01.688555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:15.268348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286089+0000","last_change":"2024-09-12T00:18:44.202449+0000","last_active":"2024-09-12T00:19:24.286089+0000","last_peered":"2024-09-12T00:19:24.286089+0000","last_clean":"2024-09-12T00:19:24.286089+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:19:24.286089+0000","last_undegraded":"2024-09-12T00:19:24.286089+0000","last_fullsized":"2024-09-12T00:19:24.286089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:21.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.297596+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:19:24.297596+0000","last_peered":"2024-09-12T00:19:24.297596+0000","last_clean":"2024-09-12T00:19:24.297596+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:19:24.297596+0000","last_undegraded":"2024-09-12T00:19:24.297596+0000","last_fullsized":"2024-09-12T00:19:24.297596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.140374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453820+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:21:58.453820+0000","last_peered":"2024-09-12T00:21:58.453820+0000","last_clean":"2024-09-12T00:21:58.453820+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:21:58.453820+0000","last_undegraded":"2024-09-12T00:21:58.453820+0000","last_fullsized":"2024-09-12T00:21:58.453820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:47.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904775+0000","last_change":"2024-09-12T00:18:46.184978+0000","last_active":"2024-09-12T00:22:01.904775+0000","last_peered":"2024-09-12T00:22:01.904775+0000","last_clean":"2024-09-12T00:22:01.904775+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:22:01.904775+0000","last_undegraded":"2024-09-12T00:22:01.904775+0000","last_fullsized":"2024-09-12T00:22:01.904775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:34.862818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.670182+0000","last_change":"2024-09-12T00:18:44.200635+0000","last_active":"2024-09-12T00:21:00.670182+0000","last_peered":"2024-09-12T00:21:00.670182+0000","last_clean":"2024-09-12T00:21:00.670182+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:21:00.670182+0000","last_undegraded":"2024-09-12T00:21:00.670182+0000","last_fullsized":"2024-09-12T00:21:00.670182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274386+0000","last_change":"2024-09-12T00:18:48.218098+0000","last_active":"2024-09-12T00:19:24.274386+0000","last_peered":"2024-09-12T00:19:24.274386+0000","last_clean":"2024-09-12T00:19:24.274386+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:19:24.274386+0000","last_undegraded":"2024-09-12T00:19:24.274386+0000","last_fullsized":"2024-09-12T00:19:24.274386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'63","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.603751+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:21:17.603751+0000","last_peered":"2024-09-12T00:21:17.603751+0000","last_clean":"2024-09-12T00:21:17.603751+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:21:17.603751+0000","last_undegraded":"2024-09-12T00:21:17.603751+0000","last_fullsized":"2024-09-12T00:21:17.603751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.110848+0000","last_change":"2024-09-12T00:18:46.184999+0000","last_active":"2024-09-12T00:22:02.110848+0000","last_peered":"2024-09-12T00:22:02.110848+0000","last_clean":"2024-09-12T00:22:02.110848+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:22:02.110848+0000","last_undegraded":"2024-09-12T00:22:02.110848+0000","last_fullsized":"2024-09-12T00:22:02.110848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.882201+0000","last_change":"2024-09-12T00:18:44.212572+0000","last_active":"2024-09-12T00:22:01.882201+0000","last_peered":"2024-09-12T00:22:01.882201+0000","last_clean":"2024-09-12T00:22:01.882201+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:01.882201+0000","last_undegraded":"2024-09-12T00:22:01.882201+0000","last_fullsized":"2024-09-12T00:22:01.882201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.022098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271547+0000","last_change":"2024-09-12T00:18:48.208202+0000","last_active":"2024-09-12T00:19:24.271547+0000","last_peered":"2024-09-12T00:19:24.271547+0000","last_clean":"2024-09-12T00:19:24.271547+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:19:24.271547+0000","last_undegraded":"2024-09-12T00:19:24.271547+0000","last_fullsized":"2024-09-12T00:19:24.271547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.859052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.228341+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:20:58.228341+0000","last_peered":"2024-09-12T00:20:58.228341+0000","last_clean":"2024-09-12T00:20:58.228341+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:20:58.228341+0000","last_undegraded":"2024-09-12T00:20:58.228341+0000","last_fullsized":"2024-09-12T00:20:58.228341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903921+0000","last_change":"2024-09-12T00:18:46.183379+0000","last_active":"2024-09-12T00:22:01.903921+0000","last_peered":"2024-09-12T00:22:01.903921+0000","last_clean":"2024-09-12T00:22:01.903921+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:22:01.903921+0000","last_undegraded":"2024-09-12T00:22:01.903921+0000","last_fullsized":"2024-09-12T00:22:01.903921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:35.985414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548742+0000","last_change":"2024-09-12T00:18:44.217239+0000","last_active":"2024-09-12T00:19:24.548742+0000","last_peered":"2024-09-12T00:19:24.548742+0000","last_clean":"2024-09-12T00:19:24.548742+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:19:24.548742+0000","last_undegraded":"2024-09-12T00:19:24.548742+0000","last_fullsized":"2024-09-12T00:19:24.548742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271418+0000","last_change":"2024-09-12T00:18:48.211981+0000","last_active":"2024-09-12T00:19:24.271418+0000","last_peered":"2024-09-12T00:19:24.271418+0000","last_clean":"2024-09-12T00:19:24.271418+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:19:24.271418+0000","last_undegraded":"2024-09-12T00:19:24.271418+0000","last_fullsized":"2024-09-12T00:19:24.271418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:50.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'32","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.262956+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:20:58.262956+0000","last_peered":"2024-09-12T00:20:58.262956+0000","last_clean":"2024-09-12T00:20:58.262956+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:20:58.262956+0000","last_undegraded":"2024-09-12T00:20:58.262956+0000","last_fullsized":"2024-09-12T00:20:58.262956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'3","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703821+0000","last_change":"2024-09-12T00:18:46.183984+0000","last_active":"2024-09-12T00:22:01.703821+0000","last_peered":"2024-09-12T00:22:01.703821+0000","last_clean":"2024-09-12T00:22:01.703821+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:01.703821+0000","last_undegraded":"2024-09-12T00:22:01.703821+0000","last_fullsized":"2024-09-12T00:22:01.703821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:51.504748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290737+0000","last_change":"2024-09-12T00:18:44.197634+0000","last_active":"2024-09-12T00:19:24.290737+0000","last_peered":"2024-09-12T00:19:24.290737+0000","last_clean":"2024-09-12T00:19:24.290737+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:19:24.290737+0000","last_undegraded":"2024-09-12T00:19:24.290737+0000","last_fullsized":"2024-09-12T00:19:24.290737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:56.491323+0000","last_change":"2024-09-12T00:18:48.204166+0000","last_active":"2024-09-12T00:20:56.491323+0000","last_peered":"2024-09-12T00:20:56.491323+0000","last_clean":"2024-09-12T00:20:56.491323+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:20:56.491323+0000","last_undegraded":"2024-09-12T00:20:56.491323+0000","last_fullsized":"2024-09-12T00:20:56.491323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.533140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845387+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:00.845387+0000","last_peered":"2024-09-12T00:22:00.845387+0000","last_clean":"2024-09-12T00:22:00.845387+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:00.845387+0000","last_undegraded":"2024-09-12T00:22:00.845387+0000","last_fullsized":"2024-09-12T00:22:00.845387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291583+0000","last_change":"2024-09-12T00:18:46.213160+0000","last_active":"2024-09-12T00:19:24.291583+0000","last_peered":"2024-09-12T00:19:24.291583+0000","last_clean":"2024-09-12T00:19:24.291583+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:19:24.291583+0000","last_undegraded":"2024-09-12T00:19:24.291583+0000","last_fullsized":"2024-09-12T00:19:24.291583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.139206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265951+0000","last_change":"2024-09-12T00:18:44.203057+0000","last_active":"2024-09-12T00:19:24.265951+0000","last_peered":"2024-09-12T00:19:24.265951+0000","last_clean":"2024-09-12T00:19:24.265951+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:19:24.265951+0000","last_undegraded":"2024-09-12T00:19:24.265951+0000","last_fullsized":"2024-09-12T00:19:24.265951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521595+0000","last_change":"2024-09-12T00:18:46.199022+0000","last_active":"2024-09-12T00:22:01.521595+0000","last_peered":"2024-09-12T00:22:01.521595+0000","last_clean":"2024-09-12T00:22:01.521595+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:22:01.521595+0000","last_undegraded":"2024-09-12T00:22:01.521595+0000","last_fullsized":"2024-09-12T00:22:01.521595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:13.922738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543621+0000","last_change":"2024-09-12T00:18:44.195990+0000","last_active":"2024-09-12T00:19:24.543621+0000","last_peered":"2024-09-12T00:19:24.543621+0000","last_clean":"2024-09-12T00:19:24.543621+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:19:24.543621+0000","last_undegraded":"2024-09-12T00:19:24.543621+0000","last_fullsized":"2024-09-12T00:19:24.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.780507+0000","last_change":"2024-09-12T00:18:46.188983+0000","last_active":"2024-09-12T00:21:00.780507+0000","last_peered":"2024-09-12T00:21:00.780507+0000","last_clean":"2024-09-12T00:21:00.780507+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:21:00.780507+0000","last_undegraded":"2024-09-12T00:21:00.780507+0000","last_fullsized":"2024-09-12T00:21:00.780507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.278021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605456+0000","last_change":"2024-09-12T00:18:44.216479+0000","last_active":"2024-09-12T00:20:52.605456+0000","last_peered":"2024-09-12T00:20:52.605456+0000","last_clean":"2024-09-12T00:20:52.605456+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:20:52.605456+0000","last_undegraded":"2024-09-12T00:20:52.605456+0000","last_fullsized":"2024-09-12T00:20:52.605456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.659928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020857+0000","last_change":"2024-09-12T00:18:46.199070+0000","last_active":"2024-09-12T00:22:02.020857+0000","last_peered":"2024-09-12T00:22:02.020857+0000","last_clean":"2024-09-12T00:22:02.020857+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:22:02.020857+0000","last_undegraded":"2024-09-12T00:22:02.020857+0000","last_fullsized":"2024-09-12T00:22:02.020857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550235+0000","last_change":"2024-09-12T00:18:44.216172+0000","last_active":"2024-09-12T00:19:24.550235+0000","last_peered":"2024-09-12T00:19:24.550235+0000","last_clean":"2024-09-12T00:19:24.550235+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:19:24.550235+0000","last_undegraded":"2024-09-12T00:19:24.550235+0000","last_fullsized":"2024-09-12T00:19:24.550235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.247891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.094167+0000","last_change":"2024-09-12T00:18:46.195536+0000","last_active":"2024-09-12T00:22:02.094167+0000","last_peered":"2024-09-12T00:22:02.094167+0000","last_clean":"2024-09-12T00:22:02.094167+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:02.094167+0000","last_undegraded":"2024-09-12T00:22:02.094167+0000","last_fullsized":"2024-09-12T00:22:02.094167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215866+0000","last_change":"2024-09-12T00:18:44.197186+0000","last_active":"2024-09-12T00:19:30.215866+0000","last_peered":"2024-09-12T00:19:30.215866+0000","last_clean":"2024-09-12T00:19:30.215866+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:19:30.215866+0000","last_undegraded":"2024-09-12T00:19:30.215866+0000","last_fullsized":"2024-09-12T00:19:30.215866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:56.784241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091927+0000","last_change":"2024-09-12T00:18:46.217504+0000","last_active":"2024-09-12T00:22:02.091927+0000","last_peered":"2024-09-12T00:22:02.091927+0000","last_clean":"2024-09-12T00:22:02.091927+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:02.091927+0000","last_undegraded":"2024-09-12T00:22:02.091927+0000","last_fullsized":"2024-09-12T00:22:02.091927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:19.889526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599343+0000","last_change":"2024-09-12T00:18:44.213699+0000","last_active":"2024-09-12T00:20:57.599343+0000","last_peered":"2024-09-12T00:20:57.599343+0000","last_clean":"2024-09-12T00:20:57.599343+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:20:57.599343+0000","last_undegraded":"2024-09-12T00:20:57.599343+0000","last_fullsized":"2024-09-12T00:20:57.599343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020343+0000","last_change":"2024-09-12T00:18:46.210908+0000","last_active":"2024-09-12T00:22:02.020343+0000","last_peered":"2024-09-12T00:22:02.020343+0000","last_clean":"2024-09-12T00:22:02.020343+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:22:02.020343+0000","last_undegraded":"2024-09-12T00:22:02.020343+0000","last_fullsized":"2024-09-12T00:22:02.020343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278780+0000","last_change":"2024-09-12T00:18:44.198599+0000","last_active":"2024-09-12T00:19:24.278780+0000","last_peered":"2024-09-12T00:19:24.278780+0000","last_clean":"2024-09-12T00:19:24.278780+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:19:24.278780+0000","last_undegraded":"2024-09-12T00:19:24.278780+0000","last_fullsized":"2024-09-12T00:19:24.278780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:41.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091749+0000","last_change":"2024-09-12T00:18:46.211137+0000","last_active":"2024-09-12T00:22:02.091749+0000","last_peered":"2024-09-12T00:22:02.091749+0000","last_clean":"2024-09-12T00:22:02.091749+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:02.091749+0000","last_undegraded":"2024-09-12T00:22:02.091749+0000","last_fullsized":"2024-09-12T00:22:02.091749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.932223+0000","last_change":"2024-09-12T00:18:44.198634+0000","last_active":"2024-09-12T00:20:55.932223+0000","last_peered":"2024-09-12T00:20:55.932223+0000","last_clean":"2024-09-12T00:20:55.932223+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:20:55.932223+0000","last_undegraded":"2024-09-12T00:20:55.932223+0000","last_fullsized":"2024-09-12T00:20:55.932223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:48.169091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.018907+0000","last_change":"2024-09-12T00:18:46.201393+0000","last_active":"2024-09-12T00:22:02.018907+0000","last_peered":"2024-09-12T00:22:02.018907+0000","last_clean":"2024-09-12T00:22:02.018907+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:22:02.018907+0000","last_undegraded":"2024-09-12T00:22:02.018907+0000","last_fullsized":"2024-09-12T00:22:02.018907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:13.149208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277355+0000","last_change":"2024-09-12T00:18:44.216635+0000","last_active":"2024-09-12T00:19:24.277355+0000","last_peered":"2024-09-12T00:19:24.277355+0000","last_clean":"2024-09-12T00:19:24.277355+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:19:24.277355+0000","last_undegraded":"2024-09-12T00:19:24.277355+0000","last_fullsized":"2024-09-12T00:19:24.277355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.723598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544142+0000","last_change":"2024-09-12T00:18:44.217899+0000","last_active":"2024-09-12T00:19:24.544142+0000","last_peered":"2024-09-12T00:19:24.544142+0000","last_clean":"2024-09-12T00:19:24.544142+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:19:24.544142+0000","last_undegraded":"2024-09-12T00:19:24.544142+0000","last_fullsized":"2024-09-12T00:19:24.544142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:23.029905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548033+0000","last_change":"2024-09-12T00:18:46.198204+0000","last_active":"2024-09-12T00:19:24.548033+0000","last_peered":"2024-09-12T00:19:24.548033+0000","last_clean":"2024-09-12T00:19:24.548033+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:19:24.548033+0000","last_undegraded":"2024-09-12T00:19:24.548033+0000","last_fullsized":"2024-09-12T00:19:24.548033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272805+0000","last_change":"2024-09-12T00:18:44.201625+0000","last_active":"2024-09-12T00:19:24.272805+0000","last_peered":"2024-09-12T00:19:24.272805+0000","last_clean":"2024-09-12T00:19:24.272805+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:19:24.272805+0000","last_undegraded":"2024-09-12T00:19:24.272805+0000","last_fullsized":"2024-09-12T00:19:24.272805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:25.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.800593+0000","last_change":"2024-09-12T00:18:46.206094+0000","last_active":"2024-09-12T00:21:00.800593+0000","last_peered":"2024-09-12T00:21:00.800593+0000","last_clean":"2024-09-12T00:21:00.800593+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:21:00.800593+0000","last_undegraded":"2024-09-12T00:21:00.800593+0000","last_fullsized":"2024-09-12T00:21:00.800593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:54.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276552+0000","last_change":"2024-09-12T00:18:44.196752+0000","last_active":"2024-09-12T00:19:24.276552+0000","last_peered":"2024-09-12T00:19:24.276552+0000","last_clean":"2024-09-12T00:19:24.276552+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:19:24.276552+0000","last_undegraded":"2024-09-12T00:19:24.276552+0000","last_fullsized":"2024-09-12T00:19:24.276552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521751+0000","last_change":"2024-09-12T00:19:24.549151+0000","last_active":"2024-09-12T00:22:01.521751+0000","last_peered":"2024-09-12T00:22:01.521751+0000","last_clean":"2024-09-12T00:22:01.521751+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:01.521751+0000","last_undegraded":"2024-09-12T00:22:01.521751+0000","last_fullsized":"2024-09-12T00:22:01.521751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:25.450062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.482133+0000","last_change":"2024-09-12T00:18:44.183718+0000","last_active":"2024-09-12T00:21:00.482133+0000","last_peered":"2024-09-12T00:21:00.482133+0000","last_clean":"2024-09-12T00:21:00.482133+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:21:00.482133+0000","last_undegraded":"2024-09-12T00:21:00.482133+0000","last_fullsized":"2024-09-12T00:21:00.482133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600242+0000","last_change":"2024-09-12T00:18:46.203607+0000","last_active":"2024-09-12T00:21:02.600242+0000","last_peered":"2024-09-12T00:21:02.600242+0000","last_clean":"2024-09-12T00:21:02.600242+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:21:02.600242+0000","last_undegraded":"2024-09-12T00:21:02.600242+0000","last_fullsized":"2024-09-12T00:21:02.600242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:01.158629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.255211+0000","last_change":"2024-09-12T00:18:44.205642+0000","last_active":"2024-09-12T00:20:15.255211+0000","last_peered":"2024-09-12T00:20:15.255211+0000","last_clean":"2024-09-12T00:20:15.255211+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:20:15.255211+0000","last_undegraded":"2024-09-12T00:20:15.255211+0000","last_fullsized":"2024-09-12T00:20:15.255211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.988420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950179+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:20:55.950179+0000","last_peered":"2024-09-12T00:20:55.950179+0000","last_clean":"2024-09-12T00:20:55.950179+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:20:55.950179+0000","last_undegraded":"2024-09-12T00:20:55.950179+0000","last_fullsized":"2024-09-12T00:20:55.950179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597799+0000","last_change":"2024-09-12T00:18:44.198284+0000","last_active":"2024-09-12T00:21:07.597799+0000","last_peered":"2024-09-12T00:21:07.597799+0000","last_clean":"2024-09-12T00:21:07.597799+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:21:07.597799+0000","last_undegraded":"2024-09-12T00:21:07.597799+0000","last_fullsized":"2024-09-12T00:21:07.597799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270885+0000","last_change":"2024-09-12T00:18:46.210796+0000","last_active":"2024-09-12T00:19:24.270885+0000","last_peered":"2024-09-12T00:19:24.270885+0000","last_clean":"2024-09-12T00:19:24.270885+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:19:24.270885+0000","last_undegraded":"2024-09-12T00:19:24.270885+0000","last_fullsized":"2024-09-12T00:19:24.270885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299482+0000","last_change":"2024-09-12T00:18:44.216498+0000","last_active":"2024-09-12T00:19:24.299482+0000","last_peered":"2024-09-12T00:19:24.299482+0000","last_clean":"2024-09-12T00:19:24.299482+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:19:24.299482+0000","last_undegraded":"2024-09-12T00:19:24.299482+0000","last_fullsized":"2024-09-12T00:19:24.299482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.498751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215514+0000","last_change":"2024-09-12T00:18:44.216871+0000","last_active":"2024-09-12T00:19:30.215514+0000","last_peered":"2024-09-12T00:19:30.215514+0000","last_clean":"2024-09-12T00:19:30.215514+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:19:30.215514+0000","last_undegraded":"2024-09-12T00:19:30.215514+0000","last_fullsized":"2024-09-12T00:19:30.215514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:27.835553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093904+0000","last_change":"2024-09-12T00:18:46.211819+0000","last_active":"2024-09-12T00:22:02.093904+0000","last_peered":"2024-09-12T00:22:02.093904+0000","last_clean":"2024-09-12T00:22:02.093904+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:22:02.093904+0000","last_undegraded":"2024-09-12T00:22:02.093904+0000","last_fullsized":"2024-09-12T00:22:02.093904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544559+0000","last_change":"2024-09-12T00:18:44.216737+0000","last_active":"2024-09-12T00:19:24.544559+0000","last_peered":"2024-09-12T00:19:24.544559+0000","last_clean":"2024-09-12T00:19:24.544559+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:19:24.544559+0000","last_undegraded":"2024-09-12T00:19:24.544559+0000","last_fullsized":"2024-09-12T00:19:24.544559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:29.268868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.787219+0000","last_change":"2024-09-12T00:18:46.217286+0000","last_active":"2024-09-12T00:19:31.787219+0000","last_peered":"2024-09-12T00:19:31.787219+0000","last_clean":"2024-09-12T00:19:31.787219+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:19:31.787219+0000","last_undegraded":"2024-09-12T00:19:31.787219+0000","last_fullsized":"2024-09-12T00:19:31.787219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.834988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52580,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319260,"statfs":{"total":96636764160,"available":96582922240,"internally_reserved":0,"allocated":13389824,"data_stored":13057412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44828,"kb_used_data":9484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327012,"statfs":{"total":96636764160,"available":96590860288,"internally_reserved":0,"allocated":9711616,"data_stored":9451046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":11240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":11509760,"data_stored":11224958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46404,"kb_used_data":6900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325436,"statfs":{"total":96636764160,"available":96589246464,"internally_reserved":0,"allocated":7065600,"data_stored":6764952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:22:34.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:22:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a618e3640 1 Processor -- start 2024-09-12T00:22:34.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a618e3640 1 -- start start 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a618e3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a5c12f1e0 0x7f3a5c12f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a618e3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c070020 con 0x7f3a5c12fb00 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a618e3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c116c80 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a5a7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3a5c12fb00 0x7f3a5c125330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50904/0 (socket says 172.21.15.31:50904) 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a5a7fc640 1 -- 172.21.15.31:0/3795573310 learned_addr learned my addr 172.21.15.31:0/3795573310 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:34.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a5affd640 1 --2- 172.21.15.31:0/3795573310 >> v2:172.21.15.31:3300/0 conn(0x7f3a5c12f1e0 0x7f3a5c12f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a5affd640 1 -- 172.21.15.31:0/3795573310 >> v1:172.21.15.31:6789/0 conn(0x7f3a5c12fb00 legacy=0x7f3a5c125330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a59ffb640 1 -- 172.21.15.31:0/3795573310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317019965 0 0) 0x7f3a5c070020 con 0x7f3a5c12fb00 2024-09-12T00:22:34.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.167+0000 7f3a5affd640 1 -- 172.21.15.31:0/3795573310 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c073b50 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 --2- 172.21.15.31:0/3795573310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c12f5c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009740 tx=0x7f3a4c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f9bf255d04dc4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a59ffb640 1 -- 172.21.15.31:0/3795573310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a4c0b0070 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a59ffb640 1 -- 172.21.15.31:0/3795573310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0ab530 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a59ffb640 1 -- 172.21.15.31:0/3795573310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a4c0ab830 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/3795573310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 msgr2=0x7f3a5c12f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 --2- 172.21.15.31:0/3795573310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c12f5c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009740 tx=0x7f3a4c01c400 comp rx=0 tx=0).stop 2024-09-12T00:22:34.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/3795573310 shutdown_connections 2024-09-12T00:22:34.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 --2- 172.21.15.31:0/3795573310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c12f5c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/3795573310 >> 172.21.15.31:0/3795573310 conn(0x7f3a5c071dc0 msgr2=0x7f3a5c0721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:34.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/3795573310 shutdown_connections 2024-09-12T00:22:34.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/3795573310 wait complete. 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 Processor -- start 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- start start 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c137b20 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45488/0 (socket says 172.21.15.31:45488) 2024-09-12T00:22:34.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 -- 172.21.15.31:0/1562795961 learned_addr learned my addr 172.21.15.31:0/1562795961 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 -- 172.21.15.31:0/1562795961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c134720 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a5affd640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c01a030 tx=0x7f3a4c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a4c0b0040 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0abe40 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c134af0 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a4c004150 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.171+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c135210 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c12f5c0 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3a4c0b3070 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a53fff640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 0x7f3a4003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3a4c0e9940 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a5a7fc640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 0x7f3a4003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.175+0000 7f3a5a7fc640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 0x7f3a4003d690 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3a44007fd0 tx=0x7f3a44007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.179+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3a4c0c2030 con 0x7f3a5c12f1e0 2024-09-12T00:22:34.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.347+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a5c133e80 con 0x7f3a4003b1d0 2024-09-12T00:22:34.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.379+0000 7f3a53fff640 1 -- 172.21.15.31:0/1562795961 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665821 (secure 0 0 0) 0x7f3a5c133e80 con 0x7f3a4003b1d0 2024-09-12T00:22:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 msgr2=0x7f3a4003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 0x7f3a4003d690 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3a44007fd0 tx=0x7f3a44007900 comp rx=0 tx=0).stop 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 msgr2=0x7f3a5c123d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c01a030 tx=0x7f3a4c01ac40 comp rx=0 tx=0).stop 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 shutdown_connections 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3a4003b1d0 0x7f3a4003d690 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 --2- 172.21.15.31:0/1562795961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a5c12f1e0 0x7f3a5c123d70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 >> 172.21.15.31:0/1562795961 conn(0x7f3a5c071dc0 msgr2=0x7f3a5c09bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 shutdown_connections 2024-09-12T00:22:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.383+0000 7f3a618e3640 1 -- 172.21.15.31:0/1562795961 wait complete. 2024-09-12T00:22:34.403 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T00:22:32.615627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5185,"num_read_kb":4735,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190396,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296964,"statfs":{"total":386547056640,"available":386352091136,"internally_reserved":0,"allocated":41676800,"data_stored":40498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":153216793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006361"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.406715+0000","last_change":"2024-09-12T00:18:44.202329+0000","last_active":"2024-09-12T00:21:00.406715+0000","last_peered":"2024-09-12T00:21:00.406715+0000","last_clean":"2024-09-12T00:21:00.406715+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:21:00.406715+0000","last_undegraded":"2024-09-12T00:21:00.406715+0000","last_fullsized":"2024-09-12T00:21:00.406715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903656+0000","last_change":"2024-09-12T00:18:46.211272+0000","last_active":"2024-09-12T00:22:01.903656+0000","last_peered":"2024-09-12T00:22:01.903656+0000","last_clean":"2024-09-12T00:22:01.903656+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:22:01.903656+0000","last_undegraded":"2024-09-12T00:22:01.903656+0000","last_fullsized":"2024-09-12T00:22:01.903656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.762232+0000","last_change":"2024-09-12T00:18:44.198567+0000","last_active":"2024-09-12T00:19:31.762232+0000","last_peered":"2024-09-12T00:19:31.762232+0000","last_clean":"2024-09-12T00:19:31.762232+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:19:31.762232+0000","last_undegraded":"2024-09-12T00:19:31.762232+0000","last_fullsized":"2024-09-12T00:19:31.762232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.320029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.728342+0000","last_change":"2024-09-12T00:18:44.210055+0000","last_active":"2024-09-12T00:21:00.728342+0000","last_peered":"2024-09-12T00:21:00.728342+0000","last_clean":"2024-09-12T00:21:00.728342+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:21:00.728342+0000","last_undegraded":"2024-09-12T00:21:00.728342+0000","last_fullsized":"2024-09-12T00:21:00.728342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:52.123986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.423882+0000","last_change":"2024-09-12T00:18:44.194458+0000","last_active":"2024-09-12T00:22:01.423882+0000","last_peered":"2024-09-12T00:22:01.423882+0000","last_clean":"2024-09-12T00:22:01.423882+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:01.423882+0000","last_undegraded":"2024-09-12T00:22:01.423882+0000","last_fullsized":"2024-09-12T00:22:01.423882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286428+0000","last_change":"2024-09-12T00:18:44.206065+0000","last_active":"2024-09-12T00:19:24.286428+0000","last_peered":"2024-09-12T00:19:24.286428+0000","last_clean":"2024-09-12T00:19:24.286428+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:19:24.286428+0000","last_undegraded":"2024-09-12T00:19:24.286428+0000","last_fullsized":"2024-09-12T00:19:24.286428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:40.433166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.032972+0000","last_change":"2024-09-12T00:18:46.205029+0000","last_active":"2024-09-12T00:22:02.032972+0000","last_peered":"2024-09-12T00:22:02.032972+0000","last_clean":"2024-09-12T00:22:02.032972+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:22:02.032972+0000","last_undegraded":"2024-09-12T00:22:02.032972+0000","last_fullsized":"2024-09-12T00:22:02.032972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267456+0000","last_change":"2024-09-12T00:18:44.218601+0000","last_active":"2024-09-12T00:19:24.267456+0000","last_peered":"2024-09-12T00:19:24.267456+0000","last_clean":"2024-09-12T00:19:24.267456+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:19:24.267456+0000","last_undegraded":"2024-09-12T00:19:24.267456+0000","last_fullsized":"2024-09-12T00:19:24.267456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903829+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.903829+0000","last_peered":"2024-09-12T00:22:01.903829+0000","last_clean":"2024-09-12T00:22:01.903829+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.903829+0000","last_undegraded":"2024-09-12T00:22:01.903829+0000","last_fullsized":"2024-09-12T00:22:01.903829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:35.703562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278516+0000","last_change":"2024-09-12T00:18:44.193805+0000","last_active":"2024-09-12T00:19:24.278516+0000","last_peered":"2024-09-12T00:19:24.278516+0000","last_clean":"2024-09-12T00:19:24.278516+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:19:24.278516+0000","last_undegraded":"2024-09-12T00:19:24.278516+0000","last_fullsized":"2024-09-12T00:19:24.278516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:36.997859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279902+0000","last_change":"2024-09-12T00:18:46.207506+0000","last_active":"2024-09-12T00:19:24.279902+0000","last_peered":"2024-09-12T00:19:24.279902+0000","last_clean":"2024-09-12T00:19:24.279902+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:19:24.279902+0000","last_undegraded":"2024-09-12T00:19:24.279902+0000","last_fullsized":"2024-09-12T00:19:24.279902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.213594+0000","last_change":"2024-09-12T00:18:44.218215+0000","last_active":"2024-09-12T00:19:30.213594+0000","last_peered":"2024-09-12T00:19:30.213594+0000","last_clean":"2024-09-12T00:19:30.213594+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:19:30.213594+0000","last_undegraded":"2024-09-12T00:19:30.213594+0000","last_fullsized":"2024-09-12T00:19:30.213594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685897+0000","last_change":"2024-09-12T00:18:46.186627+0000","last_active":"2024-09-12T00:22:01.685897+0000","last_peered":"2024-09-12T00:22:01.685897+0000","last_clean":"2024-09-12T00:22:01.685897+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:22:01.685897+0000","last_undegraded":"2024-09-12T00:22:01.685897+0000","last_fullsized":"2024-09-12T00:22:01.685897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290994+0000","last_change":"2024-09-12T00:18:44.212848+0000","last_active":"2024-09-12T00:19:24.290994+0000","last_peered":"2024-09-12T00:19:24.290994+0000","last_clean":"2024-09-12T00:19:24.290994+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:19:24.290994+0000","last_undegraded":"2024-09-12T00:19:24.290994+0000","last_fullsized":"2024-09-12T00:19:24.290994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:33.310089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.925305+0000","last_change":"2024-09-12T00:18:46.194590+0000","last_active":"2024-09-12T00:22:01.925305+0000","last_peered":"2024-09-12T00:22:01.925305+0000","last_clean":"2024-09-12T00:22:01.925305+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:22:01.925305+0000","last_undegraded":"2024-09-12T00:22:01.925305+0000","last_fullsized":"2024-09-12T00:22:01.925305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279673+0000","last_change":"2024-09-12T00:18:44.202523+0000","last_active":"2024-09-12T00:19:24.279673+0000","last_peered":"2024-09-12T00:19:24.279673+0000","last_clean":"2024-09-12T00:19:24.279673+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:19:24.279673+0000","last_undegraded":"2024-09-12T00:19:24.279673+0000","last_fullsized":"2024-09-12T00:19:24.279673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904113+0000","last_change":"2024-09-12T00:18:46.203242+0000","last_active":"2024-09-12T00:22:01.904113+0000","last_peered":"2024-09-12T00:22:01.904113+0000","last_clean":"2024-09-12T00:22:01.904113+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:22:01.904113+0000","last_undegraded":"2024-09-12T00:22:01.904113+0000","last_fullsized":"2024-09-12T00:22:01.904113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:24.643819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.284256+0000","last_change":"2024-09-12T00:18:44.214172+0000","last_active":"2024-09-12T00:19:24.284256+0000","last_peered":"2024-09-12T00:19:24.284256+0000","last_clean":"2024-09-12T00:19:24.284256+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:19:24.284256+0000","last_undegraded":"2024-09-12T00:19:24.284256+0000","last_fullsized":"2024-09-12T00:19:24.284256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035956+0000","last_change":"2024-09-12T00:18:46.196617+0000","last_active":"2024-09-12T00:22:02.035956+0000","last_peered":"2024-09-12T00:22:02.035956+0000","last_clean":"2024-09-12T00:22:02.035956+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:22:02.035956+0000","last_undegraded":"2024-09-12T00:22:02.035956+0000","last_fullsized":"2024-09-12T00:22:02.035956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602719+0000","last_change":"2024-09-12T00:18:44.204026+0000","last_active":"2024-09-12T00:21:12.602719+0000","last_peered":"2024-09-12T00:21:12.602719+0000","last_clean":"2024-09-12T00:21:12.602719+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:21:12.602719+0000","last_undegraded":"2024-09-12T00:21:12.602719+0000","last_fullsized":"2024-09-12T00:21:12.602719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092738+0000","last_change":"2024-09-12T00:18:46.189741+0000","last_active":"2024-09-12T00:22:02.092738+0000","last_peered":"2024-09-12T00:22:02.092738+0000","last_clean":"2024-09-12T00:22:02.092738+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:22:02.092738+0000","last_undegraded":"2024-09-12T00:22:02.092738+0000","last_fullsized":"2024-09-12T00:22:02.092738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550714+0000","last_change":"2024-09-12T00:18:44.216492+0000","last_active":"2024-09-12T00:19:24.550714+0000","last_peered":"2024-09-12T00:19:24.550714+0000","last_clean":"2024-09-12T00:19:24.550714+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:19:24.550714+0000","last_undegraded":"2024-09-12T00:19:24.550714+0000","last_fullsized":"2024-09-12T00:19:24.550714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.545686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'5","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602774+0000","last_change":"2024-09-12T00:18:46.187100+0000","last_active":"2024-09-12T00:21:12.602774+0000","last_peered":"2024-09-12T00:21:12.602774+0000","last_clean":"2024-09-12T00:21:12.602774+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:21:12.602774+0000","last_undegraded":"2024-09-12T00:21:12.602774+0000","last_fullsized":"2024-09-12T00:21:12.602774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.865459+0000","last_change":"2024-09-12T00:18:44.194821+0000","last_active":"2024-09-12T00:22:01.865459+0000","last_peered":"2024-09-12T00:22:01.865459+0000","last_clean":"2024-09-12T00:22:01.865459+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:22:01.865459+0000","last_undegraded":"2024-09-12T00:22:01.865459+0000","last_fullsized":"2024-09-12T00:22:01.865459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:26.427367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.466162+0000","last_change":"2024-09-12T00:18:46.181776+0000","last_active":"2024-09-12T00:19:31.466162+0000","last_peered":"2024-09-12T00:19:31.466162+0000","last_clean":"2024-09-12T00:19:31.466162+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:19:31.466162+0000","last_undegraded":"2024-09-12T00:19:31.466162+0000","last_fullsized":"2024-09-12T00:19:31.466162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:14.676977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285925+0000","last_change":"2024-09-12T00:18:44.204366+0000","last_active":"2024-09-12T00:19:24.285925+0000","last_peered":"2024-09-12T00:19:24.285925+0000","last_clean":"2024-09-12T00:19:24.285925+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:19:24.285925+0000","last_undegraded":"2024-09-12T00:19:24.285925+0000","last_fullsized":"2024-09-12T00:19:24.285925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.910617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'42","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.252668+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:20:58.252668+0000","last_peered":"2024-09-12T00:20:58.252668+0000","last_clean":"2024-09-12T00:20:58.252668+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:20:58.252668+0000","last_undegraded":"2024-09-12T00:20:58.252668+0000","last_fullsized":"2024-09-12T00:20:58.252668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017652+0000","last_change":"2024-09-12T00:18:46.192637+0000","last_active":"2024-09-12T00:22:02.017652+0000","last_peered":"2024-09-12T00:22:02.017652+0000","last_clean":"2024-09-12T00:22:02.017652+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:22:02.017652+0000","last_undegraded":"2024-09-12T00:22:02.017652+0000","last_fullsized":"2024-09-12T00:22:02.017652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:10.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597537+0000","last_change":"2024-09-12T00:18:44.208808+0000","last_active":"2024-09-12T00:21:07.597537+0000","last_peered":"2024-09-12T00:21:07.597537+0000","last_clean":"2024-09-12T00:21:07.597537+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:21:07.597537+0000","last_undegraded":"2024-09-12T00:21:07.597537+0000","last_fullsized":"2024-09-12T00:21:07.597537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.580130+0000","last_change":"2024-09-12T00:19:24.287113+0000","last_active":"2024-09-12T00:19:27.580130+0000","last_peered":"2024-09-12T00:19:27.580130+0000","last_clean":"2024-09-12T00:19:27.580130+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:19:27.580130+0000","last_undegraded":"2024-09-12T00:19:27.580130+0000","last_fullsized":"2024-09-12T00:19:27.580130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:38.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.467228+0000","last_change":"2024-09-12T00:18:46.189086+0000","last_active":"2024-09-12T00:19:31.467228+0000","last_peered":"2024-09-12T00:19:31.467228+0000","last_clean":"2024-09-12T00:19:31.467228+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:19:31.467228+0000","last_undegraded":"2024-09-12T00:19:31.467228+0000","last_fullsized":"2024-09-12T00:19:31.467228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:41.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277544+0000","last_change":"2024-09-12T00:18:44.204623+0000","last_active":"2024-09-12T00:19:24.277544+0000","last_peered":"2024-09-12T00:19:24.277544+0000","last_clean":"2024-09-12T00:19:24.277544+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:19:24.277544+0000","last_undegraded":"2024-09-12T00:19:24.277544+0000","last_fullsized":"2024-09-12T00:19:24.277544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:49.492628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550915+0000","last_change":"2024-09-12T00:18:48.218518+0000","last_active":"2024-09-12T00:19:24.550915+0000","last_peered":"2024-09-12T00:19:24.550915+0000","last_clean":"2024-09-12T00:19:24.550915+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:19:24.550915+0000","last_undegraded":"2024-09-12T00:19:24.550915+0000","last_fullsized":"2024-09-12T00:19:24.550915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.252605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":383,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453635+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:21:58.453635+0000","last_peered":"2024-09-12T00:21:58.453635+0000","last_clean":"2024-09-12T00:21:58.453635+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:21:58.453635+0000","last_undegraded":"2024-09-12T00:21:58.453635+0000","last_fullsized":"2024-09-12T00:21:58.453635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093892+0000","last_change":"2024-09-12T00:18:46.211042+0000","last_active":"2024-09-12T00:22:02.093892+0000","last_peered":"2024-09-12T00:22:02.093892+0000","last_clean":"2024-09-12T00:22:02.093892+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:02.093892+0000","last_undegraded":"2024-09-12T00:22:02.093892+0000","last_fullsized":"2024-09-12T00:22:02.093892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269812+0000","last_change":"2024-09-12T00:18:44.191237+0000","last_active":"2024-09-12T00:19:24.269812+0000","last_peered":"2024-09-12T00:19:24.269812+0000","last_clean":"2024-09-12T00:19:24.269812+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:19:24.269812+0000","last_undegraded":"2024-09-12T00:19:24.269812+0000","last_fullsized":"2024-09-12T00:19:24.269812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:50.165029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883493+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:20:59.883493+0000","last_peered":"2024-09-12T00:20:59.883493+0000","last_clean":"2024-09-12T00:20:59.883493+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:20:59.883493+0000","last_undegraded":"2024-09-12T00:20:59.883493+0000","last_fullsized":"2024-09-12T00:20:59.883493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.244083+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:20:58.244083+0000","last_peered":"2024-09-12T00:20:58.244083+0000","last_clean":"2024-09-12T00:20:58.244083+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:20:58.244083+0000","last_undegraded":"2024-09-12T00:20:58.244083+0000","last_fullsized":"2024-09-12T00:20:58.244083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.103038+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:02.103038+0000","last_peered":"2024-09-12T00:22:02.103038+0000","last_clean":"2024-09-12T00:22:02.103038+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:02.103038+0000","last_undegraded":"2024-09-12T00:22:02.103038+0000","last_fullsized":"2024-09-12T00:22:02.103038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.270303+0000","last_change":"2024-09-12T00:18:46.214495+0000","last_active":"2024-09-12T00:20:15.270303+0000","last_peered":"2024-09-12T00:20:15.270303+0000","last_clean":"2024-09-12T00:20:15.270303+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:20:15.270303+0000","last_undegraded":"2024-09-12T00:20:15.270303+0000","last_fullsized":"2024-09-12T00:20:15.270303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:26.250264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.890256+0000","last_change":"2024-09-12T00:18:44.202781+0000","last_active":"2024-09-12T00:22:01.890256+0000","last_peered":"2024-09-12T00:22:01.890256+0000","last_clean":"2024-09-12T00:22:01.890256+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:01.890256+0000","last_undegraded":"2024-09-12T00:22:01.890256+0000","last_fullsized":"2024-09-12T00:22:01.890256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272688+0000","last_change":"2024-09-12T00:18:48.204648+0000","last_active":"2024-09-12T00:19:24.272688+0000","last_peered":"2024-09-12T00:19:24.272688+0000","last_clean":"2024-09-12T00:19:24.272688+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:19:24.272688+0000","last_undegraded":"2024-09-12T00:19:24.272688+0000","last_fullsized":"2024-09-12T00:19:24.272688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:46.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'48","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596167+0000","last_change":"2024-09-12T00:18:50.230605+0000","last_active":"2024-09-12T00:21:02.596167+0000","last_peered":"2024-09-12T00:21:02.596167+0000","last_clean":"2024-09-12T00:21:02.596167+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:21:02.596167+0000","last_undegraded":"2024-09-12T00:21:02.596167+0000","last_fullsized":"2024-09-12T00:21:02.596167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:38.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":43,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.022794+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.022794+0000","last_peered":"2024-09-12T00:22:02.022794+0000","last_clean":"2024-09-12T00:22:02.022794+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.022794+0000","last_undegraded":"2024-09-12T00:22:02.022794+0000","last_fullsized":"2024-09-12T00:22:02.022794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:06.675976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'5","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599274+0000","last_change":"2024-09-12T00:18:46.194904+0000","last_active":"2024-09-12T00:20:57.599274+0000","last_peered":"2024-09-12T00:20:57.599274+0000","last_clean":"2024-09-12T00:20:57.599274+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:20:57.599274+0000","last_undegraded":"2024-09-12T00:20:57.599274+0000","last_fullsized":"2024-09-12T00:20:57.599274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596353+0000","last_change":"2024-09-12T00:18:44.198188+0000","last_active":"2024-09-12T00:21:02.596353+0000","last_peered":"2024-09-12T00:21:02.596353+0000","last_clean":"2024-09-12T00:21:02.596353+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:21:02.596353+0000","last_undegraded":"2024-09-12T00:21:02.596353+0000","last_fullsized":"2024-09-12T00:21:02.596353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:18.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544308+0000","last_change":"2024-09-12T00:18:48.205812+0000","last_active":"2024-09-12T00:19:24.544308+0000","last_peered":"2024-09-12T00:19:24.544308+0000","last_clean":"2024-09-12T00:19:24.544308+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:19:24.544308+0000","last_undegraded":"2024-09-12T00:19:24.544308+0000","last_fullsized":"2024-09-12T00:19:24.544308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.485115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.227739+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:20:58.227739+0000","last_peered":"2024-09-12T00:20:58.227739+0000","last_clean":"2024-09-12T00:20:58.227739+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:20:58.227739+0000","last_undegraded":"2024-09-12T00:20:58.227739+0000","last_fullsized":"2024-09-12T00:20:58.227739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544349+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:19:24.544349+0000","last_peered":"2024-09-12T00:19:24.544349+0000","last_clean":"2024-09-12T00:19:24.544349+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:19:24.544349+0000","last_undegraded":"2024-09-12T00:19:24.544349+0000","last_fullsized":"2024-09-12T00:19:24.544349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:09.229873+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:20:09.229873+0000","last_peered":"2024-09-12T00:20:09.229873+0000","last_clean":"2024-09-12T00:20:09.229873+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:20:09.229873+0000","last_undegraded":"2024-09-12T00:20:09.229873+0000","last_fullsized":"2024-09-12T00:20:09.229873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.249738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092735+0000","last_change":"2024-09-12T00:18:46.190345+0000","last_active":"2024-09-12T00:22:02.092735+0000","last_peered":"2024-09-12T00:22:02.092735+0000","last_clean":"2024-09-12T00:22:02.092735+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:02.092735+0000","last_undegraded":"2024-09-12T00:22:02.092735+0000","last_fullsized":"2024-09-12T00:22:02.092735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:58.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.210951+0000","last_change":"2024-09-12T00:18:44.213120+0000","last_active":"2024-09-12T00:19:30.210951+0000","last_peered":"2024-09-12T00:19:30.210951+0000","last_clean":"2024-09-12T00:19:30.210951+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:19:30.210951+0000","last_undegraded":"2024-09-12T00:19:30.210951+0000","last_fullsized":"2024-09-12T00:19:30.210951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:49.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.551564+0000","last_change":"2024-09-12T00:18:48.206891+0000","last_active":"2024-09-12T00:19:24.551564+0000","last_peered":"2024-09-12T00:19:24.551564+0000","last_clean":"2024-09-12T00:19:24.551564+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:19:24.551564+0000","last_undegraded":"2024-09-12T00:19:24.551564+0000","last_fullsized":"2024-09-12T00:19:24.551564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.261684+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:20:58.261684+0000","last_peered":"2024-09-12T00:20:58.261684+0000","last_clean":"2024-09-12T00:20:58.261684+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:20:58.261684+0000","last_undegraded":"2024-09-12T00:20:58.261684+0000","last_fullsized":"2024-09-12T00:20:58.261684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.032481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":350,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.457576+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:02.457576+0000","last_peered":"2024-09-12T00:22:02.457576+0000","last_clean":"2024-09-12T00:22:02.457576+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:02.457576+0000","last_undegraded":"2024-09-12T00:22:02.457576+0000","last_fullsized":"2024-09-12T00:22:02.457576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548388+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:19:24.548388+0000","last_peered":"2024-09-12T00:19:24.548388+0000","last_clean":"2024-09-12T00:19:24.548388+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:19:24.548388+0000","last_undegraded":"2024-09-12T00:19:24.548388+0000","last_fullsized":"2024-09-12T00:19:24.548388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:44.410375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903715+0000","last_change":"2024-09-12T00:18:46.184028+0000","last_active":"2024-09-12T00:22:01.903715+0000","last_peered":"2024-09-12T00:22:01.903715+0000","last_clean":"2024-09-12T00:22:01.903715+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:01.903715+0000","last_undegraded":"2024-09-12T00:22:01.903715+0000","last_fullsized":"2024-09-12T00:22:01.903715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291451+0000","last_change":"2024-09-12T00:18:44.210945+0000","last_active":"2024-09-12T00:19:24.291451+0000","last_peered":"2024-09-12T00:19:24.291451+0000","last_clean":"2024-09-12T00:19:24.291451+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:19:24.291451+0000","last_undegraded":"2024-09-12T00:19:24.291451+0000","last_fullsized":"2024-09-12T00:19:24.291451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.463659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.574695+0000","last_change":"2024-09-12T00:19:24.275470+0000","last_active":"2024-09-12T00:19:27.574695+0000","last_peered":"2024-09-12T00:19:27.574695+0000","last_clean":"2024-09-12T00:19:27.574695+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:19:27.574695+0000","last_undegraded":"2024-09-12T00:19:27.574695+0000","last_fullsized":"2024-09-12T00:19:27.574695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:26.076062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":135,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.264136+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:20:58.264136+0000","last_peered":"2024-09-12T00:20:58.264136+0000","last_clean":"2024-09-12T00:20:58.264136+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:20:58.264136+0000","last_undegraded":"2024-09-12T00:20:58.264136+0000","last_fullsized":"2024-09-12T00:20:58.264136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.313371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543403+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:19:24.543403+0000","last_peered":"2024-09-12T00:19:24.543403+0000","last_clean":"2024-09-12T00:19:24.543403+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:19:24.543403+0000","last_undegraded":"2024-09-12T00:19:24.543403+0000","last_fullsized":"2024-09-12T00:19:24.543403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394734+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.394734+0000","last_peered":"2024-09-12T00:22:02.394734+0000","last_clean":"2024-09-12T00:22:02.394734+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.394734+0000","last_undegraded":"2024-09-12T00:22:02.394734+0000","last_fullsized":"2024-09-12T00:22:02.394734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:35.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.019375+0000","last_change":"2024-09-12T00:19:24.302900+0000","last_active":"2024-09-12T00:22:02.019375+0000","last_peered":"2024-09-12T00:22:02.019375+0000","last_clean":"2024-09-12T00:22:02.019375+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:02.019375+0000","last_undegraded":"2024-09-12T00:22:02.019375+0000","last_fullsized":"2024-09-12T00:22:02.019375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:27.149764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548407+0000","last_change":"2024-09-12T00:18:44.182390+0000","last_active":"2024-09-12T00:19:24.548407+0000","last_peered":"2024-09-12T00:19:24.548407+0000","last_clean":"2024-09-12T00:19:24.548407+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:19:24.548407+0000","last_undegraded":"2024-09-12T00:19:24.548407+0000","last_fullsized":"2024-09-12T00:19:24.548407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.955106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275681+0000","last_change":"2024-09-12T00:18:48.205192+0000","last_active":"2024-09-12T00:19:24.275681+0000","last_peered":"2024-09-12T00:19:24.275681+0000","last_clean":"2024-09-12T00:19:24.275681+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:19:24.275681+0000","last_undegraded":"2024-09-12T00:19:24.275681+0000","last_fullsized":"2024-09-12T00:19:24.275681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:53.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601657+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:21:07.601657+0000","last_peered":"2024-09-12T00:21:07.601657+0000","last_clean":"2024-09-12T00:21:07.601657+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:21:07.601657+0000","last_undegraded":"2024-09-12T00:21:07.601657+0000","last_fullsized":"2024-09-12T00:21:07.601657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.841795+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:20:57.841795+0000","last_peered":"2024-09-12T00:20:57.841795+0000","last_clean":"2024-09-12T00:20:57.841795+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:20:57.841795+0000","last_undegraded":"2024-09-12T00:20:57.841795+0000","last_fullsized":"2024-09-12T00:20:57.841795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949230+0000","last_change":"2024-09-12T00:18:46.214384+0000","last_active":"2024-09-12T00:20:55.949230+0000","last_peered":"2024-09-12T00:20:55.949230+0000","last_clean":"2024-09-12T00:20:55.949230+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:20:55.949230+0000","last_undegraded":"2024-09-12T00:20:55.949230+0000","last_fullsized":"2024-09-12T00:20:55.949230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:32.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.763687+0000","last_change":"2024-09-12T00:18:44.195641+0000","last_active":"2024-09-12T00:19:31.763687+0000","last_peered":"2024-09-12T00:19:31.763687+0000","last_clean":"2024-09-12T00:19:31.763687+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:19:31.763687+0000","last_undegraded":"2024-09-12T00:19:31.763687+0000","last_fullsized":"2024-09-12T00:19:31.763687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:32.850697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544223+0000","last_change":"2024-09-12T00:18:48.206321+0000","last_active":"2024-09-12T00:19:24.544223+0000","last_peered":"2024-09-12T00:19:24.544223+0000","last_clean":"2024-09-12T00:19:24.544223+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:19:24.544223+0000","last_undegraded":"2024-09-12T00:19:24.544223+0000","last_fullsized":"2024-09-12T00:19:24.544223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.756623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276459+0000","last_change":"2024-09-12T00:18:50.208134+0000","last_active":"2024-09-12T00:20:58.276459+0000","last_peered":"2024-09-12T00:20:58.276459+0000","last_clean":"2024-09-12T00:20:58.276459+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:20:58.276459+0000","last_undegraded":"2024-09-12T00:20:58.276459+0000","last_fullsized":"2024-09-12T00:20:58.276459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:41.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":433,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394603+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:02.394603+0000","last_peered":"2024-09-12T00:22:02.394603+0000","last_clean":"2024-09-12T00:22:02.394603+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:02.394603+0000","last_undegraded":"2024-09-12T00:22:02.394603+0000","last_fullsized":"2024-09-12T00:22:02.394603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600068+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:21:02.600068+0000","last_peered":"2024-09-12T00:21:02.600068+0000","last_clean":"2024-09-12T00:21:02.600068+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:21:02.600068+0000","last_undegraded":"2024-09-12T00:21:02.600068+0000","last_fullsized":"2024-09-12T00:21:02.600068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:32.549319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950683+0000","last_change":"2024-09-12T00:18:46.190811+0000","last_active":"2024-09-12T00:20:55.950683+0000","last_peered":"2024-09-12T00:20:55.950683+0000","last_clean":"2024-09-12T00:20:55.950683+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:20:55.950683+0000","last_undegraded":"2024-09-12T00:20:55.950683+0000","last_fullsized":"2024-09-12T00:20:55.950683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280196+0000","last_change":"2024-09-12T00:18:44.209954+0000","last_active":"2024-09-12T00:19:24.280196+0000","last_peered":"2024-09-12T00:19:24.280196+0000","last_clean":"2024-09-12T00:19:24.280196+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:19:24.280196+0000","last_undegraded":"2024-09-12T00:19:24.280196+0000","last_fullsized":"2024-09-12T00:19:24.280196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:56.345709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883129+0000","last_change":"2024-09-12T00:18:48.204097+0000","last_active":"2024-09-12T00:20:59.883129+0000","last_peered":"2024-09-12T00:20:59.883129+0000","last_clean":"2024-09-12T00:20:59.883129+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:20:59.883129+0000","last_undegraded":"2024-09-12T00:20:59.883129+0000","last_fullsized":"2024-09-12T00:20:59.883129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.662454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":470,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.261927+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:02.261927+0000","last_peered":"2024-09-12T00:22:02.261927+0000","last_clean":"2024-09-12T00:22:02.261927+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:02.261927+0000","last_undegraded":"2024-09-12T00:22:02.261927+0000","last_fullsized":"2024-09-12T00:22:02.261927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.229253+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:00.229253+0000","last_peered":"2024-09-12T00:21:00.229253+0000","last_clean":"2024-09-12T00:21:00.229253+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:00.229253+0000","last_undegraded":"2024-09-12T00:21:00.229253+0000","last_fullsized":"2024-09-12T00:21:00.229253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.526537+0000","last_change":"2024-09-12T00:18:46.211756+0000","last_active":"2024-09-12T00:22:01.526537+0000","last_peered":"2024-09-12T00:22:01.526537+0000","last_clean":"2024-09-12T00:22:01.526537+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:01.526537+0000","last_undegraded":"2024-09-12T00:22:01.526537+0000","last_fullsized":"2024-09-12T00:22:01.526537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:58.473396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277734+0000","last_change":"2024-09-12T00:18:44.204521+0000","last_active":"2024-09-12T00:19:24.277734+0000","last_peered":"2024-09-12T00:19:24.277734+0000","last_clean":"2024-09-12T00:19:24.277734+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:19:24.277734+0000","last_undegraded":"2024-09-12T00:19:24.277734+0000","last_fullsized":"2024-09-12T00:19:24.277734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.066094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298901+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:19:24.298901+0000","last_peered":"2024-09-12T00:19:24.298901+0000","last_clean":"2024-09-12T00:19:24.298901+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:19:24.298901+0000","last_undegraded":"2024-09-12T00:19:24.298901+0000","last_fullsized":"2024-09-12T00:19:24.298901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'38","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.254646+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:20:58.254646+0000","last_peered":"2024-09-12T00:20:58.254646+0000","last_clean":"2024-09-12T00:20:58.254646+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:20:58.254646+0000","last_undegraded":"2024-09-12T00:20:58.254646+0000","last_fullsized":"2024-09-12T00:20:58.254646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.191021+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.191021+0000","last_peered":"2024-09-12T00:22:02.191021+0000","last_clean":"2024-09-12T00:22:02.191021+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.191021+0000","last_undegraded":"2024-09-12T00:22:02.191021+0000","last_fullsized":"2024-09-12T00:22:02.191021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:07.414020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:32.603727+0000","last_change":"2024-09-12T00:19:24.294913+0000","last_active":"2024-09-12T00:21:32.603727+0000","last_peered":"2024-09-12T00:21:32.603727+0000","last_clean":"2024-09-12T00:21:32.603727+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:21:32.603727+0000","last_undegraded":"2024-09-12T00:21:32.603727+0000","last_fullsized":"2024-09-12T00:21:32.603727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:01.472976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269684+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:19:24.269684+0000","last_peered":"2024-09-12T00:19:24.269684+0000","last_clean":"2024-09-12T00:19:24.269684+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:19:24.269684+0000","last_undegraded":"2024-09-12T00:19:24.269684+0000","last_fullsized":"2024-09-12T00:19:24.269684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285652+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:19:24.285652+0000","last_peered":"2024-09-12T00:19:24.285652+0000","last_clean":"2024-09-12T00:19:24.285652+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:19:24.285652+0000","last_undegraded":"2024-09-12T00:19:24.285652+0000","last_fullsized":"2024-09-12T00:19:24.285652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.079086+0000","last_change":"2024-09-12T00:18:44.210973+0000","last_active":"2024-09-12T00:22:02.079086+0000","last_peered":"2024-09-12T00:22:02.079086+0000","last_clean":"2024-09-12T00:22:02.079086+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:02.079086+0000","last_undegraded":"2024-09-12T00:22:02.079086+0000","last_fullsized":"2024-09-12T00:22:02.079086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:48.534399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.282323+0000","last_change":"2024-09-12T00:18:48.211948+0000","last_active":"2024-09-12T00:19:24.282323+0000","last_peered":"2024-09-12T00:19:24.282323+0000","last_clean":"2024-09-12T00:19:24.282323+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:19:24.282323+0000","last_undegraded":"2024-09-12T00:19:24.282323+0000","last_fullsized":"2024-09-12T00:19:24.282323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'82","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272194+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:20:58.272194+0000","last_peered":"2024-09-12T00:20:58.272194+0000","last_clean":"2024-09-12T00:20:58.272194+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:20:58.272194+0000","last_undegraded":"2024-09-12T00:20:58.272194+0000","last_fullsized":"2024-09-12T00:20:58.272194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.876704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547510+0000","last_change":"2024-09-12T00:18:52.245007+0000","last_active":"2024-09-12T00:19:24.547510+0000","last_peered":"2024-09-12T00:19:24.547510+0000","last_clean":"2024-09-12T00:19:24.547510+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:19:24.547510+0000","last_undegraded":"2024-09-12T00:19:24.547510+0000","last_fullsized":"2024-09-12T00:19:24.547510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:17.254061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.119534+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.119534+0000","last_peered":"2024-09-12T00:22:02.119534+0000","last_clean":"2024-09-12T00:22:02.119534+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.119534+0000","last_undegraded":"2024-09-12T00:22:02.119534+0000","last_fullsized":"2024-09-12T00:22:02.119534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:46.601602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091794+0000","last_change":"2024-09-12T00:18:46.188276+0000","last_active":"2024-09-12T00:22:02.091794+0000","last_peered":"2024-09-12T00:22:02.091794+0000","last_clean":"2024-09-12T00:22:02.091794+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:22:02.091794+0000","last_undegraded":"2024-09-12T00:22:02.091794+0000","last_fullsized":"2024-09-12T00:22:02.091794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.432662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.273369+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:19:24.273369+0000","last_peered":"2024-09-12T00:19:24.273369+0000","last_clean":"2024-09-12T00:19:24.273369+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:19:24.273369+0000","last_undegraded":"2024-09-12T00:19:24.273369+0000","last_fullsized":"2024-09-12T00:19:24.273369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.949260+0000","last_change":"2024-09-12T00:18:44.198633+0000","last_active":"2024-09-12T00:20:14.949260+0000","last_peered":"2024-09-12T00:20:14.949260+0000","last_clean":"2024-09-12T00:20:14.949260+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:20:14.949260+0000","last_undegraded":"2024-09-12T00:20:14.949260+0000","last_fullsized":"2024-09-12T00:20:14.949260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.301077+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:19:24.301077+0000","last_peered":"2024-09-12T00:19:24.301077+0000","last_clean":"2024-09-12T00:19:24.301077+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:19:24.301077+0000","last_undegraded":"2024-09-12T00:19:24.301077+0000","last_fullsized":"2024-09-12T00:19:24.301077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.126928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":490,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453795+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:21:58.453795+0000","last_peered":"2024-09-12T00:21:58.453795+0000","last_clean":"2024-09-12T00:21:58.453795+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:21:58.453795+0000","last_undegraded":"2024-09-12T00:21:58.453795+0000","last_fullsized":"2024-09-12T00:21:58.453795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.974846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291239+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:19:24.291239+0000","last_peered":"2024-09-12T00:19:24.291239+0000","last_clean":"2024-09-12T00:19:24.291239+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:19:24.291239+0000","last_undegraded":"2024-09-12T00:19:24.291239+0000","last_fullsized":"2024-09-12T00:19:24.291239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:27.494970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.967961+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:20:14.967961+0000","last_peered":"2024-09-12T00:20:14.967961+0000","last_clean":"2024-09-12T00:20:14.967961+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:20:14.967961+0000","last_undegraded":"2024-09-12T00:20:14.967961+0000","last_fullsized":"2024-09-12T00:20:14.967961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.417808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020186+0000","last_change":"2024-09-12T00:18:46.211820+0000","last_active":"2024-09-12T00:22:02.020186+0000","last_peered":"2024-09-12T00:22:02.020186+0000","last_clean":"2024-09-12T00:22:02.020186+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:02.020186+0000","last_undegraded":"2024-09-12T00:22:02.020186+0000","last_fullsized":"2024-09-12T00:22:02.020186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:43.510871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270254+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:19:24.270254+0000","last_peered":"2024-09-12T00:19:24.270254+0000","last_clean":"2024-09-12T00:19:24.270254+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:19:24.270254+0000","last_undegraded":"2024-09-12T00:19:24.270254+0000","last_fullsized":"2024-09-12T00:19:24.270254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.542991+0000","last_change":"2024-09-12T00:18:44.198208+0000","last_active":"2024-09-12T00:19:24.542991+0000","last_peered":"2024-09-12T00:19:24.542991+0000","last_clean":"2024-09-12T00:19:24.542991+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:19:24.542991+0000","last_undegraded":"2024-09-12T00:19:24.542991+0000","last_fullsized":"2024-09-12T00:19:24.542991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:02.437476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275369+0000","last_change":"2024-09-12T00:18:48.197273+0000","last_active":"2024-09-12T00:19:24.275369+0000","last_peered":"2024-09-12T00:19:24.275369+0000","last_clean":"2024-09-12T00:19:24.275369+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:19:24.275369+0000","last_undegraded":"2024-09-12T00:19:24.275369+0000","last_fullsized":"2024-09-12T00:19:24.275369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:31.361645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.454216+0000","last_change":"2024-09-12T00:18:50.235509+0000","last_active":"2024-09-12T00:21:58.454216+0000","last_peered":"2024-09-12T00:21:58.454216+0000","last_clean":"2024-09-12T00:21:58.454216+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:21:58.454216+0000","last_undegraded":"2024-09-12T00:21:58.454216+0000","last_fullsized":"2024-09-12T00:21:58.454216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.659270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545528+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:19:24.545528+0000","last_peered":"2024-09-12T00:19:24.545528+0000","last_clean":"2024-09-12T00:19:24.545528+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:19:24.545528+0000","last_undegraded":"2024-09-12T00:19:24.545528+0000","last_fullsized":"2024-09-12T00:19:24.545528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.515768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274180+0000","last_change":"2024-09-12T00:18:46.200898+0000","last_active":"2024-09-12T00:20:15.274180+0000","last_peered":"2024-09-12T00:20:15.274180+0000","last_clean":"2024-09-12T00:20:15.274180+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:20:15.274180+0000","last_undegraded":"2024-09-12T00:20:15.274180+0000","last_fullsized":"2024-09-12T00:20:15.274180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:07.775807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285725+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:19:24.285725+0000","last_peered":"2024-09-12T00:19:24.285725+0000","last_clean":"2024-09-12T00:19:24.285725+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:19:24.285725+0000","last_undegraded":"2024-09-12T00:19:24.285725+0000","last_fullsized":"2024-09-12T00:19:24.285725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270457+0000","last_change":"2024-09-12T00:18:44.210883+0000","last_active":"2024-09-12T00:19:24.270457+0000","last_peered":"2024-09-12T00:19:24.270457+0000","last_clean":"2024-09-12T00:19:24.270457+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:19:24.270457+0000","last_undegraded":"2024-09-12T00:19:24.270457+0000","last_fullsized":"2024-09-12T00:19:24.270457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547239+0000","last_change":"2024-09-12T00:18:48.208984+0000","last_active":"2024-09-12T00:19:24.547239+0000","last_peered":"2024-09-12T00:19:24.547239+0000","last_clean":"2024-09-12T00:19:24.547239+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:19:24.547239+0000","last_undegraded":"2024-09-12T00:19:24.547239+0000","last_fullsized":"2024-09-12T00:19:24.547239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.522290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.833142+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.833142+0000","last_peered":"2024-09-12T00:22:00.833142+0000","last_clean":"2024-09-12T00:22:00.833142+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.833142+0000","last_undegraded":"2024-09-12T00:22:00.833142+0000","last_fullsized":"2024-09-12T00:22:00.833142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:49.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299271+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:19:24.299271+0000","last_peered":"2024-09-12T00:19:24.299271+0000","last_clean":"2024-09-12T00:19:24.299271+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:19:24.299271+0000","last_undegraded":"2024-09-12T00:19:24.299271+0000","last_fullsized":"2024-09-12T00:19:24.299271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:40.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.160041+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:00.160041+0000","last_peered":"2024-09-12T00:21:00.160041+0000","last_clean":"2024-09-12T00:21:00.160041+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:00.160041+0000","last_undegraded":"2024-09-12T00:21:00.160041+0000","last_fullsized":"2024-09-12T00:21:00.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:16.953577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685978+0000","last_change":"2024-09-12T00:18:46.213096+0000","last_active":"2024-09-12T00:22:01.685978+0000","last_peered":"2024-09-12T00:22:01.685978+0000","last_clean":"2024-09-12T00:22:01.685978+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:01.685978+0000","last_undegraded":"2024-09-12T00:22:01.685978+0000","last_fullsized":"2024-09-12T00:22:01.685978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:49.858730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271876+0000","last_change":"2024-09-12T00:18:44.194766+0000","last_active":"2024-09-12T00:19:24.271876+0000","last_peered":"2024-09-12T00:19:24.271876+0000","last_clean":"2024-09-12T00:19:24.271876+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:19:24.271876+0000","last_undegraded":"2024-09-12T00:19:24.271876+0000","last_fullsized":"2024-09-12T00:19:24.271876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545007+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:19:24.545007+0000","last_peered":"2024-09-12T00:19:24.545007+0000","last_clean":"2024-09-12T00:19:24.545007+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:19:24.545007+0000","last_undegraded":"2024-09-12T00:19:24.545007+0000","last_fullsized":"2024-09-12T00:19:24.545007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597116+0000","last_change":"2024-09-12T00:18:48.207153+0000","last_active":"2024-09-12T00:20:52.597116+0000","last_peered":"2024-09-12T00:20:52.597116+0000","last_clean":"2024-09-12T00:20:52.597116+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:20:52.597116+0000","last_undegraded":"2024-09-12T00:20:52.597116+0000","last_fullsized":"2024-09-12T00:20:52.597116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:40.156001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276330+0000","last_change":"2024-09-12T00:18:50.224303+0000","last_active":"2024-09-12T00:20:58.276330+0000","last_peered":"2024-09-12T00:20:58.276330+0000","last_clean":"2024-09-12T00:20:58.276330+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:20:58.276330+0000","last_undegraded":"2024-09-12T00:20:58.276330+0000","last_fullsized":"2024-09-12T00:20:58.276330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.322839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268956+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:19:24.268956+0000","last_peered":"2024-09-12T00:19:24.268956+0000","last_clean":"2024-09-12T00:19:24.268956+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:19:24.268956+0000","last_undegraded":"2024-09-12T00:19:24.268956+0000","last_fullsized":"2024-09-12T00:19:24.268956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.028206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:32.516814+0000","last_change":"2024-09-12T00:19:24.290331+0000","last_active":"2024-09-12T00:19:32.516814+0000","last_peered":"2024-09-12T00:19:32.516814+0000","last_clean":"2024-09-12T00:19:32.516814+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:19:32.516814+0000","last_undegraded":"2024-09-12T00:19:32.516814+0000","last_fullsized":"2024-09-12T00:19:32.516814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547212+0000","last_change":"2024-09-12T00:18:44.199819+0000","last_active":"2024-09-12T00:19:24.547212+0000","last_peered":"2024-09-12T00:19:24.547212+0000","last_clean":"2024-09-12T00:19:24.547212+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:19:24.547212+0000","last_undegraded":"2024-09-12T00:19:24.547212+0000","last_fullsized":"2024-09-12T00:19:24.547212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:41.074307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292863+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:19:24.292863+0000","last_peered":"2024-09-12T00:19:24.292863+0000","last_clean":"2024-09-12T00:19:24.292863+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:19:24.292863+0000","last_undegraded":"2024-09-12T00:19:24.292863+0000","last_fullsized":"2024-09-12T00:19:24.292863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.303925+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:19:24.303925+0000","last_peered":"2024-09-12T00:19:24.303925+0000","last_clean":"2024-09-12T00:19:24.303925+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:19:24.303925+0000","last_undegraded":"2024-09-12T00:19:24.303925+0000","last_fullsized":"2024-09-12T00:19:24.303925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.689100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274457+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:19:24.274457+0000","last_peered":"2024-09-12T00:19:24.274457+0000","last_clean":"2024-09-12T00:19:24.274457+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:19:24.274457+0000","last_undegraded":"2024-09-12T00:19:24.274457+0000","last_fullsized":"2024-09-12T00:19:24.274457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.218218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":371,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453469+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:21:58.453469+0000","last_peered":"2024-09-12T00:21:58.453469+0000","last_clean":"2024-09-12T00:21:58.453469+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:21:58.453469+0000","last_undegraded":"2024-09-12T00:21:58.453469+0000","last_fullsized":"2024-09-12T00:21:58.453469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949445+0000","last_change":"2024-09-12T00:18:46.215890+0000","last_active":"2024-09-12T00:20:55.949445+0000","last_peered":"2024-09-12T00:20:55.949445+0000","last_clean":"2024-09-12T00:20:55.949445+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:20:55.949445+0000","last_undegraded":"2024-09-12T00:20:55.949445+0000","last_fullsized":"2024-09-12T00:20:55.949445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:46.309362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.873890+0000","last_change":"2024-09-12T00:18:44.212538+0000","last_active":"2024-09-12T00:22:01.873890+0000","last_peered":"2024-09-12T00:22:01.873890+0000","last_clean":"2024-09-12T00:22:01.873890+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:01.873890+0000","last_undegraded":"2024-09-12T00:22:01.873890+0000","last_fullsized":"2024-09-12T00:22:01.873890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.256228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548363+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:19:24.548363+0000","last_peered":"2024-09-12T00:19:24.548363+0000","last_clean":"2024-09-12T00:19:24.548363+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:19:24.548363+0000","last_undegraded":"2024-09-12T00:19:24.548363+0000","last_fullsized":"2024-09-12T00:19:24.548363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291763+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:19:24.291763+0000","last_peered":"2024-09-12T00:19:24.291763+0000","last_clean":"2024-09-12T00:19:24.291763+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:19:24.291763+0000","last_undegraded":"2024-09-12T00:19:24.291763+0000","last_fullsized":"2024-09-12T00:19:24.291763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287632+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:19:24.287632+0000","last_peered":"2024-09-12T00:19:24.287632+0000","last_clean":"2024-09-12T00:19:24.287632+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:19:24.287632+0000","last_undegraded":"2024-09-12T00:19:24.287632+0000","last_fullsized":"2024-09-12T00:19:24.287632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:13.589684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":401,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.426978+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:02.426978+0000","last_peered":"2024-09-12T00:22:02.426978+0000","last_clean":"2024-09-12T00:22:02.426978+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:02.426978+0000","last_undegraded":"2024-09-12T00:22:02.426978+0000","last_fullsized":"2024-09-12T00:22:02.426978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:31.647959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.112613+0000","last_change":"2024-09-12T00:18:46.192554+0000","last_active":"2024-09-12T00:22:02.112613+0000","last_peered":"2024-09-12T00:22:02.112613+0000","last_clean":"2024-09-12T00:22:02.112613+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:02.112613+0000","last_undegraded":"2024-09-12T00:22:02.112613+0000","last_fullsized":"2024-09-12T00:22:02.112613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:28.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288209+0000","last_change":"2024-09-12T00:18:44.208784+0000","last_active":"2024-09-12T00:19:24.288209+0000","last_peered":"2024-09-12T00:19:24.288209+0000","last_clean":"2024-09-12T00:19:24.288209+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:19:24.288209+0000","last_undegraded":"2024-09-12T00:19:24.288209+0000","last_fullsized":"2024-09-12T00:19:24.288209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:59.889965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298936+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:19:24.298936+0000","last_peered":"2024-09-12T00:19:24.298936+0000","last_clean":"2024-09-12T00:19:24.298936+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:19:24.298936+0000","last_undegraded":"2024-09-12T00:19:24.298936+0000","last_fullsized":"2024-09-12T00:19:24.298936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.854016+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:20:59.854016+0000","last_peered":"2024-09-12T00:20:59.854016+0000","last_clean":"2024-09-12T00:20:59.854016+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:20:59.854016+0000","last_undegraded":"2024-09-12T00:20:59.854016+0000","last_fullsized":"2024-09-12T00:20:59.854016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:13.228327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'89","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.240753+0000","last_change":"2024-09-12T00:18:50.216704+0000","last_active":"2024-09-12T00:20:58.240753+0000","last_peered":"2024-09-12T00:20:58.240753+0000","last_clean":"2024-09-12T00:20:58.240753+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:20:58.240753+0000","last_undegraded":"2024-09-12T00:20:58.240753+0000","last_fullsized":"2024-09-12T00:20:58.240753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:30.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545585+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:19:24.545585+0000","last_peered":"2024-09-12T00:19:24.545585+0000","last_clean":"2024-09-12T00:19:24.545585+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:19:24.545585+0000","last_undegraded":"2024-09-12T00:19:24.545585+0000","last_fullsized":"2024-09-12T00:19:24.545585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.985554+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:01.985554+0000","last_peered":"2024-09-12T00:22:01.985554+0000","last_clean":"2024-09-12T00:22:01.985554+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:01.985554+0000","last_undegraded":"2024-09-12T00:22:01.985554+0000","last_fullsized":"2024-09-12T00:22:01.985554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:58.559812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904828+0000","last_change":"2024-09-12T00:18:46.189861+0000","last_active":"2024-09-12T00:22:01.904828+0000","last_peered":"2024-09-12T00:22:01.904828+0000","last_clean":"2024-09-12T00:22:01.904828+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:01.904828+0000","last_undegraded":"2024-09-12T00:22:01.904828+0000","last_fullsized":"2024-09-12T00:22:01.904828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291694+0000","last_change":"2024-09-12T00:18:44.220926+0000","last_active":"2024-09-12T00:19:24.291694+0000","last_peered":"2024-09-12T00:19:24.291694+0000","last_clean":"2024-09-12T00:19:24.291694+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:19:24.291694+0000","last_undegraded":"2024-09-12T00:19:24.291694+0000","last_fullsized":"2024-09-12T00:19:24.291694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:45.017062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279723+0000","last_change":"2024-09-12T00:18:48.216343+0000","last_active":"2024-09-12T00:19:24.279723+0000","last_peered":"2024-09-12T00:19:24.279723+0000","last_clean":"2024-09-12T00:19:24.279723+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:19:24.279723+0000","last_undegraded":"2024-09-12T00:19:24.279723+0000","last_fullsized":"2024-09-12T00:19:24.279723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:54.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.260323+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:20:58.260323+0000","last_peered":"2024-09-12T00:20:58.260323+0000","last_clean":"2024-09-12T00:20:58.260323+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:20:58.260323+0000","last_undegraded":"2024-09-12T00:20:58.260323+0000","last_fullsized":"2024-09-12T00:20:58.260323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.846790+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.846790+0000","last_peered":"2024-09-12T00:20:57.846790+0000","last_clean":"2024-09-12T00:20:57.846790+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.846790+0000","last_undegraded":"2024-09-12T00:20:57.846790+0000","last_fullsized":"2024-09-12T00:20:57.846790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.924187+0000","last_change":"2024-09-12T00:18:46.217714+0000","last_active":"2024-09-12T00:22:01.924187+0000","last_peered":"2024-09-12T00:22:01.924187+0000","last_clean":"2024-09-12T00:22:01.924187+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:01.924187+0000","last_undegraded":"2024-09-12T00:22:01.924187+0000","last_fullsized":"2024-09-12T00:22:01.924187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272131+0000","last_change":"2024-09-12T00:18:44.211179+0000","last_active":"2024-09-12T00:19:24.272131+0000","last_peered":"2024-09-12T00:19:24.272131+0000","last_clean":"2024-09-12T00:19:24.272131+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:19:24.272131+0000","last_undegraded":"2024-09-12T00:19:24.272131+0000","last_fullsized":"2024-09-12T00:19:24.272131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.906157+0000","last_change":"2024-09-12T00:18:46.194089+0000","last_active":"2024-09-12T00:22:01.906157+0000","last_peered":"2024-09-12T00:22:01.906157+0000","last_clean":"2024-09-12T00:22:01.906157+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:01.906157+0000","last_undegraded":"2024-09-12T00:22:01.906157+0000","last_fullsized":"2024-09-12T00:22:01.906157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278439+0000","last_change":"2024-09-12T00:18:44.197793+0000","last_active":"2024-09-12T00:19:24.278439+0000","last_peered":"2024-09-12T00:19:24.278439+0000","last_clean":"2024-09-12T00:19:24.278439+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:19:24.278439+0000","last_undegraded":"2024-09-12T00:19:24.278439+0000","last_fullsized":"2024-09-12T00:19:24.278439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:28.573321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267773+0000","last_change":"2024-09-12T00:18:48.200680+0000","last_active":"2024-09-12T00:19:24.267773+0000","last_peered":"2024-09-12T00:19:24.267773+0000","last_clean":"2024-09-12T00:19:24.267773+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:19:24.267773+0000","last_undegraded":"2024-09-12T00:19:24.267773+0000","last_fullsized":"2024-09-12T00:19:24.267773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'42","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.999610+0000","last_change":"2024-09-12T00:18:50.224287+0000","last_active":"2024-09-12T00:22:00.999610+0000","last_peered":"2024-09-12T00:22:00.999610+0000","last_clean":"2024-09-12T00:22:00.999610+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:22:00.999610+0000","last_undegraded":"2024-09-12T00:22:00.999610+0000","last_fullsized":"2024-09-12T00:22:00.999610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":85,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.705857+0000","last_change":"2024-09-12T00:18:46.214462+0000","last_active":"2024-09-12T00:22:01.705857+0000","last_peered":"2024-09-12T00:22:01.705857+0000","last_clean":"2024-09-12T00:22:01.705857+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:22:01.705857+0000","last_undegraded":"2024-09-12T00:22:01.705857+0000","last_fullsized":"2024-09-12T00:22:01.705857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:37.657684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.472192+0000","last_change":"2024-09-12T00:18:44.196857+0000","last_active":"2024-09-12T00:22:01.472192+0000","last_peered":"2024-09-12T00:22:01.472192+0000","last_clean":"2024-09-12T00:22:01.472192+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:01.472192+0000","last_undegraded":"2024-09-12T00:22:01.472192+0000","last_fullsized":"2024-09-12T00:22:01.472192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.238155+0000","last_change":"2024-09-12T00:18:50.204600+0000","last_active":"2024-09-12T00:20:58.238155+0000","last_peered":"2024-09-12T00:20:58.238155+0000","last_clean":"2024-09-12T00:20:58.238155+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:20:58.238155+0000","last_undegraded":"2024-09-12T00:20:58.238155+0000","last_fullsized":"2024-09-12T00:20:58.238155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.683615+0000","last_change":"2024-09-12T00:18:46.191419+0000","last_active":"2024-09-12T00:22:01.683615+0000","last_peered":"2024-09-12T00:22:01.683615+0000","last_clean":"2024-09-12T00:22:01.683615+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:22:01.683615+0000","last_undegraded":"2024-09-12T00:22:01.683615+0000","last_fullsized":"2024-09-12T00:22:01.683615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:24.777789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.956540+0000","last_change":"2024-09-12T00:18:44.218418+0000","last_active":"2024-09-12T00:19:30.956540+0000","last_peered":"2024-09-12T00:19:30.956540+0000","last_clean":"2024-09-12T00:19:30.956540+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:19:30.956540+0000","last_undegraded":"2024-09-12T00:19:30.956540+0000","last_fullsized":"2024-09-12T00:19:30.956540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:11.461908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550826+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:19:24.550826+0000","last_peered":"2024-09-12T00:19:24.550826+0000","last_clean":"2024-09-12T00:19:24.550826+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:19:24.550826+0000","last_undegraded":"2024-09-12T00:19:24.550826+0000","last_fullsized":"2024-09-12T00:19:24.550826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:10.736641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272148+0000","last_change":"2024-09-12T00:18:50.216262+0000","last_active":"2024-09-12T00:20:58.272148+0000","last_peered":"2024-09-12T00:20:58.272148+0000","last_clean":"2024-09-12T00:20:58.272148+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:20:58.272148+0000","last_undegraded":"2024-09-12T00:20:58.272148+0000","last_fullsized":"2024-09-12T00:20:58.272148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'15","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035728+0000","last_change":"2024-09-12T00:18:46.211034+0000","last_active":"2024-09-12T00:22:02.035728+0000","last_peered":"2024-09-12T00:22:02.035728+0000","last_clean":"2024-09-12T00:22:02.035728+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:22:02.035728+0000","last_undegraded":"2024-09-12T00:22:02.035728+0000","last_fullsized":"2024-09-12T00:22:02.035728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272298+0000","last_change":"2024-09-12T00:18:44.193399+0000","last_active":"2024-09-12T00:19:24.272298+0000","last_peered":"2024-09-12T00:19:24.272298+0000","last_clean":"2024-09-12T00:19:24.272298+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:19:24.272298+0000","last_undegraded":"2024-09-12T00:19:24.272298+0000","last_fullsized":"2024-09-12T00:19:24.272298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293437+0000","last_change":"2024-09-12T00:19:24.291735+0000","last_active":"2024-09-12T00:19:24.293437+0000","last_peered":"2024-09-12T00:19:24.293437+0000","last_clean":"2024-09-12T00:19:24.293437+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:19:24.293437+0000","last_undegraded":"2024-09-12T00:19:24.293437+0000","last_fullsized":"2024-09-12T00:19:24.293437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:24.444471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:22.613326+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:21:22.613326+0000","last_peered":"2024-09-12T00:21:22.613326+0000","last_clean":"2024-09-12T00:21:22.613326+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:21:22.613326+0000","last_undegraded":"2024-09-12T00:21:22.613326+0000","last_fullsized":"2024-09-12T00:21:22.613326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.520849+0000","last_change":"2024-09-12T00:18:46.214392+0000","last_active":"2024-09-12T00:22:01.520849+0000","last_peered":"2024-09-12T00:22:01.520849+0000","last_clean":"2024-09-12T00:22:01.520849+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:22:01.520849+0000","last_undegraded":"2024-09-12T00:22:01.520849+0000","last_fullsized":"2024-09-12T00:22:01.520849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.180192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.769730+0000","last_change":"2024-09-12T00:18:44.202045+0000","last_active":"2024-09-12T00:19:31.769730+0000","last_peered":"2024-09-12T00:19:31.769730+0000","last_clean":"2024-09-12T00:19:31.769730+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:19:31.769730+0000","last_undegraded":"2024-09-12T00:19:31.769730+0000","last_fullsized":"2024-09-12T00:19:31.769730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276461+0000","last_change":"2024-09-12T00:18:48.196567+0000","last_active":"2024-09-12T00:19:24.276461+0000","last_peered":"2024-09-12T00:19:24.276461+0000","last_clean":"2024-09-12T00:19:24.276461+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:19:24.276461+0000","last_undegraded":"2024-09-12T00:19:24.276461+0000","last_fullsized":"2024-09-12T00:19:24.276461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:59.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.830301+0000","last_change":"2024-09-12T00:18:50.222960+0000","last_active":"2024-09-12T00:20:57.830301+0000","last_peered":"2024-09-12T00:20:57.830301+0000","last_clean":"2024-09-12T00:20:57.830301+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:20:57.830301+0000","last_undegraded":"2024-09-12T00:20:57.830301+0000","last_fullsized":"2024-09-12T00:20:57.830301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:40.015121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547263+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:19:24.547263+0000","last_peered":"2024-09-12T00:19:24.547263+0000","last_clean":"2024-09-12T00:19:24.547263+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:19:24.547263+0000","last_undegraded":"2024-09-12T00:19:24.547263+0000","last_fullsized":"2024-09-12T00:19:24.547263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:36.813068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.688555+0000","last_change":"2024-09-12T00:18:46.199141+0000","last_active":"2024-09-12T00:22:01.688555+0000","last_peered":"2024-09-12T00:22:01.688555+0000","last_clean":"2024-09-12T00:22:01.688555+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:01.688555+0000","last_undegraded":"2024-09-12T00:22:01.688555+0000","last_fullsized":"2024-09-12T00:22:01.688555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:15.268348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286089+0000","last_change":"2024-09-12T00:18:44.202449+0000","last_active":"2024-09-12T00:19:24.286089+0000","last_peered":"2024-09-12T00:19:24.286089+0000","last_clean":"2024-09-12T00:19:24.286089+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:19:24.286089+0000","last_undegraded":"2024-09-12T00:19:24.286089+0000","last_fullsized":"2024-09-12T00:19:24.286089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:21.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.297596+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:19:24.297596+0000","last_peered":"2024-09-12T00:19:24.297596+0000","last_clean":"2024-09-12T00:19:24.297596+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:19:24.297596+0000","last_undegraded":"2024-09-12T00:19:24.297596+0000","last_fullsized":"2024-09-12T00:19:24.297596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.140374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453820+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:21:58.453820+0000","last_peered":"2024-09-12T00:21:58.453820+0000","last_clean":"2024-09-12T00:21:58.453820+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:21:58.453820+0000","last_undegraded":"2024-09-12T00:21:58.453820+0000","last_fullsized":"2024-09-12T00:21:58.453820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:47.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904775+0000","last_change":"2024-09-12T00:18:46.184978+0000","last_active":"2024-09-12T00:22:01.904775+0000","last_peered":"2024-09-12T00:22:01.904775+0000","last_clean":"2024-09-12T00:22:01.904775+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:22:01.904775+0000","last_undegraded":"2024-09-12T00:22:01.904775+0000","last_fullsized":"2024-09-12T00:22:01.904775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:34.862818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.670182+0000","last_change":"2024-09-12T00:18:44.200635+0000","last_active":"2024-09-12T00:21:00.670182+0000","last_peered":"2024-09-12T00:21:00.670182+0000","last_clean":"2024-09-12T00:21:00.670182+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:21:00.670182+0000","last_undegraded":"2024-09-12T00:21:00.670182+0000","last_fullsized":"2024-09-12T00:21:00.670182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274386+0000","last_change":"2024-09-12T00:18:48.218098+0000","last_active":"2024-09-12T00:19:24.274386+0000","last_peered":"2024-09-12T00:19:24.274386+0000","last_clean":"2024-09-12T00:19:24.274386+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:19:24.274386+0000","last_undegraded":"2024-09-12T00:19:24.274386+0000","last_fullsized":"2024-09-12T00:19:24.274386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'63","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.603751+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:21:17.603751+0000","last_peered":"2024-09-12T00:21:17.603751+0000","last_clean":"2024-09-12T00:21:17.603751+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:21:17.603751+0000","last_undegraded":"2024-09-12T00:21:17.603751+0000","last_fullsized":"2024-09-12T00:21:17.603751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.110848+0000","last_change":"2024-09-12T00:18:46.184999+0000","last_active":"2024-09-12T00:22:02.110848+0000","last_peered":"2024-09-12T00:22:02.110848+0000","last_clean":"2024-09-12T00:22:02.110848+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:22:02.110848+0000","last_undegraded":"2024-09-12T00:22:02.110848+0000","last_fullsized":"2024-09-12T00:22:02.110848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.882201+0000","last_change":"2024-09-12T00:18:44.212572+0000","last_active":"2024-09-12T00:22:01.882201+0000","last_peered":"2024-09-12T00:22:01.882201+0000","last_clean":"2024-09-12T00:22:01.882201+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:01.882201+0000","last_undegraded":"2024-09-12T00:22:01.882201+0000","last_fullsized":"2024-09-12T00:22:01.882201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.022098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271547+0000","last_change":"2024-09-12T00:18:48.208202+0000","last_active":"2024-09-12T00:19:24.271547+0000","last_peered":"2024-09-12T00:19:24.271547+0000","last_clean":"2024-09-12T00:19:24.271547+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:19:24.271547+0000","last_undegraded":"2024-09-12T00:19:24.271547+0000","last_fullsized":"2024-09-12T00:19:24.271547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.859052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.228341+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:20:58.228341+0000","last_peered":"2024-09-12T00:20:58.228341+0000","last_clean":"2024-09-12T00:20:58.228341+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:20:58.228341+0000","last_undegraded":"2024-09-12T00:20:58.228341+0000","last_fullsized":"2024-09-12T00:20:58.228341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903921+0000","last_change":"2024-09-12T00:18:46.183379+0000","last_active":"2024-09-12T00:22:01.903921+0000","last_peered":"2024-09-12T00:22:01.903921+0000","last_clean":"2024-09-12T00:22:01.903921+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:22:01.903921+0000","last_undegraded":"2024-09-12T00:22:01.903921+0000","last_fullsized":"2024-09-12T00:22:01.903921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:35.985414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548742+0000","last_change":"2024-09-12T00:18:44.217239+0000","last_active":"2024-09-12T00:19:24.548742+0000","last_peered":"2024-09-12T00:19:24.548742+0000","last_clean":"2024-09-12T00:19:24.548742+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:19:24.548742+0000","last_undegraded":"2024-09-12T00:19:24.548742+0000","last_fullsized":"2024-09-12T00:19:24.548742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271418+0000","last_change":"2024-09-12T00:18:48.211981+0000","last_active":"2024-09-12T00:19:24.271418+0000","last_peered":"2024-09-12T00:19:24.271418+0000","last_clean":"2024-09-12T00:19:24.271418+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:19:24.271418+0000","last_undegraded":"2024-09-12T00:19:24.271418+0000","last_fullsized":"2024-09-12T00:19:24.271418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:50.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'32","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.262956+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:20:58.262956+0000","last_peered":"2024-09-12T00:20:58.262956+0000","last_clean":"2024-09-12T00:20:58.262956+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:20:58.262956+0000","last_undegraded":"2024-09-12T00:20:58.262956+0000","last_fullsized":"2024-09-12T00:20:58.262956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'3","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703821+0000","last_change":"2024-09-12T00:18:46.183984+0000","last_active":"2024-09-12T00:22:01.703821+0000","last_peered":"2024-09-12T00:22:01.703821+0000","last_clean":"2024-09-12T00:22:01.703821+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:01.703821+0000","last_undegraded":"2024-09-12T00:22:01.703821+0000","last_fullsized":"2024-09-12T00:22:01.703821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:51.504748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290737+0000","last_change":"2024-09-12T00:18:44.197634+0000","last_active":"2024-09-12T00:19:24.290737+0000","last_peered":"2024-09-12T00:19:24.290737+0000","last_clean":"2024-09-12T00:19:24.290737+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:19:24.290737+0000","last_undegraded":"2024-09-12T00:19:24.290737+0000","last_fullsized":"2024-09-12T00:19:24.290737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:56.491323+0000","last_change":"2024-09-12T00:18:48.204166+0000","last_active":"2024-09-12T00:20:56.491323+0000","last_peered":"2024-09-12T00:20:56.491323+0000","last_clean":"2024-09-12T00:20:56.491323+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:20:56.491323+0000","last_undegraded":"2024-09-12T00:20:56.491323+0000","last_fullsized":"2024-09-12T00:20:56.491323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.533140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845387+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:00.845387+0000","last_peered":"2024-09-12T00:22:00.845387+0000","last_clean":"2024-09-12T00:22:00.845387+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:00.845387+0000","last_undegraded":"2024-09-12T00:22:00.845387+0000","last_fullsized":"2024-09-12T00:22:00.845387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291583+0000","last_change":"2024-09-12T00:18:46.213160+0000","last_active":"2024-09-12T00:19:24.291583+0000","last_peered":"2024-09-12T00:19:24.291583+0000","last_clean":"2024-09-12T00:19:24.291583+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:19:24.291583+0000","last_undegraded":"2024-09-12T00:19:24.291583+0000","last_fullsized":"2024-09-12T00:19:24.291583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.139206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265951+0000","last_change":"2024-09-12T00:18:44.203057+0000","last_active":"2024-09-12T00:19:24.265951+0000","last_peered":"2024-09-12T00:19:24.265951+0000","last_clean":"2024-09-12T00:19:24.265951+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:19:24.265951+0000","last_undegraded":"2024-09-12T00:19:24.265951+0000","last_fullsized":"2024-09-12T00:19:24.265951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521595+0000","last_change":"2024-09-12T00:18:46.199022+0000","last_active":"2024-09-12T00:22:01.521595+0000","last_peered":"2024-09-12T00:22:01.521595+0000","last_clean":"2024-09-12T00:22:01.521595+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:22:01.521595+0000","last_undegraded":"2024-09-12T00:22:01.521595+0000","last_fullsized":"2024-09-12T00:22:01.521595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:13.922738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543621+0000","last_change":"2024-09-12T00:18:44.195990+0000","last_active":"2024-09-12T00:19:24.543621+0000","last_peered":"2024-09-12T00:19:24.543621+0000","last_clean":"2024-09-12T00:19:24.543621+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:19:24.543621+0000","last_undegraded":"2024-09-12T00:19:24.543621+0000","last_fullsized":"2024-09-12T00:19:24.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.780507+0000","last_change":"2024-09-12T00:18:46.188983+0000","last_active":"2024-09-12T00:21:00.780507+0000","last_peered":"2024-09-12T00:21:00.780507+0000","last_clean":"2024-09-12T00:21:00.780507+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:21:00.780507+0000","last_undegraded":"2024-09-12T00:21:00.780507+0000","last_fullsized":"2024-09-12T00:21:00.780507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.278021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605456+0000","last_change":"2024-09-12T00:18:44.216479+0000","last_active":"2024-09-12T00:20:52.605456+0000","last_peered":"2024-09-12T00:20:52.605456+0000","last_clean":"2024-09-12T00:20:52.605456+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:20:52.605456+0000","last_undegraded":"2024-09-12T00:20:52.605456+0000","last_fullsized":"2024-09-12T00:20:52.605456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.659928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020857+0000","last_change":"2024-09-12T00:18:46.199070+0000","last_active":"2024-09-12T00:22:02.020857+0000","last_peered":"2024-09-12T00:22:02.020857+0000","last_clean":"2024-09-12T00:22:02.020857+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:22:02.020857+0000","last_undegraded":"2024-09-12T00:22:02.020857+0000","last_fullsized":"2024-09-12T00:22:02.020857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550235+0000","last_change":"2024-09-12T00:18:44.216172+0000","last_active":"2024-09-12T00:19:24.550235+0000","last_peered":"2024-09-12T00:19:24.550235+0000","last_clean":"2024-09-12T00:19:24.550235+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:19:24.550235+0000","last_undegraded":"2024-09-12T00:19:24.550235+0000","last_fullsized":"2024-09-12T00:19:24.550235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.247891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.094167+0000","last_change":"2024-09-12T00:18:46.195536+0000","last_active":"2024-09-12T00:22:02.094167+0000","last_peered":"2024-09-12T00:22:02.094167+0000","last_clean":"2024-09-12T00:22:02.094167+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:02.094167+0000","last_undegraded":"2024-09-12T00:22:02.094167+0000","last_fullsized":"2024-09-12T00:22:02.094167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215866+0000","last_change":"2024-09-12T00:18:44.197186+0000","last_active":"2024-09-12T00:19:30.215866+0000","last_peered":"2024-09-12T00:19:30.215866+0000","last_clean":"2024-09-12T00:19:30.215866+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:19:30.215866+0000","last_undegraded":"2024-09-12T00:19:30.215866+0000","last_fullsized":"2024-09-12T00:19:30.215866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:56.784241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091927+0000","last_change":"2024-09-12T00:18:46.217504+0000","last_active":"2024-09-12T00:22:02.091927+0000","last_peered":"2024-09-12T00:22:02.091927+0000","last_clean":"2024-09-12T00:22:02.091927+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:02.091927+0000","last_undegraded":"2024-09-12T00:22:02.091927+0000","last_fullsized":"2024-09-12T00:22:02.091927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:19.889526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599343+0000","last_change":"2024-09-12T00:18:44.213699+0000","last_active":"2024-09-12T00:20:57.599343+0000","last_peered":"2024-09-12T00:20:57.599343+0000","last_clean":"2024-09-12T00:20:57.599343+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:20:57.599343+0000","last_undegraded":"2024-09-12T00:20:57.599343+0000","last_fullsized":"2024-09-12T00:20:57.599343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020343+0000","last_change":"2024-09-12T00:18:46.210908+0000","last_active":"2024-09-12T00:22:02.020343+0000","last_peered":"2024-09-12T00:22:02.020343+0000","last_clean":"2024-09-12T00:22:02.020343+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:22:02.020343+0000","last_undegraded":"2024-09-12T00:22:02.020343+0000","last_fullsized":"2024-09-12T00:22:02.020343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278780+0000","last_change":"2024-09-12T00:18:44.198599+0000","last_active":"2024-09-12T00:19:24.278780+0000","last_peered":"2024-09-12T00:19:24.278780+0000","last_clean":"2024-09-12T00:19:24.278780+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:19:24.278780+0000","last_undegraded":"2024-09-12T00:19:24.278780+0000","last_fullsized":"2024-09-12T00:19:24.278780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:41.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091749+0000","last_change":"2024-09-12T00:18:46.211137+0000","last_active":"2024-09-12T00:22:02.091749+0000","last_peered":"2024-09-12T00:22:02.091749+0000","last_clean":"2024-09-12T00:22:02.091749+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:02.091749+0000","last_undegraded":"2024-09-12T00:22:02.091749+0000","last_fullsized":"2024-09-12T00:22:02.091749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.932223+0000","last_change":"2024-09-12T00:18:44.198634+0000","last_active":"2024-09-12T00:20:55.932223+0000","last_peered":"2024-09-12T00:20:55.932223+0000","last_clean":"2024-09-12T00:20:55.932223+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:20:55.932223+0000","last_undegraded":"2024-09-12T00:20:55.932223+0000","last_fullsized":"2024-09-12T00:20:55.932223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:48.169091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.018907+0000","last_change":"2024-09-12T00:18:46.201393+0000","last_active":"2024-09-12T00:22:02.018907+0000","last_peered":"2024-09-12T00:22:02.018907+0000","last_clean":"2024-09-12T00:22:02.018907+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:22:02.018907+0000","last_undegraded":"2024-09-12T00:22:02.018907+0000","last_fullsized":"2024-09-12T00:22:02.018907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:13.149208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277355+0000","last_change":"2024-09-12T00:18:44.216635+0000","last_active":"2024-09-12T00:19:24.277355+0000","last_peered":"2024-09-12T00:19:24.277355+0000","last_clean":"2024-09-12T00:19:24.277355+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:19:24.277355+0000","last_undegraded":"2024-09-12T00:19:24.277355+0000","last_fullsized":"2024-09-12T00:19:24.277355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.723598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544142+0000","last_change":"2024-09-12T00:18:44.217899+0000","last_active":"2024-09-12T00:19:24.544142+0000","last_peered":"2024-09-12T00:19:24.544142+0000","last_clean":"2024-09-12T00:19:24.544142+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:19:24.544142+0000","last_undegraded":"2024-09-12T00:19:24.544142+0000","last_fullsized":"2024-09-12T00:19:24.544142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:23.029905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548033+0000","last_change":"2024-09-12T00:18:46.198204+0000","last_active":"2024-09-12T00:19:24.548033+0000","last_peered":"2024-09-12T00:19:24.548033+0000","last_clean":"2024-09-12T00:19:24.548033+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:19:24.548033+0000","last_undegraded":"2024-09-12T00:19:24.548033+0000","last_fullsized":"2024-09-12T00:19:24.548033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272805+0000","last_change":"2024-09-12T00:18:44.201625+0000","last_active":"2024-09-12T00:19:24.272805+0000","last_peered":"2024-09-12T00:19:24.272805+0000","last_clean":"2024-09-12T00:19:24.272805+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:19:24.272805+0000","last_undegraded":"2024-09-12T00:19:24.272805+0000","last_fullsized":"2024-09-12T00:19:24.272805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:25.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.800593+0000","last_change":"2024-09-12T00:18:46.206094+0000","last_active":"2024-09-12T00:21:00.800593+0000","last_peered":"2024-09-12T00:21:00.800593+0000","last_clean":"2024-09-12T00:21:00.800593+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:21:00.800593+0000","last_undegraded":"2024-09-12T00:21:00.800593+0000","last_fullsized":"2024-09-12T00:21:00.800593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:54.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276552+0000","last_change":"2024-09-12T00:18:44.196752+0000","last_active":"2024-09-12T00:19:24.276552+0000","last_peered":"2024-09-12T00:19:24.276552+0000","last_clean":"2024-09-12T00:19:24.276552+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:19:24.276552+0000","last_undegraded":"2024-09-12T00:19:24.276552+0000","last_fullsized":"2024-09-12T00:19:24.276552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521751+0000","last_change":"2024-09-12T00:19:24.549151+0000","last_active":"2024-09-12T00:22:01.521751+0000","last_peered":"2024-09-12T00:22:01.521751+0000","last_clean":"2024-09-12T00:22:01.521751+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:01.521751+0000","last_undegraded":"2024-09-12T00:22:01.521751+0000","last_fullsized":"2024-09-12T00:22:01.521751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:25.450062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.482133+0000","last_change":"2024-09-12T00:18:44.183718+0000","last_active":"2024-09-12T00:21:00.482133+0000","last_peered":"2024-09-12T00:21:00.482133+0000","last_clean":"2024-09-12T00:21:00.482133+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:21:00.482133+0000","last_undegraded":"2024-09-12T00:21:00.482133+0000","last_fullsized":"2024-09-12T00:21:00.482133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600242+0000","last_change":"2024-09-12T00:18:46.203607+0000","last_active":"2024-09-12T00:21:02.600242+0000","last_peered":"2024-09-12T00:21:02.600242+0000","last_clean":"2024-09-12T00:21:02.600242+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:21:02.600242+0000","last_undegraded":"2024-09-12T00:21:02.600242+0000","last_fullsized":"2024-09-12T00:21:02.600242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:01.158629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.255211+0000","last_change":"2024-09-12T00:18:44.205642+0000","last_active":"2024-09-12T00:20:15.255211+0000","last_peered":"2024-09-12T00:20:15.255211+0000","last_clean":"2024-09-12T00:20:15.255211+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:20:15.255211+0000","last_undegraded":"2024-09-12T00:20:15.255211+0000","last_fullsized":"2024-09-12T00:20:15.255211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.988420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950179+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:20:55.950179+0000","last_peered":"2024-09-12T00:20:55.950179+0000","last_clean":"2024-09-12T00:20:55.950179+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:20:55.950179+0000","last_undegraded":"2024-09-12T00:20:55.950179+0000","last_fullsized":"2024-09-12T00:20:55.950179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597799+0000","last_change":"2024-09-12T00:18:44.198284+0000","last_active":"2024-09-12T00:21:07.597799+0000","last_peered":"2024-09-12T00:21:07.597799+0000","last_clean":"2024-09-12T00:21:07.597799+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:21:07.597799+0000","last_undegraded":"2024-09-12T00:21:07.597799+0000","last_fullsized":"2024-09-12T00:21:07.597799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270885+0000","last_change":"2024-09-12T00:18:46.210796+0000","last_active":"2024-09-12T00:19:24.270885+0000","last_peered":"2024-09-12T00:19:24.270885+0000","last_clean":"2024-09-12T00:19:24.270885+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:19:24.270885+0000","last_undegraded":"2024-09-12T00:19:24.270885+0000","last_fullsized":"2024-09-12T00:19:24.270885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299482+0000","last_change":"2024-09-12T00:18:44.216498+0000","last_active":"2024-09-12T00:19:24.299482+0000","last_peered":"2024-09-12T00:19:24.299482+0000","last_clean":"2024-09-12T00:19:24.299482+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:19:24.299482+0000","last_undegraded":"2024-09-12T00:19:24.299482+0000","last_fullsized":"2024-09-12T00:19:24.299482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.498751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215514+0000","last_change":"2024-09-12T00:18:44.216871+0000","last_active":"2024-09-12T00:19:30.215514+0000","last_peered":"2024-09-12T00:19:30.215514+0000","last_clean":"2024-09-12T00:19:30.215514+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:19:30.215514+0000","last_undegraded":"2024-09-12T00:19:30.215514+0000","last_fullsized":"2024-09-12T00:19:30.215514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:27.835553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093904+0000","last_change":"2024-09-12T00:18:46.211819+0000","last_active":"2024-09-12T00:22:02.093904+0000","last_peered":"2024-09-12T00:22:02.093904+0000","last_clean":"2024-09-12T00:22:02.093904+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:22:02.093904+0000","last_undegraded":"2024-09-12T00:22:02.093904+0000","last_fullsized":"2024-09-12T00:22:02.093904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544559+0000","last_change":"2024-09-12T00:18:44.216737+0000","last_active":"2024-09-12T00:19:24.544559+0000","last_peered":"2024-09-12T00:19:24.544559+0000","last_clean":"2024-09-12T00:19:24.544559+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:19:24.544559+0000","last_undegraded":"2024-09-12T00:19:24.544559+0000","last_fullsized":"2024-09-12T00:19:24.544559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:29.268868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.787219+0000","last_change":"2024-09-12T00:18:46.217286+0000","last_active":"2024-09-12T00:19:31.787219+0000","last_peered":"2024-09-12T00:19:31.787219+0000","last_clean":"2024-09-12T00:19:31.787219+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:19:31.787219+0000","last_undegraded":"2024-09-12T00:19:31.787219+0000","last_fullsized":"2024-09-12T00:19:31.787219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.834988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52580,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319260,"statfs":{"total":96636764160,"available":96582922240,"internally_reserved":0,"allocated":13389824,"data_stored":13057412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44828,"kb_used_data":9484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327012,"statfs":{"total":96636764160,"available":96590860288,"internally_reserved":0,"allocated":9711616,"data_stored":9451046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":11240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":11509760,"data_stored":11224958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46404,"kb_used_data":6900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325436,"statfs":{"total":96636764160,"available":96589246464,"internally_reserved":0,"allocated":7065600,"data_stored":6764952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:22:34.412 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:22:34.412 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:22:34.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdadabf6640 1 Processor -- start 2024-09-12T00:22:34.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdadabf6640 1 -- start start 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdadabf6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdad41162e0 0x7fdad41347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdadabf6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdad4115530 con 0x7fdad412f1a0 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdadabf6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdad4116c40 con 0x7fdad41162e0 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdad41162e0 0x7fdad41347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad8992640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdad412f1a0 0x7fdad412f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50920/0 (socket says 172.21.15.31:50920) 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad8992640 1 -- 172.21.15.31:0/2995134435 learned_addr learned my addr 172.21.15.31:0/2995134435 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad3fff640 1 -- 172.21.15.31:0/2995134435 >> v1:172.21.15.31:6789/0 conn(0x7fdad412f1a0 legacy=0x7fdad412f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad3fff640 1 -- 172.21.15.31:0/2995134435 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad4073760 con 0x7fdad41162e0 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad3fff640 1 --2- 172.21.15.31:0/2995134435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad41347a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009740 tx=0x7fdac801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3672476f37976fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad37fe640 1 -- 172.21.15.31:0/2995134435 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac80b0070 con 0x7fdad41162e0 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad37fe640 1 -- 172.21.15.31:0/2995134435 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac80ab530 con 0x7fdad41162e0 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.571+0000 7fdad37fe640 1 -- 172.21.15.31:0/2995134435 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac80ab830 con 0x7fdad41162e0 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/2995134435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 msgr2=0x7fdad41347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 --2- 172.21.15.31:0/2995134435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad41347a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009740 tx=0x7fdac801c370 comp rx=0 tx=0).stop 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/2995134435 shutdown_connections 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 --2- 172.21.15.31:0/2995134435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad41347a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/2995134435 >> 172.21.15.31:0/2995134435 conn(0x7fdad406f380 msgr2=0x7fdad40717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/2995134435 shutdown_connections 2024-09-12T00:22:34.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/2995134435 wait complete. 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 Processor -- start 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- start start 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdad41378c0 con 0x7fdad41162e0 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad8992640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad8992640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45510/0 (socket says 172.21.15.31:45510) 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad8992640 1 -- 172.21.15.31:0/996336349 learned_addr learned my addr 172.21.15.31:0/996336349 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad8992640 1 -- 172.21.15.31:0/996336349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad4132120 con 0x7fdad41162e0 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad8992640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdac400cbd0 tx=0x7fdac400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac4017070 con 0x7fdad41162e0 2024-09-12T00:22:34.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac400abc0 con 0x7fdad41162e0 2024-09-12T00:22:34.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad4133490 con 0x7fdad41162e0 2024-09-12T00:22:34.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac4012400 con 0x7fdad41162e0 2024-09-12T00:22:34.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad41311e0 con 0x7fdad41162e0 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad4076880 con 0x7fdad41162e0 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdac401a070 con 0x7fdad41162e0 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 0x7fdac003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.575+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fdac404f790 con 0x7fdad41162e0 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.579+0000 7fdad3fff640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 0x7fdac003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.579+0000 7fdad3fff640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 0x7fdac003d690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdac80ad000 tx=0x7fdac80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.583+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdad4115530 con 0x7fdad41162e0 2024-09-12T00:22:34.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.751+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdad4131470 con 0x7fdac003b1d0 2024-09-12T00:22:34.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.779+0000 7fdad17fa640 1 -- 172.21.15.31:0/996336349 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665821 (secure 0 0 0) 0x7fdad4131470 con 0x7fdac003b1d0 2024-09-12T00:22:34.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:34.793 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:22:34.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 msgr2=0x7fdac003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 0x7fdac003d690 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdac80ad000 tx=0x7fdac80a6000 comp rx=0 tx=0).stop 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 msgr2=0x7fdad4130ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdac400cbd0 tx=0x7fdac400a430 comp rx=0 tx=0).stop 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 shutdown_connections 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdac003b1d0 0x7fdac003d690 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 --2- 172.21.15.31:0/996336349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdad41162e0 0x7fdad4130ad0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 >> 172.21.15.31:0/996336349 conn(0x7fdad406f380 msgr2=0x7fdad4071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 shutdown_connections 2024-09-12T00:22:34.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.783+0000 7fdadabf6640 1 -- 172.21.15.31:0/996336349 wait complete. 2024-09-12T00:22:34.806 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-12T00:22:34.616198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5185,"num_read_kb":4735,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190396,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296964,"statfs":{"total":386547056640,"available":386352091136,"internally_reserved":0,"allocated":41676800,"data_stored":40498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":153216793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006172"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.406715+0000","last_change":"2024-09-12T00:18:44.202329+0000","last_active":"2024-09-12T00:21:00.406715+0000","last_peered":"2024-09-12T00:21:00.406715+0000","last_clean":"2024-09-12T00:21:00.406715+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:21:00.406715+0000","last_undegraded":"2024-09-12T00:21:00.406715+0000","last_fullsized":"2024-09-12T00:21:00.406715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903656+0000","last_change":"2024-09-12T00:18:46.211272+0000","last_active":"2024-09-12T00:22:01.903656+0000","last_peered":"2024-09-12T00:22:01.903656+0000","last_clean":"2024-09-12T00:22:01.903656+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:22:01.903656+0000","last_undegraded":"2024-09-12T00:22:01.903656+0000","last_fullsized":"2024-09-12T00:22:01.903656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.762232+0000","last_change":"2024-09-12T00:18:44.198567+0000","last_active":"2024-09-12T00:19:31.762232+0000","last_peered":"2024-09-12T00:19:31.762232+0000","last_clean":"2024-09-12T00:19:31.762232+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:19:31.762232+0000","last_undegraded":"2024-09-12T00:19:31.762232+0000","last_fullsized":"2024-09-12T00:19:31.762232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.320029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.728342+0000","last_change":"2024-09-12T00:18:44.210055+0000","last_active":"2024-09-12T00:21:00.728342+0000","last_peered":"2024-09-12T00:21:00.728342+0000","last_clean":"2024-09-12T00:21:00.728342+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:21:00.728342+0000","last_undegraded":"2024-09-12T00:21:00.728342+0000","last_fullsized":"2024-09-12T00:21:00.728342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:52.123986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.423882+0000","last_change":"2024-09-12T00:18:44.194458+0000","last_active":"2024-09-12T00:22:01.423882+0000","last_peered":"2024-09-12T00:22:01.423882+0000","last_clean":"2024-09-12T00:22:01.423882+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:01.423882+0000","last_undegraded":"2024-09-12T00:22:01.423882+0000","last_fullsized":"2024-09-12T00:22:01.423882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286428+0000","last_change":"2024-09-12T00:18:44.206065+0000","last_active":"2024-09-12T00:19:24.286428+0000","last_peered":"2024-09-12T00:19:24.286428+0000","last_clean":"2024-09-12T00:19:24.286428+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:19:24.286428+0000","last_undegraded":"2024-09-12T00:19:24.286428+0000","last_fullsized":"2024-09-12T00:19:24.286428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:40.433166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.032972+0000","last_change":"2024-09-12T00:18:46.205029+0000","last_active":"2024-09-12T00:22:02.032972+0000","last_peered":"2024-09-12T00:22:02.032972+0000","last_clean":"2024-09-12T00:22:02.032972+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:22:02.032972+0000","last_undegraded":"2024-09-12T00:22:02.032972+0000","last_fullsized":"2024-09-12T00:22:02.032972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267456+0000","last_change":"2024-09-12T00:18:44.218601+0000","last_active":"2024-09-12T00:19:24.267456+0000","last_peered":"2024-09-12T00:19:24.267456+0000","last_clean":"2024-09-12T00:19:24.267456+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:19:24.267456+0000","last_undegraded":"2024-09-12T00:19:24.267456+0000","last_fullsized":"2024-09-12T00:19:24.267456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903829+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.903829+0000","last_peered":"2024-09-12T00:22:01.903829+0000","last_clean":"2024-09-12T00:22:01.903829+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.903829+0000","last_undegraded":"2024-09-12T00:22:01.903829+0000","last_fullsized":"2024-09-12T00:22:01.903829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:35.703562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278516+0000","last_change":"2024-09-12T00:18:44.193805+0000","last_active":"2024-09-12T00:19:24.278516+0000","last_peered":"2024-09-12T00:19:24.278516+0000","last_clean":"2024-09-12T00:19:24.278516+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:19:24.278516+0000","last_undegraded":"2024-09-12T00:19:24.278516+0000","last_fullsized":"2024-09-12T00:19:24.278516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:36.997859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279902+0000","last_change":"2024-09-12T00:18:46.207506+0000","last_active":"2024-09-12T00:19:24.279902+0000","last_peered":"2024-09-12T00:19:24.279902+0000","last_clean":"2024-09-12T00:19:24.279902+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:19:24.279902+0000","last_undegraded":"2024-09-12T00:19:24.279902+0000","last_fullsized":"2024-09-12T00:19:24.279902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.213594+0000","last_change":"2024-09-12T00:18:44.218215+0000","last_active":"2024-09-12T00:19:30.213594+0000","last_peered":"2024-09-12T00:19:30.213594+0000","last_clean":"2024-09-12T00:19:30.213594+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:19:30.213594+0000","last_undegraded":"2024-09-12T00:19:30.213594+0000","last_fullsized":"2024-09-12T00:19:30.213594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685897+0000","last_change":"2024-09-12T00:18:46.186627+0000","last_active":"2024-09-12T00:22:01.685897+0000","last_peered":"2024-09-12T00:22:01.685897+0000","last_clean":"2024-09-12T00:22:01.685897+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:22:01.685897+0000","last_undegraded":"2024-09-12T00:22:01.685897+0000","last_fullsized":"2024-09-12T00:22:01.685897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290994+0000","last_change":"2024-09-12T00:18:44.212848+0000","last_active":"2024-09-12T00:19:24.290994+0000","last_peered":"2024-09-12T00:19:24.290994+0000","last_clean":"2024-09-12T00:19:24.290994+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:19:24.290994+0000","last_undegraded":"2024-09-12T00:19:24.290994+0000","last_fullsized":"2024-09-12T00:19:24.290994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:33.310089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.925305+0000","last_change":"2024-09-12T00:18:46.194590+0000","last_active":"2024-09-12T00:22:01.925305+0000","last_peered":"2024-09-12T00:22:01.925305+0000","last_clean":"2024-09-12T00:22:01.925305+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:22:01.925305+0000","last_undegraded":"2024-09-12T00:22:01.925305+0000","last_fullsized":"2024-09-12T00:22:01.925305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279673+0000","last_change":"2024-09-12T00:18:44.202523+0000","last_active":"2024-09-12T00:19:24.279673+0000","last_peered":"2024-09-12T00:19:24.279673+0000","last_clean":"2024-09-12T00:19:24.279673+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:19:24.279673+0000","last_undegraded":"2024-09-12T00:19:24.279673+0000","last_fullsized":"2024-09-12T00:19:24.279673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904113+0000","last_change":"2024-09-12T00:18:46.203242+0000","last_active":"2024-09-12T00:22:01.904113+0000","last_peered":"2024-09-12T00:22:01.904113+0000","last_clean":"2024-09-12T00:22:01.904113+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:22:01.904113+0000","last_undegraded":"2024-09-12T00:22:01.904113+0000","last_fullsized":"2024-09-12T00:22:01.904113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:24.643819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.284256+0000","last_change":"2024-09-12T00:18:44.214172+0000","last_active":"2024-09-12T00:19:24.284256+0000","last_peered":"2024-09-12T00:19:24.284256+0000","last_clean":"2024-09-12T00:19:24.284256+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:19:24.284256+0000","last_undegraded":"2024-09-12T00:19:24.284256+0000","last_fullsized":"2024-09-12T00:19:24.284256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035956+0000","last_change":"2024-09-12T00:18:46.196617+0000","last_active":"2024-09-12T00:22:02.035956+0000","last_peered":"2024-09-12T00:22:02.035956+0000","last_clean":"2024-09-12T00:22:02.035956+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:22:02.035956+0000","last_undegraded":"2024-09-12T00:22:02.035956+0000","last_fullsized":"2024-09-12T00:22:02.035956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602719+0000","last_change":"2024-09-12T00:18:44.204026+0000","last_active":"2024-09-12T00:21:12.602719+0000","last_peered":"2024-09-12T00:21:12.602719+0000","last_clean":"2024-09-12T00:21:12.602719+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:21:12.602719+0000","last_undegraded":"2024-09-12T00:21:12.602719+0000","last_fullsized":"2024-09-12T00:21:12.602719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092738+0000","last_change":"2024-09-12T00:18:46.189741+0000","last_active":"2024-09-12T00:22:02.092738+0000","last_peered":"2024-09-12T00:22:02.092738+0000","last_clean":"2024-09-12T00:22:02.092738+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:22:02.092738+0000","last_undegraded":"2024-09-12T00:22:02.092738+0000","last_fullsized":"2024-09-12T00:22:02.092738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550714+0000","last_change":"2024-09-12T00:18:44.216492+0000","last_active":"2024-09-12T00:19:24.550714+0000","last_peered":"2024-09-12T00:19:24.550714+0000","last_clean":"2024-09-12T00:19:24.550714+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:19:24.550714+0000","last_undegraded":"2024-09-12T00:19:24.550714+0000","last_fullsized":"2024-09-12T00:19:24.550714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.545686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'5","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602774+0000","last_change":"2024-09-12T00:18:46.187100+0000","last_active":"2024-09-12T00:21:12.602774+0000","last_peered":"2024-09-12T00:21:12.602774+0000","last_clean":"2024-09-12T00:21:12.602774+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:21:12.602774+0000","last_undegraded":"2024-09-12T00:21:12.602774+0000","last_fullsized":"2024-09-12T00:21:12.602774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.865459+0000","last_change":"2024-09-12T00:18:44.194821+0000","last_active":"2024-09-12T00:22:01.865459+0000","last_peered":"2024-09-12T00:22:01.865459+0000","last_clean":"2024-09-12T00:22:01.865459+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:22:01.865459+0000","last_undegraded":"2024-09-12T00:22:01.865459+0000","last_fullsized":"2024-09-12T00:22:01.865459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:26.427367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.466162+0000","last_change":"2024-09-12T00:18:46.181776+0000","last_active":"2024-09-12T00:19:31.466162+0000","last_peered":"2024-09-12T00:19:31.466162+0000","last_clean":"2024-09-12T00:19:31.466162+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:19:31.466162+0000","last_undegraded":"2024-09-12T00:19:31.466162+0000","last_fullsized":"2024-09-12T00:19:31.466162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:14.676977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285925+0000","last_change":"2024-09-12T00:18:44.204366+0000","last_active":"2024-09-12T00:19:24.285925+0000","last_peered":"2024-09-12T00:19:24.285925+0000","last_clean":"2024-09-12T00:19:24.285925+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:19:24.285925+0000","last_undegraded":"2024-09-12T00:19:24.285925+0000","last_fullsized":"2024-09-12T00:19:24.285925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.910617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'42","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.252668+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:20:58.252668+0000","last_peered":"2024-09-12T00:20:58.252668+0000","last_clean":"2024-09-12T00:20:58.252668+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:20:58.252668+0000","last_undegraded":"2024-09-12T00:20:58.252668+0000","last_fullsized":"2024-09-12T00:20:58.252668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017652+0000","last_change":"2024-09-12T00:18:46.192637+0000","last_active":"2024-09-12T00:22:02.017652+0000","last_peered":"2024-09-12T00:22:02.017652+0000","last_clean":"2024-09-12T00:22:02.017652+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:22:02.017652+0000","last_undegraded":"2024-09-12T00:22:02.017652+0000","last_fullsized":"2024-09-12T00:22:02.017652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:10.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597537+0000","last_change":"2024-09-12T00:18:44.208808+0000","last_active":"2024-09-12T00:21:07.597537+0000","last_peered":"2024-09-12T00:21:07.597537+0000","last_clean":"2024-09-12T00:21:07.597537+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:21:07.597537+0000","last_undegraded":"2024-09-12T00:21:07.597537+0000","last_fullsized":"2024-09-12T00:21:07.597537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.580130+0000","last_change":"2024-09-12T00:19:24.287113+0000","last_active":"2024-09-12T00:19:27.580130+0000","last_peered":"2024-09-12T00:19:27.580130+0000","last_clean":"2024-09-12T00:19:27.580130+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:19:27.580130+0000","last_undegraded":"2024-09-12T00:19:27.580130+0000","last_fullsized":"2024-09-12T00:19:27.580130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:38.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.467228+0000","last_change":"2024-09-12T00:18:46.189086+0000","last_active":"2024-09-12T00:19:31.467228+0000","last_peered":"2024-09-12T00:19:31.467228+0000","last_clean":"2024-09-12T00:19:31.467228+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:19:31.467228+0000","last_undegraded":"2024-09-12T00:19:31.467228+0000","last_fullsized":"2024-09-12T00:19:31.467228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:41.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277544+0000","last_change":"2024-09-12T00:18:44.204623+0000","last_active":"2024-09-12T00:19:24.277544+0000","last_peered":"2024-09-12T00:19:24.277544+0000","last_clean":"2024-09-12T00:19:24.277544+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:19:24.277544+0000","last_undegraded":"2024-09-12T00:19:24.277544+0000","last_fullsized":"2024-09-12T00:19:24.277544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:49.492628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550915+0000","last_change":"2024-09-12T00:18:48.218518+0000","last_active":"2024-09-12T00:19:24.550915+0000","last_peered":"2024-09-12T00:19:24.550915+0000","last_clean":"2024-09-12T00:19:24.550915+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:19:24.550915+0000","last_undegraded":"2024-09-12T00:19:24.550915+0000","last_fullsized":"2024-09-12T00:19:24.550915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.252605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":383,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453635+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:21:58.453635+0000","last_peered":"2024-09-12T00:21:58.453635+0000","last_clean":"2024-09-12T00:21:58.453635+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:21:58.453635+0000","last_undegraded":"2024-09-12T00:21:58.453635+0000","last_fullsized":"2024-09-12T00:21:58.453635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093892+0000","last_change":"2024-09-12T00:18:46.211042+0000","last_active":"2024-09-12T00:22:02.093892+0000","last_peered":"2024-09-12T00:22:02.093892+0000","last_clean":"2024-09-12T00:22:02.093892+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:02.093892+0000","last_undegraded":"2024-09-12T00:22:02.093892+0000","last_fullsized":"2024-09-12T00:22:02.093892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269812+0000","last_change":"2024-09-12T00:18:44.191237+0000","last_active":"2024-09-12T00:19:24.269812+0000","last_peered":"2024-09-12T00:19:24.269812+0000","last_clean":"2024-09-12T00:19:24.269812+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:19:24.269812+0000","last_undegraded":"2024-09-12T00:19:24.269812+0000","last_fullsized":"2024-09-12T00:19:24.269812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:50.165029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883493+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:20:59.883493+0000","last_peered":"2024-09-12T00:20:59.883493+0000","last_clean":"2024-09-12T00:20:59.883493+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:20:59.883493+0000","last_undegraded":"2024-09-12T00:20:59.883493+0000","last_fullsized":"2024-09-12T00:20:59.883493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.244083+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:20:58.244083+0000","last_peered":"2024-09-12T00:20:58.244083+0000","last_clean":"2024-09-12T00:20:58.244083+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:20:58.244083+0000","last_undegraded":"2024-09-12T00:20:58.244083+0000","last_fullsized":"2024-09-12T00:20:58.244083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.103038+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:02.103038+0000","last_peered":"2024-09-12T00:22:02.103038+0000","last_clean":"2024-09-12T00:22:02.103038+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:02.103038+0000","last_undegraded":"2024-09-12T00:22:02.103038+0000","last_fullsized":"2024-09-12T00:22:02.103038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.270303+0000","last_change":"2024-09-12T00:18:46.214495+0000","last_active":"2024-09-12T00:20:15.270303+0000","last_peered":"2024-09-12T00:20:15.270303+0000","last_clean":"2024-09-12T00:20:15.270303+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:20:15.270303+0000","last_undegraded":"2024-09-12T00:20:15.270303+0000","last_fullsized":"2024-09-12T00:20:15.270303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:26.250264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.890256+0000","last_change":"2024-09-12T00:18:44.202781+0000","last_active":"2024-09-12T00:22:01.890256+0000","last_peered":"2024-09-12T00:22:01.890256+0000","last_clean":"2024-09-12T00:22:01.890256+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:01.890256+0000","last_undegraded":"2024-09-12T00:22:01.890256+0000","last_fullsized":"2024-09-12T00:22:01.890256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272688+0000","last_change":"2024-09-12T00:18:48.204648+0000","last_active":"2024-09-12T00:19:24.272688+0000","last_peered":"2024-09-12T00:19:24.272688+0000","last_clean":"2024-09-12T00:19:24.272688+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:19:24.272688+0000","last_undegraded":"2024-09-12T00:19:24.272688+0000","last_fullsized":"2024-09-12T00:19:24.272688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:46.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'48","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596167+0000","last_change":"2024-09-12T00:18:50.230605+0000","last_active":"2024-09-12T00:21:02.596167+0000","last_peered":"2024-09-12T00:21:02.596167+0000","last_clean":"2024-09-12T00:21:02.596167+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:21:02.596167+0000","last_undegraded":"2024-09-12T00:21:02.596167+0000","last_fullsized":"2024-09-12T00:21:02.596167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:38.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":43,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.022794+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.022794+0000","last_peered":"2024-09-12T00:22:02.022794+0000","last_clean":"2024-09-12T00:22:02.022794+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.022794+0000","last_undegraded":"2024-09-12T00:22:02.022794+0000","last_fullsized":"2024-09-12T00:22:02.022794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:06.675976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'5","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599274+0000","last_change":"2024-09-12T00:18:46.194904+0000","last_active":"2024-09-12T00:20:57.599274+0000","last_peered":"2024-09-12T00:20:57.599274+0000","last_clean":"2024-09-12T00:20:57.599274+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:20:57.599274+0000","last_undegraded":"2024-09-12T00:20:57.599274+0000","last_fullsized":"2024-09-12T00:20:57.599274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596353+0000","last_change":"2024-09-12T00:18:44.198188+0000","last_active":"2024-09-12T00:21:02.596353+0000","last_peered":"2024-09-12T00:21:02.596353+0000","last_clean":"2024-09-12T00:21:02.596353+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:21:02.596353+0000","last_undegraded":"2024-09-12T00:21:02.596353+0000","last_fullsized":"2024-09-12T00:21:02.596353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:18.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544308+0000","last_change":"2024-09-12T00:18:48.205812+0000","last_active":"2024-09-12T00:19:24.544308+0000","last_peered":"2024-09-12T00:19:24.544308+0000","last_clean":"2024-09-12T00:19:24.544308+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:19:24.544308+0000","last_undegraded":"2024-09-12T00:19:24.544308+0000","last_fullsized":"2024-09-12T00:19:24.544308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.485115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.227739+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:20:58.227739+0000","last_peered":"2024-09-12T00:20:58.227739+0000","last_clean":"2024-09-12T00:20:58.227739+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:20:58.227739+0000","last_undegraded":"2024-09-12T00:20:58.227739+0000","last_fullsized":"2024-09-12T00:20:58.227739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544349+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:19:24.544349+0000","last_peered":"2024-09-12T00:19:24.544349+0000","last_clean":"2024-09-12T00:19:24.544349+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:19:24.544349+0000","last_undegraded":"2024-09-12T00:19:24.544349+0000","last_fullsized":"2024-09-12T00:19:24.544349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:09.229873+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:20:09.229873+0000","last_peered":"2024-09-12T00:20:09.229873+0000","last_clean":"2024-09-12T00:20:09.229873+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:20:09.229873+0000","last_undegraded":"2024-09-12T00:20:09.229873+0000","last_fullsized":"2024-09-12T00:20:09.229873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.249738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092735+0000","last_change":"2024-09-12T00:18:46.190345+0000","last_active":"2024-09-12T00:22:02.092735+0000","last_peered":"2024-09-12T00:22:02.092735+0000","last_clean":"2024-09-12T00:22:02.092735+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:02.092735+0000","last_undegraded":"2024-09-12T00:22:02.092735+0000","last_fullsized":"2024-09-12T00:22:02.092735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:58.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.210951+0000","last_change":"2024-09-12T00:18:44.213120+0000","last_active":"2024-09-12T00:19:30.210951+0000","last_peered":"2024-09-12T00:19:30.210951+0000","last_clean":"2024-09-12T00:19:30.210951+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:19:30.210951+0000","last_undegraded":"2024-09-12T00:19:30.210951+0000","last_fullsized":"2024-09-12T00:19:30.210951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:49.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.551564+0000","last_change":"2024-09-12T00:18:48.206891+0000","last_active":"2024-09-12T00:19:24.551564+0000","last_peered":"2024-09-12T00:19:24.551564+0000","last_clean":"2024-09-12T00:19:24.551564+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:19:24.551564+0000","last_undegraded":"2024-09-12T00:19:24.551564+0000","last_fullsized":"2024-09-12T00:19:24.551564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.261684+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:20:58.261684+0000","last_peered":"2024-09-12T00:20:58.261684+0000","last_clean":"2024-09-12T00:20:58.261684+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:20:58.261684+0000","last_undegraded":"2024-09-12T00:20:58.261684+0000","last_fullsized":"2024-09-12T00:20:58.261684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.032481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":350,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.457576+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:02.457576+0000","last_peered":"2024-09-12T00:22:02.457576+0000","last_clean":"2024-09-12T00:22:02.457576+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:02.457576+0000","last_undegraded":"2024-09-12T00:22:02.457576+0000","last_fullsized":"2024-09-12T00:22:02.457576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548388+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:19:24.548388+0000","last_peered":"2024-09-12T00:19:24.548388+0000","last_clean":"2024-09-12T00:19:24.548388+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:19:24.548388+0000","last_undegraded":"2024-09-12T00:19:24.548388+0000","last_fullsized":"2024-09-12T00:19:24.548388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:44.410375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903715+0000","last_change":"2024-09-12T00:18:46.184028+0000","last_active":"2024-09-12T00:22:01.903715+0000","last_peered":"2024-09-12T00:22:01.903715+0000","last_clean":"2024-09-12T00:22:01.903715+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:01.903715+0000","last_undegraded":"2024-09-12T00:22:01.903715+0000","last_fullsized":"2024-09-12T00:22:01.903715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291451+0000","last_change":"2024-09-12T00:18:44.210945+0000","last_active":"2024-09-12T00:19:24.291451+0000","last_peered":"2024-09-12T00:19:24.291451+0000","last_clean":"2024-09-12T00:19:24.291451+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:19:24.291451+0000","last_undegraded":"2024-09-12T00:19:24.291451+0000","last_fullsized":"2024-09-12T00:19:24.291451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.463659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.574695+0000","last_change":"2024-09-12T00:19:24.275470+0000","last_active":"2024-09-12T00:19:27.574695+0000","last_peered":"2024-09-12T00:19:27.574695+0000","last_clean":"2024-09-12T00:19:27.574695+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:19:27.574695+0000","last_undegraded":"2024-09-12T00:19:27.574695+0000","last_fullsized":"2024-09-12T00:19:27.574695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:26.076062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":135,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.264136+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:20:58.264136+0000","last_peered":"2024-09-12T00:20:58.264136+0000","last_clean":"2024-09-12T00:20:58.264136+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:20:58.264136+0000","last_undegraded":"2024-09-12T00:20:58.264136+0000","last_fullsized":"2024-09-12T00:20:58.264136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.313371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543403+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:19:24.543403+0000","last_peered":"2024-09-12T00:19:24.543403+0000","last_clean":"2024-09-12T00:19:24.543403+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:19:24.543403+0000","last_undegraded":"2024-09-12T00:19:24.543403+0000","last_fullsized":"2024-09-12T00:19:24.543403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394734+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.394734+0000","last_peered":"2024-09-12T00:22:02.394734+0000","last_clean":"2024-09-12T00:22:02.394734+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.394734+0000","last_undegraded":"2024-09-12T00:22:02.394734+0000","last_fullsized":"2024-09-12T00:22:02.394734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:35.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.019375+0000","last_change":"2024-09-12T00:19:24.302900+0000","last_active":"2024-09-12T00:22:02.019375+0000","last_peered":"2024-09-12T00:22:02.019375+0000","last_clean":"2024-09-12T00:22:02.019375+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:02.019375+0000","last_undegraded":"2024-09-12T00:22:02.019375+0000","last_fullsized":"2024-09-12T00:22:02.019375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:27.149764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548407+0000","last_change":"2024-09-12T00:18:44.182390+0000","last_active":"2024-09-12T00:19:24.548407+0000","last_peered":"2024-09-12T00:19:24.548407+0000","last_clean":"2024-09-12T00:19:24.548407+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:19:24.548407+0000","last_undegraded":"2024-09-12T00:19:24.548407+0000","last_fullsized":"2024-09-12T00:19:24.548407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.955106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275681+0000","last_change":"2024-09-12T00:18:48.205192+0000","last_active":"2024-09-12T00:19:24.275681+0000","last_peered":"2024-09-12T00:19:24.275681+0000","last_clean":"2024-09-12T00:19:24.275681+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:19:24.275681+0000","last_undegraded":"2024-09-12T00:19:24.275681+0000","last_fullsized":"2024-09-12T00:19:24.275681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:53.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601657+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:21:07.601657+0000","last_peered":"2024-09-12T00:21:07.601657+0000","last_clean":"2024-09-12T00:21:07.601657+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:21:07.601657+0000","last_undegraded":"2024-09-12T00:21:07.601657+0000","last_fullsized":"2024-09-12T00:21:07.601657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.841795+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:20:57.841795+0000","last_peered":"2024-09-12T00:20:57.841795+0000","last_clean":"2024-09-12T00:20:57.841795+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:20:57.841795+0000","last_undegraded":"2024-09-12T00:20:57.841795+0000","last_fullsized":"2024-09-12T00:20:57.841795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949230+0000","last_change":"2024-09-12T00:18:46.214384+0000","last_active":"2024-09-12T00:20:55.949230+0000","last_peered":"2024-09-12T00:20:55.949230+0000","last_clean":"2024-09-12T00:20:55.949230+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:20:55.949230+0000","last_undegraded":"2024-09-12T00:20:55.949230+0000","last_fullsized":"2024-09-12T00:20:55.949230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:32.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.763687+0000","last_change":"2024-09-12T00:18:44.195641+0000","last_active":"2024-09-12T00:19:31.763687+0000","last_peered":"2024-09-12T00:19:31.763687+0000","last_clean":"2024-09-12T00:19:31.763687+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:19:31.763687+0000","last_undegraded":"2024-09-12T00:19:31.763687+0000","last_fullsized":"2024-09-12T00:19:31.763687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:32.850697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544223+0000","last_change":"2024-09-12T00:18:48.206321+0000","last_active":"2024-09-12T00:19:24.544223+0000","last_peered":"2024-09-12T00:19:24.544223+0000","last_clean":"2024-09-12T00:19:24.544223+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:19:24.544223+0000","last_undegraded":"2024-09-12T00:19:24.544223+0000","last_fullsized":"2024-09-12T00:19:24.544223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.756623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276459+0000","last_change":"2024-09-12T00:18:50.208134+0000","last_active":"2024-09-12T00:20:58.276459+0000","last_peered":"2024-09-12T00:20:58.276459+0000","last_clean":"2024-09-12T00:20:58.276459+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:20:58.276459+0000","last_undegraded":"2024-09-12T00:20:58.276459+0000","last_fullsized":"2024-09-12T00:20:58.276459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:41.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":433,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394603+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:02.394603+0000","last_peered":"2024-09-12T00:22:02.394603+0000","last_clean":"2024-09-12T00:22:02.394603+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:02.394603+0000","last_undegraded":"2024-09-12T00:22:02.394603+0000","last_fullsized":"2024-09-12T00:22:02.394603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600068+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:21:02.600068+0000","last_peered":"2024-09-12T00:21:02.600068+0000","last_clean":"2024-09-12T00:21:02.600068+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:21:02.600068+0000","last_undegraded":"2024-09-12T00:21:02.600068+0000","last_fullsized":"2024-09-12T00:21:02.600068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:32.549319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950683+0000","last_change":"2024-09-12T00:18:46.190811+0000","last_active":"2024-09-12T00:20:55.950683+0000","last_peered":"2024-09-12T00:20:55.950683+0000","last_clean":"2024-09-12T00:20:55.950683+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:20:55.950683+0000","last_undegraded":"2024-09-12T00:20:55.950683+0000","last_fullsized":"2024-09-12T00:20:55.950683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280196+0000","last_change":"2024-09-12T00:18:44.209954+0000","last_active":"2024-09-12T00:19:24.280196+0000","last_peered":"2024-09-12T00:19:24.280196+0000","last_clean":"2024-09-12T00:19:24.280196+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:19:24.280196+0000","last_undegraded":"2024-09-12T00:19:24.280196+0000","last_fullsized":"2024-09-12T00:19:24.280196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:56.345709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883129+0000","last_change":"2024-09-12T00:18:48.204097+0000","last_active":"2024-09-12T00:20:59.883129+0000","last_peered":"2024-09-12T00:20:59.883129+0000","last_clean":"2024-09-12T00:20:59.883129+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:20:59.883129+0000","last_undegraded":"2024-09-12T00:20:59.883129+0000","last_fullsized":"2024-09-12T00:20:59.883129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.662454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":470,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.261927+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:02.261927+0000","last_peered":"2024-09-12T00:22:02.261927+0000","last_clean":"2024-09-12T00:22:02.261927+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:02.261927+0000","last_undegraded":"2024-09-12T00:22:02.261927+0000","last_fullsized":"2024-09-12T00:22:02.261927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.229253+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:00.229253+0000","last_peered":"2024-09-12T00:21:00.229253+0000","last_clean":"2024-09-12T00:21:00.229253+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:00.229253+0000","last_undegraded":"2024-09-12T00:21:00.229253+0000","last_fullsized":"2024-09-12T00:21:00.229253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.526537+0000","last_change":"2024-09-12T00:18:46.211756+0000","last_active":"2024-09-12T00:22:01.526537+0000","last_peered":"2024-09-12T00:22:01.526537+0000","last_clean":"2024-09-12T00:22:01.526537+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:01.526537+0000","last_undegraded":"2024-09-12T00:22:01.526537+0000","last_fullsized":"2024-09-12T00:22:01.526537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:58.473396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277734+0000","last_change":"2024-09-12T00:18:44.204521+0000","last_active":"2024-09-12T00:19:24.277734+0000","last_peered":"2024-09-12T00:19:24.277734+0000","last_clean":"2024-09-12T00:19:24.277734+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:19:24.277734+0000","last_undegraded":"2024-09-12T00:19:24.277734+0000","last_fullsized":"2024-09-12T00:19:24.277734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.066094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298901+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:19:24.298901+0000","last_peered":"2024-09-12T00:19:24.298901+0000","last_clean":"2024-09-12T00:19:24.298901+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:19:24.298901+0000","last_undegraded":"2024-09-12T00:19:24.298901+0000","last_fullsized":"2024-09-12T00:19:24.298901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'38","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.254646+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:20:58.254646+0000","last_peered":"2024-09-12T00:20:58.254646+0000","last_clean":"2024-09-12T00:20:58.254646+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:20:58.254646+0000","last_undegraded":"2024-09-12T00:20:58.254646+0000","last_fullsized":"2024-09-12T00:20:58.254646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.191021+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.191021+0000","last_peered":"2024-09-12T00:22:02.191021+0000","last_clean":"2024-09-12T00:22:02.191021+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.191021+0000","last_undegraded":"2024-09-12T00:22:02.191021+0000","last_fullsized":"2024-09-12T00:22:02.191021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:07.414020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:32.603727+0000","last_change":"2024-09-12T00:19:24.294913+0000","last_active":"2024-09-12T00:21:32.603727+0000","last_peered":"2024-09-12T00:21:32.603727+0000","last_clean":"2024-09-12T00:21:32.603727+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:21:32.603727+0000","last_undegraded":"2024-09-12T00:21:32.603727+0000","last_fullsized":"2024-09-12T00:21:32.603727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:01.472976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:32.594140+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:20:32.594140+0000","last_peered":"2024-09-12T00:20:32.594140+0000","last_clean":"2024-09-12T00:20:32.594140+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:20:32.594140+0000","last_undegraded":"2024-09-12T00:20:32.594140+0000","last_fullsized":"2024-09-12T00:20:32.594140+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285652+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:19:24.285652+0000","last_peered":"2024-09-12T00:19:24.285652+0000","last_clean":"2024-09-12T00:19:24.285652+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:19:24.285652+0000","last_undegraded":"2024-09-12T00:19:24.285652+0000","last_fullsized":"2024-09-12T00:19:24.285652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.079086+0000","last_change":"2024-09-12T00:18:44.210973+0000","last_active":"2024-09-12T00:22:02.079086+0000","last_peered":"2024-09-12T00:22:02.079086+0000","last_clean":"2024-09-12T00:22:02.079086+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:02.079086+0000","last_undegraded":"2024-09-12T00:22:02.079086+0000","last_fullsized":"2024-09-12T00:22:02.079086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:48.534399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.282323+0000","last_change":"2024-09-12T00:18:48.211948+0000","last_active":"2024-09-12T00:19:24.282323+0000","last_peered":"2024-09-12T00:19:24.282323+0000","last_clean":"2024-09-12T00:19:24.282323+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:19:24.282323+0000","last_undegraded":"2024-09-12T00:19:24.282323+0000","last_fullsized":"2024-09-12T00:19:24.282323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'82","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272194+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:20:58.272194+0000","last_peered":"2024-09-12T00:20:58.272194+0000","last_clean":"2024-09-12T00:20:58.272194+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:20:58.272194+0000","last_undegraded":"2024-09-12T00:20:58.272194+0000","last_fullsized":"2024-09-12T00:20:58.272194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.876704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547510+0000","last_change":"2024-09-12T00:18:52.245007+0000","last_active":"2024-09-12T00:19:24.547510+0000","last_peered":"2024-09-12T00:19:24.547510+0000","last_clean":"2024-09-12T00:19:24.547510+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:19:24.547510+0000","last_undegraded":"2024-09-12T00:19:24.547510+0000","last_fullsized":"2024-09-12T00:19:24.547510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:17.254061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.119534+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.119534+0000","last_peered":"2024-09-12T00:22:02.119534+0000","last_clean":"2024-09-12T00:22:02.119534+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.119534+0000","last_undegraded":"2024-09-12T00:22:02.119534+0000","last_fullsized":"2024-09-12T00:22:02.119534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:46.601602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091794+0000","last_change":"2024-09-12T00:18:46.188276+0000","last_active":"2024-09-12T00:22:02.091794+0000","last_peered":"2024-09-12T00:22:02.091794+0000","last_clean":"2024-09-12T00:22:02.091794+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:22:02.091794+0000","last_undegraded":"2024-09-12T00:22:02.091794+0000","last_fullsized":"2024-09-12T00:22:02.091794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.432662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.273369+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:19:24.273369+0000","last_peered":"2024-09-12T00:19:24.273369+0000","last_clean":"2024-09-12T00:19:24.273369+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:19:24.273369+0000","last_undegraded":"2024-09-12T00:19:24.273369+0000","last_fullsized":"2024-09-12T00:19:24.273369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.949260+0000","last_change":"2024-09-12T00:18:44.198633+0000","last_active":"2024-09-12T00:20:14.949260+0000","last_peered":"2024-09-12T00:20:14.949260+0000","last_clean":"2024-09-12T00:20:14.949260+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:20:14.949260+0000","last_undegraded":"2024-09-12T00:20:14.949260+0000","last_fullsized":"2024-09-12T00:20:14.949260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.301077+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:19:24.301077+0000","last_peered":"2024-09-12T00:19:24.301077+0000","last_clean":"2024-09-12T00:19:24.301077+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:19:24.301077+0000","last_undegraded":"2024-09-12T00:19:24.301077+0000","last_fullsized":"2024-09-12T00:19:24.301077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.126928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":490,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453795+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:21:58.453795+0000","last_peered":"2024-09-12T00:21:58.453795+0000","last_clean":"2024-09-12T00:21:58.453795+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:21:58.453795+0000","last_undegraded":"2024-09-12T00:21:58.453795+0000","last_fullsized":"2024-09-12T00:21:58.453795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.974846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291239+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:19:24.291239+0000","last_peered":"2024-09-12T00:19:24.291239+0000","last_clean":"2024-09-12T00:19:24.291239+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:19:24.291239+0000","last_undegraded":"2024-09-12T00:19:24.291239+0000","last_fullsized":"2024-09-12T00:19:24.291239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:27.494970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.967961+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:20:14.967961+0000","last_peered":"2024-09-12T00:20:14.967961+0000","last_clean":"2024-09-12T00:20:14.967961+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:20:14.967961+0000","last_undegraded":"2024-09-12T00:20:14.967961+0000","last_fullsized":"2024-09-12T00:20:14.967961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.417808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020186+0000","last_change":"2024-09-12T00:18:46.211820+0000","last_active":"2024-09-12T00:22:02.020186+0000","last_peered":"2024-09-12T00:22:02.020186+0000","last_clean":"2024-09-12T00:22:02.020186+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:02.020186+0000","last_undegraded":"2024-09-12T00:22:02.020186+0000","last_fullsized":"2024-09-12T00:22:02.020186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:43.510871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270254+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:19:24.270254+0000","last_peered":"2024-09-12T00:19:24.270254+0000","last_clean":"2024-09-12T00:19:24.270254+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:19:24.270254+0000","last_undegraded":"2024-09-12T00:19:24.270254+0000","last_fullsized":"2024-09-12T00:19:24.270254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.542991+0000","last_change":"2024-09-12T00:18:44.198208+0000","last_active":"2024-09-12T00:19:24.542991+0000","last_peered":"2024-09-12T00:19:24.542991+0000","last_clean":"2024-09-12T00:19:24.542991+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:19:24.542991+0000","last_undegraded":"2024-09-12T00:19:24.542991+0000","last_fullsized":"2024-09-12T00:19:24.542991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:02.437476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275369+0000","last_change":"2024-09-12T00:18:48.197273+0000","last_active":"2024-09-12T00:19:24.275369+0000","last_peered":"2024-09-12T00:19:24.275369+0000","last_clean":"2024-09-12T00:19:24.275369+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:19:24.275369+0000","last_undegraded":"2024-09-12T00:19:24.275369+0000","last_fullsized":"2024-09-12T00:19:24.275369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:31.361645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.454216+0000","last_change":"2024-09-12T00:18:50.235509+0000","last_active":"2024-09-12T00:21:58.454216+0000","last_peered":"2024-09-12T00:21:58.454216+0000","last_clean":"2024-09-12T00:21:58.454216+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:21:58.454216+0000","last_undegraded":"2024-09-12T00:21:58.454216+0000","last_fullsized":"2024-09-12T00:21:58.454216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.659270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545528+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:19:24.545528+0000","last_peered":"2024-09-12T00:19:24.545528+0000","last_clean":"2024-09-12T00:19:24.545528+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:19:24.545528+0000","last_undegraded":"2024-09-12T00:19:24.545528+0000","last_fullsized":"2024-09-12T00:19:24.545528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.515768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274180+0000","last_change":"2024-09-12T00:18:46.200898+0000","last_active":"2024-09-12T00:20:15.274180+0000","last_peered":"2024-09-12T00:20:15.274180+0000","last_clean":"2024-09-12T00:20:15.274180+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:20:15.274180+0000","last_undegraded":"2024-09-12T00:20:15.274180+0000","last_fullsized":"2024-09-12T00:20:15.274180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:07.775807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285725+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:19:24.285725+0000","last_peered":"2024-09-12T00:19:24.285725+0000","last_clean":"2024-09-12T00:19:24.285725+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:19:24.285725+0000","last_undegraded":"2024-09-12T00:19:24.285725+0000","last_fullsized":"2024-09-12T00:19:24.285725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270457+0000","last_change":"2024-09-12T00:18:44.210883+0000","last_active":"2024-09-12T00:19:24.270457+0000","last_peered":"2024-09-12T00:19:24.270457+0000","last_clean":"2024-09-12T00:19:24.270457+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:19:24.270457+0000","last_undegraded":"2024-09-12T00:19:24.270457+0000","last_fullsized":"2024-09-12T00:19:24.270457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547239+0000","last_change":"2024-09-12T00:18:48.208984+0000","last_active":"2024-09-12T00:19:24.547239+0000","last_peered":"2024-09-12T00:19:24.547239+0000","last_clean":"2024-09-12T00:19:24.547239+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:19:24.547239+0000","last_undegraded":"2024-09-12T00:19:24.547239+0000","last_fullsized":"2024-09-12T00:19:24.547239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.522290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.833142+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.833142+0000","last_peered":"2024-09-12T00:22:00.833142+0000","last_clean":"2024-09-12T00:22:00.833142+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.833142+0000","last_undegraded":"2024-09-12T00:22:00.833142+0000","last_fullsized":"2024-09-12T00:22:00.833142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:49.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299271+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:19:24.299271+0000","last_peered":"2024-09-12T00:19:24.299271+0000","last_clean":"2024-09-12T00:19:24.299271+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:19:24.299271+0000","last_undegraded":"2024-09-12T00:19:24.299271+0000","last_fullsized":"2024-09-12T00:19:24.299271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:40.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.160041+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:00.160041+0000","last_peered":"2024-09-12T00:21:00.160041+0000","last_clean":"2024-09-12T00:21:00.160041+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:00.160041+0000","last_undegraded":"2024-09-12T00:21:00.160041+0000","last_fullsized":"2024-09-12T00:21:00.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:16.953577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685978+0000","last_change":"2024-09-12T00:18:46.213096+0000","last_active":"2024-09-12T00:22:01.685978+0000","last_peered":"2024-09-12T00:22:01.685978+0000","last_clean":"2024-09-12T00:22:01.685978+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:01.685978+0000","last_undegraded":"2024-09-12T00:22:01.685978+0000","last_fullsized":"2024-09-12T00:22:01.685978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:49.858730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271876+0000","last_change":"2024-09-12T00:18:44.194766+0000","last_active":"2024-09-12T00:19:24.271876+0000","last_peered":"2024-09-12T00:19:24.271876+0000","last_clean":"2024-09-12T00:19:24.271876+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:19:24.271876+0000","last_undegraded":"2024-09-12T00:19:24.271876+0000","last_fullsized":"2024-09-12T00:19:24.271876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545007+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:19:24.545007+0000","last_peered":"2024-09-12T00:19:24.545007+0000","last_clean":"2024-09-12T00:19:24.545007+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:19:24.545007+0000","last_undegraded":"2024-09-12T00:19:24.545007+0000","last_fullsized":"2024-09-12T00:19:24.545007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597116+0000","last_change":"2024-09-12T00:18:48.207153+0000","last_active":"2024-09-12T00:20:52.597116+0000","last_peered":"2024-09-12T00:20:52.597116+0000","last_clean":"2024-09-12T00:20:52.597116+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:20:52.597116+0000","last_undegraded":"2024-09-12T00:20:52.597116+0000","last_fullsized":"2024-09-12T00:20:52.597116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:40.156001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276330+0000","last_change":"2024-09-12T00:18:50.224303+0000","last_active":"2024-09-12T00:20:58.276330+0000","last_peered":"2024-09-12T00:20:58.276330+0000","last_clean":"2024-09-12T00:20:58.276330+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:20:58.276330+0000","last_undegraded":"2024-09-12T00:20:58.276330+0000","last_fullsized":"2024-09-12T00:20:58.276330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.322839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268956+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:19:24.268956+0000","last_peered":"2024-09-12T00:19:24.268956+0000","last_clean":"2024-09-12T00:19:24.268956+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:19:24.268956+0000","last_undegraded":"2024-09-12T00:19:24.268956+0000","last_fullsized":"2024-09-12T00:19:24.268956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.028206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:32.516814+0000","last_change":"2024-09-12T00:19:24.290331+0000","last_active":"2024-09-12T00:19:32.516814+0000","last_peered":"2024-09-12T00:19:32.516814+0000","last_clean":"2024-09-12T00:19:32.516814+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:19:32.516814+0000","last_undegraded":"2024-09-12T00:19:32.516814+0000","last_fullsized":"2024-09-12T00:19:32.516814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547212+0000","last_change":"2024-09-12T00:18:44.199819+0000","last_active":"2024-09-12T00:19:24.547212+0000","last_peered":"2024-09-12T00:19:24.547212+0000","last_clean":"2024-09-12T00:19:24.547212+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:19:24.547212+0000","last_undegraded":"2024-09-12T00:19:24.547212+0000","last_fullsized":"2024-09-12T00:19:24.547212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:41.074307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292863+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:19:24.292863+0000","last_peered":"2024-09-12T00:19:24.292863+0000","last_clean":"2024-09-12T00:19:24.292863+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:19:24.292863+0000","last_undegraded":"2024-09-12T00:19:24.292863+0000","last_fullsized":"2024-09-12T00:19:24.292863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.303925+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:19:24.303925+0000","last_peered":"2024-09-12T00:19:24.303925+0000","last_clean":"2024-09-12T00:19:24.303925+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:19:24.303925+0000","last_undegraded":"2024-09-12T00:19:24.303925+0000","last_fullsized":"2024-09-12T00:19:24.303925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.689100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274457+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:19:24.274457+0000","last_peered":"2024-09-12T00:19:24.274457+0000","last_clean":"2024-09-12T00:19:24.274457+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:19:24.274457+0000","last_undegraded":"2024-09-12T00:19:24.274457+0000","last_fullsized":"2024-09-12T00:19:24.274457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.218218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":371,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453469+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:21:58.453469+0000","last_peered":"2024-09-12T00:21:58.453469+0000","last_clean":"2024-09-12T00:21:58.453469+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:21:58.453469+0000","last_undegraded":"2024-09-12T00:21:58.453469+0000","last_fullsized":"2024-09-12T00:21:58.453469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949445+0000","last_change":"2024-09-12T00:18:46.215890+0000","last_active":"2024-09-12T00:20:55.949445+0000","last_peered":"2024-09-12T00:20:55.949445+0000","last_clean":"2024-09-12T00:20:55.949445+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:20:55.949445+0000","last_undegraded":"2024-09-12T00:20:55.949445+0000","last_fullsized":"2024-09-12T00:20:55.949445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:46.309362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.873890+0000","last_change":"2024-09-12T00:18:44.212538+0000","last_active":"2024-09-12T00:22:01.873890+0000","last_peered":"2024-09-12T00:22:01.873890+0000","last_clean":"2024-09-12T00:22:01.873890+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:01.873890+0000","last_undegraded":"2024-09-12T00:22:01.873890+0000","last_fullsized":"2024-09-12T00:22:01.873890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.256228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548363+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:19:24.548363+0000","last_peered":"2024-09-12T00:19:24.548363+0000","last_clean":"2024-09-12T00:19:24.548363+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:19:24.548363+0000","last_undegraded":"2024-09-12T00:19:24.548363+0000","last_fullsized":"2024-09-12T00:19:24.548363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291763+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:19:24.291763+0000","last_peered":"2024-09-12T00:19:24.291763+0000","last_clean":"2024-09-12T00:19:24.291763+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:19:24.291763+0000","last_undegraded":"2024-09-12T00:19:24.291763+0000","last_fullsized":"2024-09-12T00:19:24.291763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287632+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:19:24.287632+0000","last_peered":"2024-09-12T00:19:24.287632+0000","last_clean":"2024-09-12T00:19:24.287632+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:19:24.287632+0000","last_undegraded":"2024-09-12T00:19:24.287632+0000","last_fullsized":"2024-09-12T00:19:24.287632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:13.589684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":401,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.426978+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:02.426978+0000","last_peered":"2024-09-12T00:22:02.426978+0000","last_clean":"2024-09-12T00:22:02.426978+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:02.426978+0000","last_undegraded":"2024-09-12T00:22:02.426978+0000","last_fullsized":"2024-09-12T00:22:02.426978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:31.647959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.112613+0000","last_change":"2024-09-12T00:18:46.192554+0000","last_active":"2024-09-12T00:22:02.112613+0000","last_peered":"2024-09-12T00:22:02.112613+0000","last_clean":"2024-09-12T00:22:02.112613+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:02.112613+0000","last_undegraded":"2024-09-12T00:22:02.112613+0000","last_fullsized":"2024-09-12T00:22:02.112613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:28.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288209+0000","last_change":"2024-09-12T00:18:44.208784+0000","last_active":"2024-09-12T00:19:24.288209+0000","last_peered":"2024-09-12T00:19:24.288209+0000","last_clean":"2024-09-12T00:19:24.288209+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:19:24.288209+0000","last_undegraded":"2024-09-12T00:19:24.288209+0000","last_fullsized":"2024-09-12T00:19:24.288209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:59.889965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298936+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:19:24.298936+0000","last_peered":"2024-09-12T00:19:24.298936+0000","last_clean":"2024-09-12T00:19:24.298936+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:19:24.298936+0000","last_undegraded":"2024-09-12T00:19:24.298936+0000","last_fullsized":"2024-09-12T00:19:24.298936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.854016+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:20:59.854016+0000","last_peered":"2024-09-12T00:20:59.854016+0000","last_clean":"2024-09-12T00:20:59.854016+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:20:59.854016+0000","last_undegraded":"2024-09-12T00:20:59.854016+0000","last_fullsized":"2024-09-12T00:20:59.854016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:13.228327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'89","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.240753+0000","last_change":"2024-09-12T00:18:50.216704+0000","last_active":"2024-09-12T00:20:58.240753+0000","last_peered":"2024-09-12T00:20:58.240753+0000","last_clean":"2024-09-12T00:20:58.240753+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:20:58.240753+0000","last_undegraded":"2024-09-12T00:20:58.240753+0000","last_fullsized":"2024-09-12T00:20:58.240753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:30.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545585+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:19:24.545585+0000","last_peered":"2024-09-12T00:19:24.545585+0000","last_clean":"2024-09-12T00:19:24.545585+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:19:24.545585+0000","last_undegraded":"2024-09-12T00:19:24.545585+0000","last_fullsized":"2024-09-12T00:19:24.545585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.985554+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:01.985554+0000","last_peered":"2024-09-12T00:22:01.985554+0000","last_clean":"2024-09-12T00:22:01.985554+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:01.985554+0000","last_undegraded":"2024-09-12T00:22:01.985554+0000","last_fullsized":"2024-09-12T00:22:01.985554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:58.559812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904828+0000","last_change":"2024-09-12T00:18:46.189861+0000","last_active":"2024-09-12T00:22:01.904828+0000","last_peered":"2024-09-12T00:22:01.904828+0000","last_clean":"2024-09-12T00:22:01.904828+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:01.904828+0000","last_undegraded":"2024-09-12T00:22:01.904828+0000","last_fullsized":"2024-09-12T00:22:01.904828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291694+0000","last_change":"2024-09-12T00:18:44.220926+0000","last_active":"2024-09-12T00:19:24.291694+0000","last_peered":"2024-09-12T00:19:24.291694+0000","last_clean":"2024-09-12T00:19:24.291694+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:19:24.291694+0000","last_undegraded":"2024-09-12T00:19:24.291694+0000","last_fullsized":"2024-09-12T00:19:24.291694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:45.017062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279723+0000","last_change":"2024-09-12T00:18:48.216343+0000","last_active":"2024-09-12T00:19:24.279723+0000","last_peered":"2024-09-12T00:19:24.279723+0000","last_clean":"2024-09-12T00:19:24.279723+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:19:24.279723+0000","last_undegraded":"2024-09-12T00:19:24.279723+0000","last_fullsized":"2024-09-12T00:19:24.279723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:54.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.260323+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:20:58.260323+0000","last_peered":"2024-09-12T00:20:58.260323+0000","last_clean":"2024-09-12T00:20:58.260323+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:20:58.260323+0000","last_undegraded":"2024-09-12T00:20:58.260323+0000","last_fullsized":"2024-09-12T00:20:58.260323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.846790+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.846790+0000","last_peered":"2024-09-12T00:20:57.846790+0000","last_clean":"2024-09-12T00:20:57.846790+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.846790+0000","last_undegraded":"2024-09-12T00:20:57.846790+0000","last_fullsized":"2024-09-12T00:20:57.846790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.924187+0000","last_change":"2024-09-12T00:18:46.217714+0000","last_active":"2024-09-12T00:22:01.924187+0000","last_peered":"2024-09-12T00:22:01.924187+0000","last_clean":"2024-09-12T00:22:01.924187+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:01.924187+0000","last_undegraded":"2024-09-12T00:22:01.924187+0000","last_fullsized":"2024-09-12T00:22:01.924187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272131+0000","last_change":"2024-09-12T00:18:44.211179+0000","last_active":"2024-09-12T00:19:24.272131+0000","last_peered":"2024-09-12T00:19:24.272131+0000","last_clean":"2024-09-12T00:19:24.272131+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:19:24.272131+0000","last_undegraded":"2024-09-12T00:19:24.272131+0000","last_fullsized":"2024-09-12T00:19:24.272131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.906157+0000","last_change":"2024-09-12T00:18:46.194089+0000","last_active":"2024-09-12T00:22:01.906157+0000","last_peered":"2024-09-12T00:22:01.906157+0000","last_clean":"2024-09-12T00:22:01.906157+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:01.906157+0000","last_undegraded":"2024-09-12T00:22:01.906157+0000","last_fullsized":"2024-09-12T00:22:01.906157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278439+0000","last_change":"2024-09-12T00:18:44.197793+0000","last_active":"2024-09-12T00:19:24.278439+0000","last_peered":"2024-09-12T00:19:24.278439+0000","last_clean":"2024-09-12T00:19:24.278439+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:19:24.278439+0000","last_undegraded":"2024-09-12T00:19:24.278439+0000","last_fullsized":"2024-09-12T00:19:24.278439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:28.573321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267773+0000","last_change":"2024-09-12T00:18:48.200680+0000","last_active":"2024-09-12T00:19:24.267773+0000","last_peered":"2024-09-12T00:19:24.267773+0000","last_clean":"2024-09-12T00:19:24.267773+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:19:24.267773+0000","last_undegraded":"2024-09-12T00:19:24.267773+0000","last_fullsized":"2024-09-12T00:19:24.267773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'42","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.999610+0000","last_change":"2024-09-12T00:18:50.224287+0000","last_active":"2024-09-12T00:22:00.999610+0000","last_peered":"2024-09-12T00:22:00.999610+0000","last_clean":"2024-09-12T00:22:00.999610+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:22:00.999610+0000","last_undegraded":"2024-09-12T00:22:00.999610+0000","last_fullsized":"2024-09-12T00:22:00.999610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":85,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.705857+0000","last_change":"2024-09-12T00:18:46.214462+0000","last_active":"2024-09-12T00:22:01.705857+0000","last_peered":"2024-09-12T00:22:01.705857+0000","last_clean":"2024-09-12T00:22:01.705857+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:22:01.705857+0000","last_undegraded":"2024-09-12T00:22:01.705857+0000","last_fullsized":"2024-09-12T00:22:01.705857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:37.657684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.472192+0000","last_change":"2024-09-12T00:18:44.196857+0000","last_active":"2024-09-12T00:22:01.472192+0000","last_peered":"2024-09-12T00:22:01.472192+0000","last_clean":"2024-09-12T00:22:01.472192+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:01.472192+0000","last_undegraded":"2024-09-12T00:22:01.472192+0000","last_fullsized":"2024-09-12T00:22:01.472192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.238155+0000","last_change":"2024-09-12T00:18:50.204600+0000","last_active":"2024-09-12T00:20:58.238155+0000","last_peered":"2024-09-12T00:20:58.238155+0000","last_clean":"2024-09-12T00:20:58.238155+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:20:58.238155+0000","last_undegraded":"2024-09-12T00:20:58.238155+0000","last_fullsized":"2024-09-12T00:20:58.238155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.683615+0000","last_change":"2024-09-12T00:18:46.191419+0000","last_active":"2024-09-12T00:22:01.683615+0000","last_peered":"2024-09-12T00:22:01.683615+0000","last_clean":"2024-09-12T00:22:01.683615+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:22:01.683615+0000","last_undegraded":"2024-09-12T00:22:01.683615+0000","last_fullsized":"2024-09-12T00:22:01.683615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:24.777789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.956540+0000","last_change":"2024-09-12T00:18:44.218418+0000","last_active":"2024-09-12T00:19:30.956540+0000","last_peered":"2024-09-12T00:19:30.956540+0000","last_clean":"2024-09-12T00:19:30.956540+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:19:30.956540+0000","last_undegraded":"2024-09-12T00:19:30.956540+0000","last_fullsized":"2024-09-12T00:19:30.956540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:11.461908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550826+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:19:24.550826+0000","last_peered":"2024-09-12T00:19:24.550826+0000","last_clean":"2024-09-12T00:19:24.550826+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:19:24.550826+0000","last_undegraded":"2024-09-12T00:19:24.550826+0000","last_fullsized":"2024-09-12T00:19:24.550826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:10.736641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272148+0000","last_change":"2024-09-12T00:18:50.216262+0000","last_active":"2024-09-12T00:20:58.272148+0000","last_peered":"2024-09-12T00:20:58.272148+0000","last_clean":"2024-09-12T00:20:58.272148+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:20:58.272148+0000","last_undegraded":"2024-09-12T00:20:58.272148+0000","last_fullsized":"2024-09-12T00:20:58.272148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'15","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035728+0000","last_change":"2024-09-12T00:18:46.211034+0000","last_active":"2024-09-12T00:22:02.035728+0000","last_peered":"2024-09-12T00:22:02.035728+0000","last_clean":"2024-09-12T00:22:02.035728+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:22:02.035728+0000","last_undegraded":"2024-09-12T00:22:02.035728+0000","last_fullsized":"2024-09-12T00:22:02.035728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272298+0000","last_change":"2024-09-12T00:18:44.193399+0000","last_active":"2024-09-12T00:19:24.272298+0000","last_peered":"2024-09-12T00:19:24.272298+0000","last_clean":"2024-09-12T00:19:24.272298+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:19:24.272298+0000","last_undegraded":"2024-09-12T00:19:24.272298+0000","last_fullsized":"2024-09-12T00:19:24.272298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293437+0000","last_change":"2024-09-12T00:19:24.291735+0000","last_active":"2024-09-12T00:19:24.293437+0000","last_peered":"2024-09-12T00:19:24.293437+0000","last_clean":"2024-09-12T00:19:24.293437+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:19:24.293437+0000","last_undegraded":"2024-09-12T00:19:24.293437+0000","last_fullsized":"2024-09-12T00:19:24.293437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:24.444471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:22.613326+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:21:22.613326+0000","last_peered":"2024-09-12T00:21:22.613326+0000","last_clean":"2024-09-12T00:21:22.613326+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:21:22.613326+0000","last_undegraded":"2024-09-12T00:21:22.613326+0000","last_fullsized":"2024-09-12T00:21:22.613326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.520849+0000","last_change":"2024-09-12T00:18:46.214392+0000","last_active":"2024-09-12T00:22:01.520849+0000","last_peered":"2024-09-12T00:22:01.520849+0000","last_clean":"2024-09-12T00:22:01.520849+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:22:01.520849+0000","last_undegraded":"2024-09-12T00:22:01.520849+0000","last_fullsized":"2024-09-12T00:22:01.520849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.180192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.769730+0000","last_change":"2024-09-12T00:18:44.202045+0000","last_active":"2024-09-12T00:19:31.769730+0000","last_peered":"2024-09-12T00:19:31.769730+0000","last_clean":"2024-09-12T00:19:31.769730+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:19:31.769730+0000","last_undegraded":"2024-09-12T00:19:31.769730+0000","last_fullsized":"2024-09-12T00:19:31.769730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276461+0000","last_change":"2024-09-12T00:18:48.196567+0000","last_active":"2024-09-12T00:19:24.276461+0000","last_peered":"2024-09-12T00:19:24.276461+0000","last_clean":"2024-09-12T00:19:24.276461+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:19:24.276461+0000","last_undegraded":"2024-09-12T00:19:24.276461+0000","last_fullsized":"2024-09-12T00:19:24.276461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:59.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.830301+0000","last_change":"2024-09-12T00:18:50.222960+0000","last_active":"2024-09-12T00:20:57.830301+0000","last_peered":"2024-09-12T00:20:57.830301+0000","last_clean":"2024-09-12T00:20:57.830301+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:20:57.830301+0000","last_undegraded":"2024-09-12T00:20:57.830301+0000","last_fullsized":"2024-09-12T00:20:57.830301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:40.015121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547263+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:19:24.547263+0000","last_peered":"2024-09-12T00:19:24.547263+0000","last_clean":"2024-09-12T00:19:24.547263+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:19:24.547263+0000","last_undegraded":"2024-09-12T00:19:24.547263+0000","last_fullsized":"2024-09-12T00:19:24.547263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:36.813068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.688555+0000","last_change":"2024-09-12T00:18:46.199141+0000","last_active":"2024-09-12T00:22:01.688555+0000","last_peered":"2024-09-12T00:22:01.688555+0000","last_clean":"2024-09-12T00:22:01.688555+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:01.688555+0000","last_undegraded":"2024-09-12T00:22:01.688555+0000","last_fullsized":"2024-09-12T00:22:01.688555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:15.268348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286089+0000","last_change":"2024-09-12T00:18:44.202449+0000","last_active":"2024-09-12T00:19:24.286089+0000","last_peered":"2024-09-12T00:19:24.286089+0000","last_clean":"2024-09-12T00:19:24.286089+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:19:24.286089+0000","last_undegraded":"2024-09-12T00:19:24.286089+0000","last_fullsized":"2024-09-12T00:19:24.286089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:21.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.297596+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:19:24.297596+0000","last_peered":"2024-09-12T00:19:24.297596+0000","last_clean":"2024-09-12T00:19:24.297596+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:19:24.297596+0000","last_undegraded":"2024-09-12T00:19:24.297596+0000","last_fullsized":"2024-09-12T00:19:24.297596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.140374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453820+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:21:58.453820+0000","last_peered":"2024-09-12T00:21:58.453820+0000","last_clean":"2024-09-12T00:21:58.453820+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:21:58.453820+0000","last_undegraded":"2024-09-12T00:21:58.453820+0000","last_fullsized":"2024-09-12T00:21:58.453820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:47.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904775+0000","last_change":"2024-09-12T00:18:46.184978+0000","last_active":"2024-09-12T00:22:01.904775+0000","last_peered":"2024-09-12T00:22:01.904775+0000","last_clean":"2024-09-12T00:22:01.904775+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:22:01.904775+0000","last_undegraded":"2024-09-12T00:22:01.904775+0000","last_fullsized":"2024-09-12T00:22:01.904775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:34.862818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.670182+0000","last_change":"2024-09-12T00:18:44.200635+0000","last_active":"2024-09-12T00:21:00.670182+0000","last_peered":"2024-09-12T00:21:00.670182+0000","last_clean":"2024-09-12T00:21:00.670182+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:21:00.670182+0000","last_undegraded":"2024-09-12T00:21:00.670182+0000","last_fullsized":"2024-09-12T00:21:00.670182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274386+0000","last_change":"2024-09-12T00:18:48.218098+0000","last_active":"2024-09-12T00:19:24.274386+0000","last_peered":"2024-09-12T00:19:24.274386+0000","last_clean":"2024-09-12T00:19:24.274386+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:19:24.274386+0000","last_undegraded":"2024-09-12T00:19:24.274386+0000","last_fullsized":"2024-09-12T00:19:24.274386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'63","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.603751+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:21:17.603751+0000","last_peered":"2024-09-12T00:21:17.603751+0000","last_clean":"2024-09-12T00:21:17.603751+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:21:17.603751+0000","last_undegraded":"2024-09-12T00:21:17.603751+0000","last_fullsized":"2024-09-12T00:21:17.603751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.110848+0000","last_change":"2024-09-12T00:18:46.184999+0000","last_active":"2024-09-12T00:22:02.110848+0000","last_peered":"2024-09-12T00:22:02.110848+0000","last_clean":"2024-09-12T00:22:02.110848+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:22:02.110848+0000","last_undegraded":"2024-09-12T00:22:02.110848+0000","last_fullsized":"2024-09-12T00:22:02.110848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.882201+0000","last_change":"2024-09-12T00:18:44.212572+0000","last_active":"2024-09-12T00:22:01.882201+0000","last_peered":"2024-09-12T00:22:01.882201+0000","last_clean":"2024-09-12T00:22:01.882201+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:01.882201+0000","last_undegraded":"2024-09-12T00:22:01.882201+0000","last_fullsized":"2024-09-12T00:22:01.882201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.022098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271547+0000","last_change":"2024-09-12T00:18:48.208202+0000","last_active":"2024-09-12T00:19:24.271547+0000","last_peered":"2024-09-12T00:19:24.271547+0000","last_clean":"2024-09-12T00:19:24.271547+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:19:24.271547+0000","last_undegraded":"2024-09-12T00:19:24.271547+0000","last_fullsized":"2024-09-12T00:19:24.271547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.859052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.228341+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:20:58.228341+0000","last_peered":"2024-09-12T00:20:58.228341+0000","last_clean":"2024-09-12T00:20:58.228341+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:20:58.228341+0000","last_undegraded":"2024-09-12T00:20:58.228341+0000","last_fullsized":"2024-09-12T00:20:58.228341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903921+0000","last_change":"2024-09-12T00:18:46.183379+0000","last_active":"2024-09-12T00:22:01.903921+0000","last_peered":"2024-09-12T00:22:01.903921+0000","last_clean":"2024-09-12T00:22:01.903921+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:22:01.903921+0000","last_undegraded":"2024-09-12T00:22:01.903921+0000","last_fullsized":"2024-09-12T00:22:01.903921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:35.985414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548742+0000","last_change":"2024-09-12T00:18:44.217239+0000","last_active":"2024-09-12T00:19:24.548742+0000","last_peered":"2024-09-12T00:19:24.548742+0000","last_clean":"2024-09-12T00:19:24.548742+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:19:24.548742+0000","last_undegraded":"2024-09-12T00:19:24.548742+0000","last_fullsized":"2024-09-12T00:19:24.548742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271418+0000","last_change":"2024-09-12T00:18:48.211981+0000","last_active":"2024-09-12T00:19:24.271418+0000","last_peered":"2024-09-12T00:19:24.271418+0000","last_clean":"2024-09-12T00:19:24.271418+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:19:24.271418+0000","last_undegraded":"2024-09-12T00:19:24.271418+0000","last_fullsized":"2024-09-12T00:19:24.271418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:50.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'32","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.262956+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:20:58.262956+0000","last_peered":"2024-09-12T00:20:58.262956+0000","last_clean":"2024-09-12T00:20:58.262956+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:20:58.262956+0000","last_undegraded":"2024-09-12T00:20:58.262956+0000","last_fullsized":"2024-09-12T00:20:58.262956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'3","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703821+0000","last_change":"2024-09-12T00:18:46.183984+0000","last_active":"2024-09-12T00:22:01.703821+0000","last_peered":"2024-09-12T00:22:01.703821+0000","last_clean":"2024-09-12T00:22:01.703821+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:01.703821+0000","last_undegraded":"2024-09-12T00:22:01.703821+0000","last_fullsized":"2024-09-12T00:22:01.703821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:51.504748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290737+0000","last_change":"2024-09-12T00:18:44.197634+0000","last_active":"2024-09-12T00:19:24.290737+0000","last_peered":"2024-09-12T00:19:24.290737+0000","last_clean":"2024-09-12T00:19:24.290737+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:19:24.290737+0000","last_undegraded":"2024-09-12T00:19:24.290737+0000","last_fullsized":"2024-09-12T00:19:24.290737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:56.491323+0000","last_change":"2024-09-12T00:18:48.204166+0000","last_active":"2024-09-12T00:20:56.491323+0000","last_peered":"2024-09-12T00:20:56.491323+0000","last_clean":"2024-09-12T00:20:56.491323+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:20:56.491323+0000","last_undegraded":"2024-09-12T00:20:56.491323+0000","last_fullsized":"2024-09-12T00:20:56.491323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.533140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845387+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:00.845387+0000","last_peered":"2024-09-12T00:22:00.845387+0000","last_clean":"2024-09-12T00:22:00.845387+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:00.845387+0000","last_undegraded":"2024-09-12T00:22:00.845387+0000","last_fullsized":"2024-09-12T00:22:00.845387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291583+0000","last_change":"2024-09-12T00:18:46.213160+0000","last_active":"2024-09-12T00:19:24.291583+0000","last_peered":"2024-09-12T00:19:24.291583+0000","last_clean":"2024-09-12T00:19:24.291583+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:19:24.291583+0000","last_undegraded":"2024-09-12T00:19:24.291583+0000","last_fullsized":"2024-09-12T00:19:24.291583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.139206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265951+0000","last_change":"2024-09-12T00:18:44.203057+0000","last_active":"2024-09-12T00:19:24.265951+0000","last_peered":"2024-09-12T00:19:24.265951+0000","last_clean":"2024-09-12T00:19:24.265951+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:19:24.265951+0000","last_undegraded":"2024-09-12T00:19:24.265951+0000","last_fullsized":"2024-09-12T00:19:24.265951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521595+0000","last_change":"2024-09-12T00:18:46.199022+0000","last_active":"2024-09-12T00:22:01.521595+0000","last_peered":"2024-09-12T00:22:01.521595+0000","last_clean":"2024-09-12T00:22:01.521595+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:22:01.521595+0000","last_undegraded":"2024-09-12T00:22:01.521595+0000","last_fullsized":"2024-09-12T00:22:01.521595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:13.922738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543621+0000","last_change":"2024-09-12T00:18:44.195990+0000","last_active":"2024-09-12T00:19:24.543621+0000","last_peered":"2024-09-12T00:19:24.543621+0000","last_clean":"2024-09-12T00:19:24.543621+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:19:24.543621+0000","last_undegraded":"2024-09-12T00:19:24.543621+0000","last_fullsized":"2024-09-12T00:19:24.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.780507+0000","last_change":"2024-09-12T00:18:46.188983+0000","last_active":"2024-09-12T00:21:00.780507+0000","last_peered":"2024-09-12T00:21:00.780507+0000","last_clean":"2024-09-12T00:21:00.780507+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:21:00.780507+0000","last_undegraded":"2024-09-12T00:21:00.780507+0000","last_fullsized":"2024-09-12T00:21:00.780507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.278021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605456+0000","last_change":"2024-09-12T00:18:44.216479+0000","last_active":"2024-09-12T00:20:52.605456+0000","last_peered":"2024-09-12T00:20:52.605456+0000","last_clean":"2024-09-12T00:20:52.605456+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:20:52.605456+0000","last_undegraded":"2024-09-12T00:20:52.605456+0000","last_fullsized":"2024-09-12T00:20:52.605456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.659928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020857+0000","last_change":"2024-09-12T00:18:46.199070+0000","last_active":"2024-09-12T00:22:02.020857+0000","last_peered":"2024-09-12T00:22:02.020857+0000","last_clean":"2024-09-12T00:22:02.020857+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:22:02.020857+0000","last_undegraded":"2024-09-12T00:22:02.020857+0000","last_fullsized":"2024-09-12T00:22:02.020857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550235+0000","last_change":"2024-09-12T00:18:44.216172+0000","last_active":"2024-09-12T00:19:24.550235+0000","last_peered":"2024-09-12T00:19:24.550235+0000","last_clean":"2024-09-12T00:19:24.550235+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:19:24.550235+0000","last_undegraded":"2024-09-12T00:19:24.550235+0000","last_fullsized":"2024-09-12T00:19:24.550235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.247891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.094167+0000","last_change":"2024-09-12T00:18:46.195536+0000","last_active":"2024-09-12T00:22:02.094167+0000","last_peered":"2024-09-12T00:22:02.094167+0000","last_clean":"2024-09-12T00:22:02.094167+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:02.094167+0000","last_undegraded":"2024-09-12T00:22:02.094167+0000","last_fullsized":"2024-09-12T00:22:02.094167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215866+0000","last_change":"2024-09-12T00:18:44.197186+0000","last_active":"2024-09-12T00:19:30.215866+0000","last_peered":"2024-09-12T00:19:30.215866+0000","last_clean":"2024-09-12T00:19:30.215866+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:19:30.215866+0000","last_undegraded":"2024-09-12T00:19:30.215866+0000","last_fullsized":"2024-09-12T00:19:30.215866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:56.784241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091927+0000","last_change":"2024-09-12T00:18:46.217504+0000","last_active":"2024-09-12T00:22:02.091927+0000","last_peered":"2024-09-12T00:22:02.091927+0000","last_clean":"2024-09-12T00:22:02.091927+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:02.091927+0000","last_undegraded":"2024-09-12T00:22:02.091927+0000","last_fullsized":"2024-09-12T00:22:02.091927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:19.889526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599343+0000","last_change":"2024-09-12T00:18:44.213699+0000","last_active":"2024-09-12T00:20:57.599343+0000","last_peered":"2024-09-12T00:20:57.599343+0000","last_clean":"2024-09-12T00:20:57.599343+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:20:57.599343+0000","last_undegraded":"2024-09-12T00:20:57.599343+0000","last_fullsized":"2024-09-12T00:20:57.599343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020343+0000","last_change":"2024-09-12T00:18:46.210908+0000","last_active":"2024-09-12T00:22:02.020343+0000","last_peered":"2024-09-12T00:22:02.020343+0000","last_clean":"2024-09-12T00:22:02.020343+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:22:02.020343+0000","last_undegraded":"2024-09-12T00:22:02.020343+0000","last_fullsized":"2024-09-12T00:22:02.020343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278780+0000","last_change":"2024-09-12T00:18:44.198599+0000","last_active":"2024-09-12T00:19:24.278780+0000","last_peered":"2024-09-12T00:19:24.278780+0000","last_clean":"2024-09-12T00:19:24.278780+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:19:24.278780+0000","last_undegraded":"2024-09-12T00:19:24.278780+0000","last_fullsized":"2024-09-12T00:19:24.278780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:41.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091749+0000","last_change":"2024-09-12T00:18:46.211137+0000","last_active":"2024-09-12T00:22:02.091749+0000","last_peered":"2024-09-12T00:22:02.091749+0000","last_clean":"2024-09-12T00:22:02.091749+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:02.091749+0000","last_undegraded":"2024-09-12T00:22:02.091749+0000","last_fullsized":"2024-09-12T00:22:02.091749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.932223+0000","last_change":"2024-09-12T00:18:44.198634+0000","last_active":"2024-09-12T00:20:55.932223+0000","last_peered":"2024-09-12T00:20:55.932223+0000","last_clean":"2024-09-12T00:20:55.932223+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:20:55.932223+0000","last_undegraded":"2024-09-12T00:20:55.932223+0000","last_fullsized":"2024-09-12T00:20:55.932223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:48.169091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.018907+0000","last_change":"2024-09-12T00:18:46.201393+0000","last_active":"2024-09-12T00:22:02.018907+0000","last_peered":"2024-09-12T00:22:02.018907+0000","last_clean":"2024-09-12T00:22:02.018907+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:22:02.018907+0000","last_undegraded":"2024-09-12T00:22:02.018907+0000","last_fullsized":"2024-09-12T00:22:02.018907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:13.149208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277355+0000","last_change":"2024-09-12T00:18:44.216635+0000","last_active":"2024-09-12T00:19:24.277355+0000","last_peered":"2024-09-12T00:19:24.277355+0000","last_clean":"2024-09-12T00:19:24.277355+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:19:24.277355+0000","last_undegraded":"2024-09-12T00:19:24.277355+0000","last_fullsized":"2024-09-12T00:19:24.277355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.723598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544142+0000","last_change":"2024-09-12T00:18:44.217899+0000","last_active":"2024-09-12T00:19:24.544142+0000","last_peered":"2024-09-12T00:19:24.544142+0000","last_clean":"2024-09-12T00:19:24.544142+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:19:24.544142+0000","last_undegraded":"2024-09-12T00:19:24.544142+0000","last_fullsized":"2024-09-12T00:19:24.544142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:23.029905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548033+0000","last_change":"2024-09-12T00:18:46.198204+0000","last_active":"2024-09-12T00:19:24.548033+0000","last_peered":"2024-09-12T00:19:24.548033+0000","last_clean":"2024-09-12T00:19:24.548033+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:19:24.548033+0000","last_undegraded":"2024-09-12T00:19:24.548033+0000","last_fullsized":"2024-09-12T00:19:24.548033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272805+0000","last_change":"2024-09-12T00:18:44.201625+0000","last_active":"2024-09-12T00:19:24.272805+0000","last_peered":"2024-09-12T00:19:24.272805+0000","last_clean":"2024-09-12T00:19:24.272805+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:19:24.272805+0000","last_undegraded":"2024-09-12T00:19:24.272805+0000","last_fullsized":"2024-09-12T00:19:24.272805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:25.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.800593+0000","last_change":"2024-09-12T00:18:46.206094+0000","last_active":"2024-09-12T00:21:00.800593+0000","last_peered":"2024-09-12T00:21:00.800593+0000","last_clean":"2024-09-12T00:21:00.800593+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:21:00.800593+0000","last_undegraded":"2024-09-12T00:21:00.800593+0000","last_fullsized":"2024-09-12T00:21:00.800593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:54.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276552+0000","last_change":"2024-09-12T00:18:44.196752+0000","last_active":"2024-09-12T00:19:24.276552+0000","last_peered":"2024-09-12T00:19:24.276552+0000","last_clean":"2024-09-12T00:19:24.276552+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:19:24.276552+0000","last_undegraded":"2024-09-12T00:19:24.276552+0000","last_fullsized":"2024-09-12T00:19:24.276552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521751+0000","last_change":"2024-09-12T00:19:24.549151+0000","last_active":"2024-09-12T00:22:01.521751+0000","last_peered":"2024-09-12T00:22:01.521751+0000","last_clean":"2024-09-12T00:22:01.521751+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:01.521751+0000","last_undegraded":"2024-09-12T00:22:01.521751+0000","last_fullsized":"2024-09-12T00:22:01.521751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:25.450062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.482133+0000","last_change":"2024-09-12T00:18:44.183718+0000","last_active":"2024-09-12T00:21:00.482133+0000","last_peered":"2024-09-12T00:21:00.482133+0000","last_clean":"2024-09-12T00:21:00.482133+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:21:00.482133+0000","last_undegraded":"2024-09-12T00:21:00.482133+0000","last_fullsized":"2024-09-12T00:21:00.482133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600242+0000","last_change":"2024-09-12T00:18:46.203607+0000","last_active":"2024-09-12T00:21:02.600242+0000","last_peered":"2024-09-12T00:21:02.600242+0000","last_clean":"2024-09-12T00:21:02.600242+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:21:02.600242+0000","last_undegraded":"2024-09-12T00:21:02.600242+0000","last_fullsized":"2024-09-12T00:21:02.600242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:01.158629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.255211+0000","last_change":"2024-09-12T00:18:44.205642+0000","last_active":"2024-09-12T00:20:15.255211+0000","last_peered":"2024-09-12T00:20:15.255211+0000","last_clean":"2024-09-12T00:20:15.255211+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:20:15.255211+0000","last_undegraded":"2024-09-12T00:20:15.255211+0000","last_fullsized":"2024-09-12T00:20:15.255211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.988420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950179+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:20:55.950179+0000","last_peered":"2024-09-12T00:20:55.950179+0000","last_clean":"2024-09-12T00:20:55.950179+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:20:55.950179+0000","last_undegraded":"2024-09-12T00:20:55.950179+0000","last_fullsized":"2024-09-12T00:20:55.950179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597799+0000","last_change":"2024-09-12T00:18:44.198284+0000","last_active":"2024-09-12T00:21:07.597799+0000","last_peered":"2024-09-12T00:21:07.597799+0000","last_clean":"2024-09-12T00:21:07.597799+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:21:07.597799+0000","last_undegraded":"2024-09-12T00:21:07.597799+0000","last_fullsized":"2024-09-12T00:21:07.597799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270885+0000","last_change":"2024-09-12T00:18:46.210796+0000","last_active":"2024-09-12T00:19:24.270885+0000","last_peered":"2024-09-12T00:19:24.270885+0000","last_clean":"2024-09-12T00:19:24.270885+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:19:24.270885+0000","last_undegraded":"2024-09-12T00:19:24.270885+0000","last_fullsized":"2024-09-12T00:19:24.270885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299482+0000","last_change":"2024-09-12T00:18:44.216498+0000","last_active":"2024-09-12T00:19:24.299482+0000","last_peered":"2024-09-12T00:19:24.299482+0000","last_clean":"2024-09-12T00:19:24.299482+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:19:24.299482+0000","last_undegraded":"2024-09-12T00:19:24.299482+0000","last_fullsized":"2024-09-12T00:19:24.299482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.498751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215514+0000","last_change":"2024-09-12T00:18:44.216871+0000","last_active":"2024-09-12T00:19:30.215514+0000","last_peered":"2024-09-12T00:19:30.215514+0000","last_clean":"2024-09-12T00:19:30.215514+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:19:30.215514+0000","last_undegraded":"2024-09-12T00:19:30.215514+0000","last_fullsized":"2024-09-12T00:19:30.215514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:27.835553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093904+0000","last_change":"2024-09-12T00:18:46.211819+0000","last_active":"2024-09-12T00:22:02.093904+0000","last_peered":"2024-09-12T00:22:02.093904+0000","last_clean":"2024-09-12T00:22:02.093904+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:22:02.093904+0000","last_undegraded":"2024-09-12T00:22:02.093904+0000","last_fullsized":"2024-09-12T00:22:02.093904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544559+0000","last_change":"2024-09-12T00:18:44.216737+0000","last_active":"2024-09-12T00:19:24.544559+0000","last_peered":"2024-09-12T00:19:24.544559+0000","last_clean":"2024-09-12T00:19:24.544559+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:19:24.544559+0000","last_undegraded":"2024-09-12T00:19:24.544559+0000","last_fullsized":"2024-09-12T00:19:24.544559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:29.268868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.787219+0000","last_change":"2024-09-12T00:18:46.217286+0000","last_active":"2024-09-12T00:19:31.787219+0000","last_peered":"2024-09-12T00:19:31.787219+0000","last_clean":"2024-09-12T00:19:31.787219+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:19:31.787219+0000","last_undegraded":"2024-09-12T00:19:31.787219+0000","last_fullsized":"2024-09-12T00:19:31.787219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.834988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52580,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319260,"statfs":{"total":96636764160,"available":96582922240,"internally_reserved":0,"allocated":13389824,"data_stored":13057412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44828,"kb_used_data":9484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327012,"statfs":{"total":96636764160,"available":96590860288,"internally_reserved":0,"allocated":9711616,"data_stored":9451046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705717,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":11240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":11509760,"data_stored":11224958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46404,"kb_used_data":6900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325436,"statfs":{"total":96636764160,"available":96589246464,"internally_reserved":0,"allocated":7065600,"data_stored":6764952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:22:34.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:22:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd31489d640 1 Processor -- start 2024-09-12T00:22:34.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd31489d640 1 -- start start 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd31489d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd310111890 0x7fd310132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd31489d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd310073a90 con 0x7fd310110da0 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd31489d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd3100696e0 con 0x7fd310111890 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30dd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd310111890 0x7fd310132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd310110da0 0x7fd310111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50934/0 (socket says 172.21.15.31:50934) 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30e59c640 1 -- 172.21.15.31:0/793276890 learned_addr learned my addr 172.21.15.31:0/793276890 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30dd9b640 1 -- 172.21.15.31:0/793276890 >> v1:172.21.15.31:6789/0 conn(0x7fd310110da0 legacy=0x7fd310111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30d59a640 1 -- 172.21.15.31:0/793276890 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148293591 0 0) 0x7fd310073a90 con 0x7fd310110da0 2024-09-12T00:22:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.971+0000 7fd30dd9b640 1 -- 172.21.15.31:0/793276890 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31006dd50 con 0x7fd310111890 2024-09-12T00:22:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd30dd9b640 1 --2- 172.21.15.31:0/793276890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310111890 0x7fd310132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd304009740 tx=0x7fd30401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f24dc723da1337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd30d59a640 1 -- 172.21.15.31:0/793276890 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3040b0070 con 0x7fd310111890 2024-09-12T00:22:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd30d59a640 1 -- 172.21.15.31:0/793276890 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3040ab530 con 0x7fd310111890 2024-09-12T00:22:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd30d59a640 1 -- 172.21.15.31:0/793276890 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3040ab830 con 0x7fd310111890 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- 172.21.15.31:0/793276890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310111890 msgr2=0x7fd310132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 --2- 172.21.15.31:0/793276890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310111890 0x7fd310132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd304009740 tx=0x7fd30401c370 comp rx=0 tx=0).stop 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- 172.21.15.31:0/793276890 shutdown_connections 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 --2- 172.21.15.31:0/793276890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310111890 0x7fd310132450 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- 172.21.15.31:0/793276890 >> 172.21.15.31:0/793276890 conn(0x7fd310070900 msgr2=0x7fd310072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- 172.21.15.31:0/793276890 shutdown_connections 2024-09-12T00:22:34.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- 172.21.15.31:0/793276890 wait complete. 2024-09-12T00:22:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 Processor -- start 2024-09-12T00:22:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- start start 2024-09-12T00:22:34.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.975+0000 7fd31489d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd310135330 con 0x7fd310110da0 2024-09-12T00:22:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45528/0 (socket says 172.21.15.31:45528) 2024-09-12T00:22:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30e59c640 1 -- 172.21.15.31:0/1030468791 learned_addr learned my addr 172.21.15.31:0/1030468791 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30e59c640 1 -- 172.21.15.31:0/1030468791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3101140d0 con 0x7fd310110da0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30e59c640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c3d0 tx=0x7fd30000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd300007410 con 0x7fd310110da0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3000075d0 con 0x7fd310110da0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd300004960 con 0x7fd310110da0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31012f7b0 con 0x7fd310110da0 2024-09-12T00:22:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31012fca0 con 0x7fd310110da0 2024-09-12T00:22:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd310111180 con 0x7fd310110da0 2024-09-12T00:22:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd300011070 con 0x7fd310110da0 2024-09-12T00:22:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 0x7fd2f003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fd30004f460 con 0x7fd310110da0 2024-09-12T00:22:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.979+0000 7fd30dd9b640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 0x7fd2f003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:34.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.983+0000 7fd30dd9b640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 0x7fd2f003d6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3040ad000 tx=0x7fd304008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:34.987+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd300010d50 con 0x7fd310110da0 2024-09-12T00:22:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.159+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3101275f0 con 0x7fd310110da0 2024-09-12T00:22:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd2feffd640 1 -- 172.21.15.31:0/1030468791 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+21246 (secure 0 0 0) 0x7fd300012d70 con 0x7fd310110da0 2024-09-12T00:22:35.164 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:35.164 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"fsid":"9e56bc75-e06d-484a-a616-57879b8b0bec","created":"2024-09-12T00:18:17.187257+0000","modified":"2024-09-12T00:19:24.264123+0000","last_up_change":"2024-09-12T00:18:27.505132+0000","last_in_change":"2024-09-12T00:18:18.356100+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:28.545884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:33.023201+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:18:42.154732+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:18:44.544686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:18:46.422694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:18:48.340774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:18:50.251810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:18:52.398184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65e1d3c3-176c-4471-8ee3-862fc2551683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6801","nonce":3108862692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6803","nonce":3108862692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6807","nonce":3108862692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":3108862692},{"type":"v1","addr":"172.21.15.31:6805","nonce":3108862692}]},"public_addr":"172.21.15.31:6801/3108862692","cluster_addr":"172.21.15.31:6803/3108862692","heartbeat_back_addr":"172.21.15.31:6807/3108862692","heartbeat_front_addr":"172.21.15.31:6805/3108862692","state":["exists","up"]},{"osd":1,"uuid":"a399a405-fbce-4b58-abcd-9d6deb8bc985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6809","nonce":1373122057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6811","nonce":1373122057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6815","nonce":1373122057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1373122057},{"type":"v1","addr":"172.21.15.66:6813","nonce":1373122057}]},"public_addr":"172.21.15.66:6809/1373122057","cluster_addr":"172.21.15.66:6811/1373122057","heartbeat_back_addr":"172.21.15.66:6815/1373122057","heartbeat_front_addr":"172.21.15.66:6813/1373122057","state":["exists","up"]},{"osd":2,"uuid":"dc526bb4-7a5b-4039-aa96-e5f704645a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6801","nonce":1272812173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6803","nonce":1272812173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6807","nonce":1272812173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":1272812173},{"type":"v1","addr":"172.21.15.66:6805","nonce":1272812173}]},"public_addr":"172.21.15.66:6801/1272812173","cluster_addr":"172.21.15.66:6803/1272812173","heartbeat_back_addr":"172.21.15.66:6807/1272812173","heartbeat_front_addr":"172.21.15.66:6805/1272812173","state":["exists","up"]},{"osd":3,"uuid":"964c4d70-5f2c-4c85-9767-03529a7afd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6817","nonce":2782209626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6819","nonce":2782209626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6823","nonce":2782209626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2782209626},{"type":"v1","addr":"172.21.15.66:6821","nonce":2782209626}]},"public_addr":"172.21.15.66:6817/2782209626","cluster_addr":"172.21.15.66:6819/2782209626","heartbeat_back_addr":"172.21.15.66:6823/2782209626","heartbeat_front_addr":"172.21.15.66:6821/2782209626","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.633499+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.991972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:24.986989+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:18:25.155160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":0}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]},{"pgid":"5.1f","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 msgr2=0x7fd2f003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 0x7fd2f003d6c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3040ad000 tx=0x7fd304008040 comp rx=0 tx=0).stop 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 msgr2=0x7fd3101226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c3d0 tx=0x7fd30000c890 comp rx=0 tx=0).stop 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 shutdown_connections 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd2f003b200 0x7fd2f003d6c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 --2- 172.21.15.31:0/1030468791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd310110da0 0x7fd3101226b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 >> 172.21.15.31:0/1030468791 conn(0x7fd310070900 msgr2=0x7fd310129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 shutdown_connections 2024-09-12T00:22:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:35.163+0000 7fd31489d640 1 -- 172.21.15.31:0/1030468791 wait complete. 2024-09-12T00:22:36.185 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T00:22:36.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:22:36.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed1280f640 1 Processor -- start 2024-09-12T00:22:36.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed1280f640 1 -- start start 2024-09-12T00:22:36.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed1280f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fed0c116350 0x7fed0c1344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed1280f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0c115f00 con 0x7fed0c12be40 2024-09-12T00:22:36.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed1280f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c12c930 con 0x7fed0c116350 2024-09-12T00:22:36.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fed0c12be40 0x7fed0c12c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50940/0 (socket says 172.21.15.31:50940) 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0bfff640 1 -- 172.21.15.31:0/1184991766 learned_addr learned my addr 172.21.15.31:0/1184991766 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0b7fe640 1 --2- 172.21.15.31:0/1184991766 >> v2:172.21.15.31:3300/0 conn(0x7fed0c116350 0x7fed0c1344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0affd640 1 -- 172.21.15.31:0/1184991766 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742425735 0 0) 0x7fed0c115f00 con 0x7fed0c12be40 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0affd640 1 -- 172.21.15.31:0/1184991766 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf8003530 con 0x7fed0c12be40 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0b7fe640 1 -- 172.21.15.31:0/1184991766 >> v1:172.21.15.31:6789/0 conn(0x7fed0c12be40 legacy=0x7fed0c12c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.327+0000 7fed0b7fe640 1 -- 172.21.15.31:0/1184991766 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c116ac0 con 0x7fed0c116350 2024-09-12T00:22:36.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed0b7fe640 1 --2- 172.21.15.31:0/1184991766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1344e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009740 tx=0x7fecf401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c224c4406f10d221 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed0affd640 1 -- 172.21.15.31:0/1184991766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40b0070 con 0x7fed0c116350 2024-09-12T00:22:36.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed0affd640 1 -- 172.21.15.31:0/1184991766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40ab530 con 0x7fed0c116350 2024-09-12T00:22:36.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed0affd640 1 -- 172.21.15.31:0/1184991766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40ab830 con 0x7fed0c116350 2024-09-12T00:22:36.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 -- 172.21.15.31:0/1184991766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 msgr2=0x7fed0c1344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 --2- 172.21.15.31:0/1184991766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1344e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009740 tx=0x7fecf401c370 comp rx=0 tx=0).stop 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 -- 172.21.15.31:0/1184991766 shutdown_connections 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 --2- 172.21.15.31:0/1184991766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1344e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 -- 172.21.15.31:0/1184991766 >> 172.21.15.31:0/1184991766 conn(0x7fed0c06fb10 msgr2=0x7fed0c071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 -- 172.21.15.31:0/1184991766 shutdown_connections 2024-09-12T00:22:36.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.331+0000 7fed1280f640 1 -- 172.21.15.31:0/1184991766 wait complete. 2024-09-12T00:22:36.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 Processor -- start 2024-09-12T00:22:36.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 -- start start 2024-09-12T00:22:36.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c1375d0 con 0x7fed0c116350 2024-09-12T00:22:36.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45536/0 (socket says 172.21.15.31:45536) 2024-09-12T00:22:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0bfff640 1 -- 172.21.15.31:0/3464448374 learned_addr learned my addr 172.21.15.31:0/3464448374 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0bfff640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c117b10 con 0x7fed0c116350 2024-09-12T00:22:36.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0bfff640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c450 tx=0x7fed0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04017070 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed04005ce0 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04007200 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c118480 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c1c7080 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed0c1298b0 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed0401a070 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 0x7fecec03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fed0404eae0 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 0x7fecec049b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed04014ec0 con 0x7fecec0476b0 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fed040532a0 con 0x7fed0c116350 2024-09-12T00:22:36.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed10dac640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 0x7fecec049b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed0b7fe640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 0x7fecec03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.335+0000 7fed10dac640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 0x7fecec049b50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.339+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== osd.0 v2:172.21.15.31:6800/3108862692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed04014ec0 con 0x7fecec0476b0 2024-09-12T00:22:36.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.339+0000 7fed0b7fe640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 0x7fecec03d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ad000 tx=0x7fecf4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 --> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed0c1337e0 con 0x7fecec0476b0 2024-09-12T00:22:36.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed08ff9640 1 -- 172.21.15.31:0/3464448374 <== osd.0 v2:172.21.15.31:6800/3108862692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed0c1337e0 con 0x7fecec0476b0 2024-09-12T00:22:36.353 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-12T00:22:36.353 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:22:36.353 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-12T00:22:36.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 msgr2=0x7fecec049b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 0x7fecec049b50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 msgr2=0x7fecec03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 0x7fecec03d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ad000 tx=0x7fecf4008040 comp rx=0 tx=0).stop 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 msgr2=0x7fed0c1c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c450 tx=0x7fed0400c910 comp rx=0 tx=0).stop 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 shutdown_connections 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:6800/3108862692,v1:172.21.15.31:6801/3108862692] conn(0x7fecec0476b0 0x7fecec049b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fecec03b1d0 0x7fecec03d690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 --2- 172.21.15.31:0/3464448374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0c116350 0x7fed0c1c6970 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 >> 172.21.15.31:0/3464448374 conn(0x7fed0c06fb10 msgr2=0x7fed0c126500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 shutdown_connections 2024-09-12T00:22:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.351+0000 7fed1280f640 1 -- 172.21.15.31:0/3464448374 wait complete. 2024-09-12T00:22:36.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T00:22:36.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c98901640 1 Processor -- start 2024-09-12T00:22:36.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c98901640 1 -- start start 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c98901640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c9412bc10 0x7f8c9412bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c98901640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c94073830 con 0x7f8c9412c530 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c98901640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8c94071eb0 con 0x7f8c9412bc10 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c9259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c9412bc10 0x7f8c9412bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c91d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8c9412c530 0x7f8c9412ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50952/0 (socket says 172.21.15.31:50952) 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c91d9b640 1 -- 172.21.15.31:0/260587047 learned_addr learned my addr 172.21.15.31:0/260587047 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:36.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c9259c640 1 -- 172.21.15.31:0/260587047 >> v1:172.21.15.31:6789/0 conn(0x7f8c9412c530 legacy=0x7f8c9412ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c9259c640 1 -- 172.21.15.31:0/260587047 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c940a30b0 con 0x7f8c9412bc10 2024-09-12T00:22:36.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.483+0000 7f8c9159a640 1 -- 172.21.15.31:0/260587047 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191538095 0 0) 0x7f8c94073830 con 0x7f8c9412c530 2024-09-12T00:22:36.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9259c640 1 --2- 172.21.15.31:0/260587047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c9412bff0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009740 tx=0x7f8c8401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1351e1927c4e54f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9159a640 1 -- 172.21.15.31:0/260587047 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840b0070 con 0x7f8c9412bc10 2024-09-12T00:22:36.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9159a640 1 -- 172.21.15.31:0/260587047 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c840ab530 con 0x7f8c9412bc10 2024-09-12T00:22:36.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9159a640 1 -- 172.21.15.31:0/260587047 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840ab830 con 0x7f8c9412bc10 2024-09-12T00:22:36.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- 172.21.15.31:0/260587047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 msgr2=0x7f8c9412bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 --2- 172.21.15.31:0/260587047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c9412bff0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009740 tx=0x7f8c8401c370 comp rx=0 tx=0).stop 2024-09-12T00:22:36.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- 172.21.15.31:0/260587047 shutdown_connections 2024-09-12T00:22:36.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 --2- 172.21.15.31:0/260587047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c9412bff0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- 172.21.15.31:0/260587047 >> 172.21.15.31:0/260587047 conn(0x7f8c940a0a60 msgr2=0x7f8c9406e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- 172.21.15.31:0/260587047 shutdown_connections 2024-09-12T00:22:36.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- 172.21.15.31:0/260587047 wait complete. 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 Processor -- start 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- start start 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c98901640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94137a50 con 0x7f8c9412bc10 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45564/0 (socket says 172.21.15.31:45564) 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9259c640 1 -- 172.21.15.31:0/3930454831 learned_addr learned my addr 172.21.15.31:0/3930454831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:36.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.487+0000 7f8c9259c640 1 -- 172.21.15.31:0/3930454831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9412d810 con 0x7f8c9412bc10 2024-09-12T00:22:36.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c9259c640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8c84019fa0 tx=0x7f8c8401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840b0050 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c840b1040 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840b5740 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9411c100 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9411c790 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8c840be030 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9412bff0 con 0x7f8c9412bc10 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 0x7f8c7403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f8c840bc070 con 0x7f8c9412bc10 2024-09-12T00:22:36.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c91d9b640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 0x7f8c7403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.491+0000 7f8c91d9b640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 0x7f8c7403d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c88007fd0 tx=0x7f8c88007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.495+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8c840c5020 con 0x7f8c9412bc10 2024-09-12T00:22:36.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T00:22:36.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.663+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8c9411c4b0 con 0x7f8c7403b1d0 2024-09-12T00:22:36.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.663+0000 7f8c82ffd640 1 -- 172.21.15.31:0/3930454831 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8c9411c4b0 con 0x7f8c7403b1d0 2024-09-12T00:22:36.666 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 msgr2=0x7f8c7403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 0x7f8c7403d690 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c88007fd0 tx=0x7f8c88007900 comp rx=0 tx=0).stop 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 msgr2=0x7f8c94129950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8c84019fa0 tx=0x7f8c8401abb0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 shutdown_connections 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f8c7403b1d0 0x7f8c7403d690 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 --2- 172.21.15.31:0/3930454831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c9412bc10 0x7f8c94129950 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 >> 172.21.15.31:0/3930454831 conn(0x7f8c940a0a60 msgr2=0x7f8c940a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 shutdown_connections 2024-09-12T00:22:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.667+0000 7f8c98901640 1 -- 172.21.15.31:0/3930454831 wait complete. 2024-09-12T00:22:36.685 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T00:22:36.685 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:22:36.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.799+0000 7f8288fd4640 1 Processor -- start 2024-09-12T00:22:36.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8288fd4640 1 -- start start 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8288fd4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8284129a20 0x7f8284129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8288fd4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828412a930 con 0x7f828412a4f0 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8288fd4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8284069170 con 0x7f8284129a20 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828259c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8284129a20 0x7f8284129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8281d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f828412a4f0 0x7f828412cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50968/0 (socket says 172.21.15.31:50968) 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f8281d9b640 1 -- 172.21.15.31:0/3823390406 learned_addr learned my addr 172.21.15.31:0/3823390406 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828259c640 1 -- 172.21.15.31:0/3823390406 >> v1:172.21.15.31:6789/0 conn(0x7f828412a4f0 legacy=0x7f828412cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828259c640 1 -- 172.21.15.31:0/3823390406 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284114950 con 0x7f8284129a20 2024-09-12T00:22:36.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828259c640 1 --2- 172.21.15.31:0/3823390406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284129fb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f827c009d90 tx=0x7f827c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f7b068aee1d23c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828159a640 1 -- 172.21.15.31:0/3823390406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c0b2070 con 0x7f8284129a20 2024-09-12T00:22:36.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828159a640 1 -- 172.21.15.31:0/3823390406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c0a5660 con 0x7f8284129a20 2024-09-12T00:22:36.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.803+0000 7f828159a640 1 -- 172.21.15.31:0/3823390406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c0a5960 con 0x7f8284129a20 2024-09-12T00:22:36.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/3823390406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 msgr2=0x7f8284129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 --2- 172.21.15.31:0/3823390406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284129fb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f827c009d90 tx=0x7f827c01c8c0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/3823390406 shutdown_connections 2024-09-12T00:22:36.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 --2- 172.21.15.31:0/3823390406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284129fb0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/3823390406 >> 172.21.15.31:0/3823390406 conn(0x7f8284070d70 msgr2=0x7f8284073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/3823390406 shutdown_connections 2024-09-12T00:22:36.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/3823390406 wait complete. 2024-09-12T00:22:36.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 Processor -- start 2024-09-12T00:22:36.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- start start 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8284135ce0 con 0x7f8284129a20 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f828259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f828259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45588/0 (socket says 172.21.15.31:45588) 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f828259c640 1 -- 172.21.15.31:0/2564802127 learned_addr learned my addr 172.21.15.31:0/2564802127 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:36.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f828259c640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284132920 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f828259c640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f827c0a5630 tx=0x7f827c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c0bd020 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c0ad770 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8284112ec0 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f827c0b2040 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8284123db0 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8284129fb0 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f827c0c0020 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 0x7f826803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f827c0ea8e0 con 0x7f8284129a20 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 0x7f8268049b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f827c00ae60 con 0x7f82680476e0 2024-09-12T00:22:36.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f827c0ef2a0 con 0x7f8284129a20 2024-09-12T00:22:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8281d9b640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 0x7f826803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.807+0000 7f8282d9d640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 0x7f8268049b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.811+0000 7f8282d9d640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 0x7f8268049b80 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.811+0000 7f8281d9b640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 0x7f826803d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f826c001670 tx=0x7f826c007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.811+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== osd.1 v2:172.21.15.66:6808/1373122057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f827c00ae60 con 0x7f82680476e0 2024-09-12T00:22:36.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.823+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 --> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82841130f0 con 0x7f82680476e0 2024-09-12T00:22:36.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f827affd640 1 -- 172.21.15.31:0/2564802127 <== osd.1 v2:172.21.15.66:6808/1373122057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8274009870 con 0x7f82680476e0 2024-09-12T00:22:36.828 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-12T00:22:36.828 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:22:36.828 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 msgr2=0x7f8268049b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 0x7f8268049b80 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 msgr2=0x7f826803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 0x7f826803d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f826c001670 tx=0x7f826c007ad0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 msgr2=0x7f8284123870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f827c0a5630 tx=0x7f827c019660 comp rx=0 tx=0).stop 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 shutdown_connections 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6808/1373122057,v1:172.21.15.66:6809/1373122057] conn(0x7f82680476e0 0x7f8268049b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f826803b200 0x7f826803d6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 --2- 172.21.15.31:0/2564802127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8284129a20 0x7f8284123870 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 >> 172.21.15.31:0/2564802127 conn(0x7f8284070d70 msgr2=0x7f8284127ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 shutdown_connections 2024-09-12T00:22:36.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.827+0000 7f8288fd4640 1 -- 172.21.15.31:0/2564802127 wait complete. 2024-09-12T00:22:36.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T00:22:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.955+0000 7f006f762640 1 Processor -- start 2024-09-12T00:22:36.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.955+0000 7f006f762640 1 -- start start 2024-09-12T00:22:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0068132540 0x7f0068134930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0068111f60 con 0x7f00681259f0 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0068073bd0 con 0x7f0068132540 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006ccfd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0068132540 0x7f0068134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006d4fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f00681259f0 0x7f0068125dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50978/0 (socket says 172.21.15.31:50978) 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006d4fe640 1 -- 172.21.15.31:0/2201674632 learned_addr learned my addr 172.21.15.31:0/2201674632 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006ccfd640 1 -- 172.21.15.31:0/2201674632 >> v1:172.21.15.31:6789/0 conn(0x7f00681259f0 legacy=0x7f0068125dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006ccfd640 1 -- 172.21.15.31:0/2201674632 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00681121a0 con 0x7f0068132540 2024-09-12T00:22:36.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f005ffff640 1 -- 172.21.15.31:0/2201674632 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258969907 0 0) 0x7f0064001120 con 0x7f00681259f0 2024-09-12T00:22:36.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006ccfd640 1 --2- 172.21.15.31:0/2201674632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0068132540 0x7f0068134930 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0058009740 tx=0x7f005801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c118e8079004745 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f005ffff640 1 -- 172.21.15.31:0/2201674632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00580b0070 con 0x7f0068132540 2024-09-12T00:22:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f005ffff640 1 -- 172.21.15.31:0/2201674632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00580ab530 con 0x7f0068132540 2024-09-12T00:22:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f005ffff640 1 -- 172.21.15.31:0/2201674632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00580ab830 con 0x7f0068132540 2024-09-12T00:22:36.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- 172.21.15.31:0/2201674632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0068132540 msgr2=0x7f0068134930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 --2- 172.21.15.31:0/2201674632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0068132540 0x7f0068134930 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0058009740 tx=0x7f005801c370 comp rx=0 tx=0).stop 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- 172.21.15.31:0/2201674632 shutdown_connections 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 --2- 172.21.15.31:0/2201674632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0068132540 0x7f0068134930 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- 172.21.15.31:0/2201674632 >> 172.21.15.31:0/2201674632 conn(0x7f00680709b0 msgr2=0x7f0068072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- 172.21.15.31:0/2201674632 shutdown_connections 2024-09-12T00:22:36.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.959+0000 7f006f762640 1 -- 172.21.15.31:0/2201674632 wait complete. 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 Processor -- start 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 -- start start 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0068137a20 con 0x7f00681259f0 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006d4fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006d4fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45608/0 (socket says 172.21.15.31:45608) 2024-09-12T00:22:36.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006d4fe640 1 -- 172.21.15.31:0/889434571 learned_addr learned my addr 172.21.15.31:0/889434571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006d4fe640 1 -- 172.21.15.31:0/889434571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006812dde0 con 0x7f00681259f0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006d4fe640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f006400c6b0 tx=0x7f006400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0064018070 con 0x7f00681259f0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0064007e30 con 0x7f00681259f0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0064007200 con 0x7f00681259f0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006812e270 con 0x7f00681259f0 2024-09-12T00:22:36.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0068128110 con 0x7f00681259f0 2024-09-12T00:22:36.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0068128fe0 con 0x7f00681259f0 2024-09-12T00:22:36.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f006401b070 con 0x7f00681259f0 2024-09-12T00:22:36.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 0x7f004c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:36.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.963+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f006404eaa0 con 0x7f00681259f0 2024-09-12T00:22:36.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.967+0000 7f006ccfd640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 0x7f004c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:36.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.967+0000 7f006ccfd640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 0x7f004c03d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f00580ad000 tx=0x7f0058008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:36.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:36.971+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0068111f60 con 0x7f00681259f0 2024-09-12T00:22:37.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.139+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0068129920 con 0x7f004c03b200 2024-09-12T00:22:37.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.139+0000 7f005dffb640 1 -- 172.21.15.31:0/889434571 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0068129920 con 0x7f004c03b200 2024-09-12T00:22:37.142 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T00:22:37.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 msgr2=0x7f004c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 0x7f004c03d6c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f00580ad000 tx=0x7f0058008040 comp rx=0 tx=0).stop 2024-09-12T00:22:37.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 msgr2=0x7f0068127a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f006400c6b0 tx=0x7f006400cb70 comp rx=0 tx=0).stop 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 shutdown_connections 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f004c03b200 0x7f004c03d6c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 --2- 172.21.15.31:0/889434571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00681259f0 0x7f0068127a00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 >> 172.21.15.31:0/889434571 conn(0x7f00680709b0 msgr2=0x7f006812a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 shutdown_connections 2024-09-12T00:22:37.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.143+0000 7f006f762640 1 -- 172.21.15.31:0/889434571 wait complete. 2024-09-12T00:22:37.160 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T00:22:37.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:22:37.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d37dcf640 1 Processor -- start 2024-09-12T00:22:37.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d37dcf640 1 -- start start 2024-09-12T00:22:37.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d37dcf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d30130340 0x7f0d30130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d37dcf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d30130120 con 0x7f0d30130c60 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d37dcf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3009d5d0 con 0x7f0d30130340 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d3536a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0d30130c60 0x7f0d30133570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50982/0 (socket says 172.21.15.31:50982) 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d3536a640 1 -- 172.21.15.31:0/3754866024 learned_addr learned my addr 172.21.15.31:0/3754866024 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d35b6b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0d30130340 0x7f0d30130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d34b69640 1 -- 172.21.15.31:0/3754866024 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117024302 0 0) 0x7f0d30130120 con 0x7f0d30130c60 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d34b69640 1 -- 172.21.15.31:0/3754866024 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d1c003530 con 0x7f0d30130c60 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d35b6b640 1 -- 172.21.15.31:0/3754866024 >> v1:172.21.15.31:6789/0 conn(0x7f0d30130c60 legacy=0x7f0d30133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.275+0000 7f0d35b6b640 1 -- 172.21.15.31:0/3754866024 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3009c3c0 con 0x7f0d30130340 2024-09-12T00:22:37.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 --2- 172.21.15.31:0/3754866024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d30130720 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009740 tx=0x7f0d2401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f848c5e3026b9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d34b69640 1 -- 172.21.15.31:0/3754866024 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d240b0070 con 0x7f0d30130340 2024-09-12T00:22:37.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d34b69640 1 -- 172.21.15.31:0/3754866024 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240ab530 con 0x7f0d30130340 2024-09-12T00:22:37.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d34b69640 1 -- 172.21.15.31:0/3754866024 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d240ab810 con 0x7f0d30130340 2024-09-12T00:22:37.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3754866024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 msgr2=0x7f0d30130720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3754866024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d30130720 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009740 tx=0x7f0d2401c400 comp rx=0 tx=0).stop 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3754866024 shutdown_connections 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3754866024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d30130720 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3754866024 >> 172.21.15.31:0/3754866024 conn(0x7f0d30071600 msgr2=0x7f0d3009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3754866024 shutdown_connections 2024-09-12T00:22:37.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3754866024 wait complete. 2024-09-12T00:22:37.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 Processor -- start 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- start start 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3013ba90 con 0x7f0d30130340 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45622/0 (socket says 172.21.15.31:45622) 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 -- 172.21.15.31:0/3284841528 learned_addr learned my addr 172.21.15.31:0/3284841528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301205b0 con 0x7f0d30130340 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d35b6b640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0d24019010 tx=0x7f0d240191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d240b9070 con 0x7f0d30130340 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d240ab810 con 0x7f0d30130340 2024-09-12T00:22:37.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d240b0040 con 0x7f0d30130340 2024-09-12T00:22:37.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d301216c0 con 0x7f0d30130340 2024-09-12T00:22:37.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.279+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3012f1b0 con 0x7f0d30130340 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d30130720 con 0x7f0d30130340 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0d240bc070 con 0x7f0d30130340 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 0x7f0d1403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f0d240e99e0 con 0x7f0d30130340 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 0x7f0d14049af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d240c4ec0 con 0x7f0d14047650 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0d240ee2a0 con 0x7f0d30130340 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d3536a640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 0x7f0d1403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d3636c640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 0x7f0d14049af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d3536a640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 0x7f0d1403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c005c10 tx=0x7f0d2c001720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d3636c640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 0x7f0d14049af0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.283+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== osd.2 v2:172.21.15.66:6800/1272812173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d240c4ec0 con 0x7f0d14047650 2024-09-12T00:22:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 --> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d300a0e60 con 0x7f0d14047650 2024-09-12T00:22:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d227fc640 1 -- 172.21.15.31:0/3284841528 <== osd.2 v2:172.21.15.66:6800/1272812173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d300a0e60 con 0x7f0d14047650 2024-09-12T00:22:37.301 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-12T00:22:37.301 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:22:37.301 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-12T00:22:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 msgr2=0x7f0d14049af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 0x7f0d14049af0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 msgr2=0x7f0d1403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 0x7f0d1403d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c005c10 tx=0x7f0d2c001720 comp rx=0 tx=0).stop 2024-09-12T00:22:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 msgr2=0x7f0d3012eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0d24019010 tx=0x7f0d240191a0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 shutdown_connections 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6800/1272812173,v1:172.21.15.66:6801/1272812173] conn(0x7f0d14047650 0x7f0d14049af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f0d1403b1d0 0x7f0d1403d690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 --2- 172.21.15.31:0/3284841528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30130340 0x7f0d3012eaa0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 >> 172.21.15.31:0/3284841528 conn(0x7f0d30071600 msgr2=0x7f0d3009f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 shutdown_connections 2024-09-12T00:22:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.299+0000 7f0d37dcf640 1 -- 172.21.15.31:0/3284841528 wait complete. 2024-09-12T00:22:37.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T00:22:37.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe14418c640 1 Processor -- start 2024-09-12T00:22:37.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe14418c640 1 -- start start 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe14418c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe13c12cf30 0x7fe13c12d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe14418c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c09ddc0 con 0x7fe13c12d850 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe14418c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c09e520 con 0x7fe13c12cf30 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe141f28640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe13c12cf30 0x7fe13c12d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe141727640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe13c12d850 0x7fe13c1267f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50984/0 (socket says 172.21.15.31:50984) 2024-09-12T00:22:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe141727640 1 -- 172.21.15.31:0/1182646222 learned_addr learned my addr 172.21.15.31:0/1182646222 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe141f28640 1 -- 172.21.15.31:0/1182646222 >> v1:172.21.15.31:6789/0 conn(0x7fe13c12d850 legacy=0x7fe13c1267f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe141f28640 1 -- 172.21.15.31:0/1182646222 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c09f740 con 0x7fe13c12cf30 2024-09-12T00:22:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.419+0000 7fe140f26640 1 -- 172.21.15.31:0/1182646222 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680026043 0 0) 0x7fe13c09ddc0 con 0x7fe13c12d850 2024-09-12T00:22:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 --2- 172.21.15.31:0/1182646222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c12d310 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe138009740 tx=0x7fe13801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff504950e2bd7c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe140f26640 1 -- 172.21.15.31:0/1182646222 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380b0070 con 0x7fe13c12cf30 2024-09-12T00:22:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe140f26640 1 -- 172.21.15.31:0/1182646222 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380ab530 con 0x7fe13c12cf30 2024-09-12T00:22:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe140f26640 1 -- 172.21.15.31:0/1182646222 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380ab830 con 0x7fe13c12cf30 2024-09-12T00:22:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/1182646222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 msgr2=0x7fe13c12d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 --2- 172.21.15.31:0/1182646222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c12d310 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe138009740 tx=0x7fe13801c2e0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/1182646222 shutdown_connections 2024-09-12T00:22:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 --2- 172.21.15.31:0/1182646222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c12d310 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/1182646222 >> 172.21.15.31:0/1182646222 conn(0x7fe13c071e50 msgr2=0x7fe13c072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/1182646222 shutdown_connections 2024-09-12T00:22:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/1182646222 wait complete. 2024-09-12T00:22:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 Processor -- start 2024-09-12T00:22:37.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- start start 2024-09-12T00:22:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c1354e0 con 0x7fe13c12cf30 2024-09-12T00:22:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45636/0 (socket says 172.21.15.31:45636) 2024-09-12T00:22:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 -- 172.21.15.31:0/3949270067 learned_addr learned my addr 172.21.15.31:0/3949270067 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 -- 172.21.15.31:0/3949270067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c127800 con 0x7fe13c12cf30 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe141f28640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe138019f10 tx=0x7fe13801ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380b0050 con 0x7fe13c12cf30 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380b1040 con 0x7fe13c12cf30 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380b5740 con 0x7fe13c12cf30 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c11acb0 con 0x7fe13c12cf30 2024-09-12T00:22:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.423+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c132850 con 0x7fe13c12cf30 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c12d310 con 0x7fe13c12cf30 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe1380be030 con 0x7fe13c12cf30 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe1327fc640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 0x7fe12003d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fe1380bc070 con 0x7fe13c12cf30 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe141727640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 0x7fe12003d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.427+0000 7fe141727640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 0x7fe12003d710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007fd0 tx=0x7fe12c007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.431+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe1380c5020 con 0x7fe13c12cf30 2024-09-12T00:22:37.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.599+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe13c09ec50 con 0x7fe12003b250 2024-09-12T00:22:37.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.599+0000 7fe1327fc640 1 -- 172.21.15.31:0/3949270067 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe13c09ec50 con 0x7fe12003b250 2024-09-12T00:22:37.602 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 msgr2=0x7fe12003d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 0x7fe12003d710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe12c007fd0 tx=0x7fe12c007900 comp rx=0 tx=0).stop 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 msgr2=0x7fe13c1c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe138019f10 tx=0x7fe13801ab20 comp rx=0 tx=0).stop 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 shutdown_connections 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fe12003b250 0x7fe12003d710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 --2- 172.21.15.31:0/3949270067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe13c12cf30 0x7fe13c1c6c10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 >> 172.21.15.31:0/3949270067 conn(0x7fe13c071e50 msgr2=0x7fe13c12ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 shutdown_connections 2024-09-12T00:22:37.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.603+0000 7fe14418c640 1 -- 172.21.15.31:0/3949270067 wait complete. 2024-09-12T00:22:37.621 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T00:22:37.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:22:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae7185640 1 Processor -- start 2024-09-12T00:22:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae7185640 1 -- start start 2024-09-12T00:22:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae7185640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdae0129a20 0x7fdae0129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae7185640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdae012a930 con 0x7fdae012a4f0 2024-09-12T00:22:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae7185640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdae0069170 con 0x7fdae0129a20 2024-09-12T00:22:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae4f21640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdae0129a20 0x7fdae0129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdadffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdae012a4f0 0x7fdae012cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50992/0 (socket says 172.21.15.31:50992) 2024-09-12T00:22:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdadffff640 1 -- 172.21.15.31:0/2064619476 learned_addr learned my addr 172.21.15.31:0/2064619476 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdadf7fe640 1 -- 172.21.15.31:0/2064619476 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462710069 0 0) 0x7fdad4001120 con 0x7fdae012a4f0 2024-09-12T00:22:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae4f21640 1 -- 172.21.15.31:0/2064619476 >> v1:172.21.15.31:6789/0 conn(0x7fdae012a4f0 legacy=0x7fdae012cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.743+0000 7fdae4f21640 1 -- 172.21.15.31:0/2064619476 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae0114950 con 0x7fdae0129a20 2024-09-12T00:22:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae4f21640 1 --2- 172.21.15.31:0/2064619476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0129fb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009740 tx=0x7fdad001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d075c62d0677b653 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdadf7fe640 1 -- 172.21.15.31:0/2064619476 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad00b0070 con 0x7fdae0129a20 2024-09-12T00:22:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdadf7fe640 1 -- 172.21.15.31:0/2064619476 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad00ab530 con 0x7fdae0129a20 2024-09-12T00:22:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdadf7fe640 1 -- 172.21.15.31:0/2064619476 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad00ab830 con 0x7fdae0129a20 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- 172.21.15.31:0/2064619476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 msgr2=0x7fdae0129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 --2- 172.21.15.31:0/2064619476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0129fb0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009740 tx=0x7fdad001c370 comp rx=0 tx=0).stop 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- 172.21.15.31:0/2064619476 shutdown_connections 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 --2- 172.21.15.31:0/2064619476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0129fb0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- 172.21.15.31:0/2064619476 >> 172.21.15.31:0/2064619476 conn(0x7fdae0070d70 msgr2=0x7fdae0073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- 172.21.15.31:0/2064619476 shutdown_connections 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- 172.21.15.31:0/2064619476 wait complete. 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 Processor -- start 2024-09-12T00:22:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- start start 2024-09-12T00:22:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae7185640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0135ce0 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae4f21640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae4f21640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45656/0 (socket says 172.21.15.31:45656) 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.747+0000 7fdae4f21640 1 -- 172.21.15.31:0/1850937689 learned_addr learned my addr 172.21.15.31:0/1850937689 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae4f21640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae0117220 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae4f21640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdad00ae040 tx=0x7fdad001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad00b0050 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdad00b1040 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae0117ae0 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdad00b58b0 con 0x7fdae0129a20 2024-09-12T00:22:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae0115b40 con 0x7fdae0129a20 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdae0118250 con 0x7fdae0129a20 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdad00be030 con 0x7fdae0129a20 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 0x7fdacc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fdad00bc070 con 0x7fdae0129a20 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 0x7fdacc049ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdad00ade90 con 0x7fdacc047700 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdad00ee2a0 con 0x7fdae0129a20 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadffff640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 0x7fdacc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae5722640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 0x7fdacc049ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdae5722640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 0x7fdacc049ba0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.751+0000 7fdadffff640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 0x7fdacc03d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c10 tx=0x7fdad4001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.755+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== osd.3 v2:172.21.15.66:6816/2782209626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdad00ade90 con 0x7fdacc047700 2024-09-12T00:22:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 --> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdae0129fb0 con 0x7fdacc047700 2024-09-12T00:22:37.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdadd7fa640 1 -- 172.21.15.31:0/1850937689 <== osd.3 v2:172.21.15.66:6816/2782209626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdae0129fb0 con 0x7fdacc047700 2024-09-12T00:22:37.770 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-12T00:22:37.771 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:22:37.771 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 msgr2=0x7fdacc049ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 0x7fdacc049ba0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 msgr2=0x7fdacc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 0x7fdacc03d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c10 tx=0x7fdad4001260 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 msgr2=0x7fdae0115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdad00ae040 tx=0x7fdad001abb0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 shutdown_connections 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6816/2782209626,v1:172.21.15.66:6817/2782209626] conn(0x7fdacc047700 0x7fdacc049ba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fdacc03b1d0 0x7fdacc03d690 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 --2- 172.21.15.31:0/1850937689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae0129a20 0x7fdae0115430 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 >> 172.21.15.31:0/1850937689 conn(0x7fdae0070d70 msgr2=0x7fdae0128a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 shutdown_connections 2024-09-12T00:22:37.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.767+0000 7fdae7185640 1 -- 172.21.15.31:0/1850937689 wait complete. 2024-09-12T00:22:37.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T00:22:37.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc9e4c640 1 Processor -- start 2024-09-12T00:22:37.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc9e4c640 1 -- start start 2024-09-12T00:22:37.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc9e4c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dc412f160 0x7f3dc4131550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc9e4c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dc406dcb0 con 0x7f3dc412c1b0 2024-09-12T00:22:37.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc9e4c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc412bdf0 con 0x7f3dc412f160 2024-09-12T00:22:37.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dc412f160 0x7f3dc4131550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3dc412c1b0 0x7f3dc412c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50996/0 (socket says 172.21.15.31:50996) 2024-09-12T00:22:37.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc37fe640 1 -- 172.21.15.31:0/2886588235 learned_addr learned my addr 172.21.15.31:0/2886588235 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:37.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc2ffd640 1 -- 172.21.15.31:0/2886588235 >> v1:172.21.15.31:6789/0 conn(0x7f3dc412c1b0 legacy=0x7f3dc412c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc2ffd640 1 -- 172.21.15.31:0/2886588235 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc4073ad0 con 0x7f3dc412f160 2024-09-12T00:22:37.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc2ffd640 1 --2- 172.21.15.31:0/2886588235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412f160 0x7f3dc4131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009d90 tx=0x7f3db401c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1babe7f7f76553b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc27fc640 1 -- 172.21.15.31:0/2886588235 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3db40ad070 con 0x7f3dc412f160 2024-09-12T00:22:37.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc27fc640 1 -- 172.21.15.31:0/2886588235 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db40a9550 con 0x7f3dc412f160 2024-09-12T00:22:37.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.903+0000 7f3dc27fc640 1 -- 172.21.15.31:0/2886588235 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3db40a9850 con 0x7f3dc412f160 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/2886588235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412f160 msgr2=0x7f3dc4131550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/2886588235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412f160 0x7f3dc4131550 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009d90 tx=0x7f3db401c750 comp rx=0 tx=0).stop 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/2886588235 shutdown_connections 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/2886588235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412f160 0x7f3dc4131550 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/2886588235 >> 172.21.15.31:0/2886588235 conn(0x7f3dc4070940 msgr2=0x7f3dc4072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:37.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/2886588235 shutdown_connections 2024-09-12T00:22:37.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/2886588235 wait complete. 2024-09-12T00:22:37.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 Processor -- start 2024-09-12T00:22:37.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- start start 2024-09-12T00:22:37.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4134640 con 0x7f3dc412c1b0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45676/0 (socket says 172.21.15.31:45676) 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc37fe640 1 -- 172.21.15.31:0/1804652163 learned_addr learned my addr 172.21.15.31:0/1804652163 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc37fe640 1 -- 172.21.15.31:0/1804652163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc4115f60 con 0x7f3dc412c1b0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc37fe640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c600 tx=0x7f3db800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3db8018070 con 0x7f3dc412c1b0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db8007430 con 0x7f3dc412c1b0 2024-09-12T00:22:37.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3db80047f0 con 0x7f3dc412c1b0 2024-09-12T00:22:37.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc4125980 con 0x7f3dc412c1b0 2024-09-12T00:22:37.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41167c0 con 0x7f3dc412c1b0 2024-09-12T00:22:37.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc412c590 con 0x7f3dc412c1b0 2024-09-12T00:22:37.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3db801b070 con 0x7f3dc412c1b0 2024-09-12T00:22:37.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 0x7f3db003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:37.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.907+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f3db804ed00 con 0x7f3dc412c1b0 2024-09-12T00:22:37.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.911+0000 7f3dc2ffd640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 0x7f3db003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:37.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.911+0000 7f3dc2ffd640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 0x7f3db003d6c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3db40af000 tx=0x7f3db40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:37.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:37.915+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3db800add0 con 0x7f3dc412c1b0 2024-09-12T00:22:38.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.075+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3dc41162d0 con 0x7f3db003b200 2024-09-12T00:22:38.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dabfff640 1 -- 172.21.15.31:0/1804652163 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3dc41162d0 con 0x7f3db003b200 2024-09-12T00:22:38.081 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T00:22:38.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 msgr2=0x7f3db003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 0x7f3db003d6c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3db40af000 tx=0x7f3db40a7000 comp rx=0 tx=0).stop 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 msgr2=0x7f3dc4121da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c600 tx=0x7f3db800cac0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 shutdown_connections 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f3db003b200 0x7f3db003d6c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 --2- 172.21.15.31:0/1804652163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dc412c1b0 0x7f3dc4121da0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 >> 172.21.15.31:0/1804652163 conn(0x7f3dc4070940 msgr2=0x7f3dc412fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 shutdown_connections 2024-09-12T00:22:38.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.079+0000 7f3dc9e4c640 1 -- 172.21.15.31:0/1804652163 wait complete. 2024-09-12T00:22:38.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:22:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd918fc0640 1 Processor -- start 2024-09-12T00:22:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd918fc0640 1 -- start start 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd918fc0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd914111890 0x7fd914132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd918fc0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914073a90 con 0x7fd914110da0 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd918fc0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd9140696e0 con 0x7fd914111890 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd911d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd914111890 0x7fd914132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd91259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd914110da0 0x7fd914111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51008/0 (socket says 172.21.15.31:51008) 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd911d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd914111890 0x7fd914132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45684/0 (socket says 172.21.15.31:45684) 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd91259c640 1 -- 172.21.15.31:0/3827493853 learned_addr learned my addr 172.21.15.31:0/3827493853 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd911d9b640 1 -- 172.21.15.31:0/3827493853 >> v1:172.21.15.31:6789/0 conn(0x7fd914110da0 legacy=0x7fd914111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd911d9b640 1 -- 172.21.15.31:0/3827493853 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91406dd50 con 0x7fd914111890 2024-09-12T00:22:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd911d9b640 1 --2- 172.21.15.31:0/3827493853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914111890 0x7fd914132450 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd908009740 tx=0x7fd90801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef70e75ffd4575d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd91159a640 1 -- 172.21.15.31:0/3827493853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9080b0070 con 0x7fd914111890 2024-09-12T00:22:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd91159a640 1 -- 172.21.15.31:0/3827493853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080ab530 con 0x7fd914111890 2024-09-12T00:22:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.207+0000 7fd91159a640 1 -- 172.21.15.31:0/3827493853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9080ab830 con 0x7fd914111890 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/3827493853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914111890 msgr2=0x7fd914132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 --2- 172.21.15.31:0/3827493853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914111890 0x7fd914132450 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd908009740 tx=0x7fd90801c370 comp rx=0 tx=0).stop 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/3827493853 shutdown_connections 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 --2- 172.21.15.31:0/3827493853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914111890 0x7fd914132450 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/3827493853 >> 172.21.15.31:0/3827493853 conn(0x7fd914070900 msgr2=0x7fd914072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/3827493853 shutdown_connections 2024-09-12T00:22:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/3827493853 wait complete. 2024-09-12T00:22:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 Processor -- start 2024-09-12T00:22:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- start start 2024-09-12T00:22:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd914135330 con 0x7fd914110da0 2024-09-12T00:22:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd91259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd91259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45696/0 (socket says 172.21.15.31:45696) 2024-09-12T00:22:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd91259c640 1 -- 172.21.15.31:0/2089829858 learned_addr learned my addr 172.21.15.31:0/2089829858 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd91259c640 1 -- 172.21.15.31:0/2089829858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9141315b0 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd91259c640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c480 tx=0x7fd90400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd904017070 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd904005c20 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd914131f90 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9040070d0 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91412fea0 con 0x7fd914110da0 2024-09-12T00:22:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.211+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd914131a80 con 0x7fd914110da0 2024-09-12T00:22:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.215+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd90401a070 con 0x7fd914110da0 2024-09-12T00:22:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.215+0000 7fd902ffd640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 0x7fd8f403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.215+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fd90404efe0 con 0x7fd914110da0 2024-09-12T00:22:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.215+0000 7fd911d9b640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 0x7fd8f403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.215+0000 7fd911d9b640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 0x7fd8f403d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.219+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd904021020 con 0x7fd914110da0 2024-09-12T00:22:38.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.391+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd914127610 con 0x7fd8f403b200 2024-09-12T00:22:38.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.423+0000 7fd902ffd640 1 -- 172.21.15.31:0/2089829858 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665821 (secure 0 0 0) 0x7fd914127610 con 0x7fd8f403b200 2024-09-12T00:22:38.427 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:38.439 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:22:38.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 msgr2=0x7fd8f403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 0x7fd8f403d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9080ad000 tx=0x7fd9080a6000 comp rx=0 tx=0).stop 2024-09-12T00:22:38.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 msgr2=0x7fd91412f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:38.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c480 tx=0x7fd90400c940 comp rx=0 tx=0).stop 2024-09-12T00:22:38.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 shutdown_connections 2024-09-12T00:22:38.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fd8f403b200 0x7fd8f403d6c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 --2- 172.21.15.31:0/2089829858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd914110da0 0x7fd91412f790 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:38.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 >> 172.21.15.31:0/2089829858 conn(0x7fd914070900 msgr2=0x7fd91412ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:38.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 shutdown_connections 2024-09-12T00:22:38.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:38.431+0000 7fd918fc0640 1 -- 172.21.15.31:0/2089829858 wait complete. 2024-09-12T00:22:38.452 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-12T00:22:36.617740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412816,"num_objects":261,"num_object_clones":0,"num_object_copies":529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":5185,"num_read_kb":4735,"num_write":2242,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4632,"ondisk_log_size":4632,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190396,"kb_used_data":40700,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296964,"statfs":{"total":386547056640,"available":386352091136,"internally_reserved":0,"allocated":41676800,"data_stored":40498368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":153216793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006959"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.406715+0000","last_change":"2024-09-12T00:18:44.202329+0000","last_active":"2024-09-12T00:21:00.406715+0000","last_peered":"2024-09-12T00:21:00.406715+0000","last_clean":"2024-09-12T00:21:00.406715+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:21:00.406715+0000","last_undegraded":"2024-09-12T00:21:00.406715+0000","last_fullsized":"2024-09-12T00:21:00.406715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903656+0000","last_change":"2024-09-12T00:18:46.211272+0000","last_active":"2024-09-12T00:22:01.903656+0000","last_peered":"2024-09-12T00:22:01.903656+0000","last_clean":"2024-09-12T00:22:01.903656+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:22:01.903656+0000","last_undegraded":"2024-09-12T00:22:01.903656+0000","last_fullsized":"2024-09-12T00:22:01.903656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.762232+0000","last_change":"2024-09-12T00:18:44.198567+0000","last_active":"2024-09-12T00:19:31.762232+0000","last_peered":"2024-09-12T00:19:31.762232+0000","last_clean":"2024-09-12T00:19:31.762232+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:19:31.762232+0000","last_undegraded":"2024-09-12T00:19:31.762232+0000","last_fullsized":"2024-09-12T00:19:31.762232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:53.320029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.728342+0000","last_change":"2024-09-12T00:18:44.210055+0000","last_active":"2024-09-12T00:21:00.728342+0000","last_peered":"2024-09-12T00:21:00.728342+0000","last_clean":"2024-09-12T00:21:00.728342+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:21:00.728342+0000","last_undegraded":"2024-09-12T00:21:00.728342+0000","last_fullsized":"2024-09-12T00:21:00.728342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:52.123986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.423882+0000","last_change":"2024-09-12T00:18:44.194458+0000","last_active":"2024-09-12T00:22:01.423882+0000","last_peered":"2024-09-12T00:22:01.423882+0000","last_clean":"2024-09-12T00:22:01.423882+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:01.423882+0000","last_undegraded":"2024-09-12T00:22:01.423882+0000","last_fullsized":"2024-09-12T00:22:01.423882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286428+0000","last_change":"2024-09-12T00:18:44.206065+0000","last_active":"2024-09-12T00:19:24.286428+0000","last_peered":"2024-09-12T00:19:24.286428+0000","last_clean":"2024-09-12T00:19:24.286428+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:19:24.286428+0000","last_undegraded":"2024-09-12T00:19:24.286428+0000","last_fullsized":"2024-09-12T00:19:24.286428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:40.433166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'9","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.032972+0000","last_change":"2024-09-12T00:18:46.205029+0000","last_active":"2024-09-12T00:22:02.032972+0000","last_peered":"2024-09-12T00:22:02.032972+0000","last_clean":"2024-09-12T00:22:02.032972+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:22:02.032972+0000","last_undegraded":"2024-09-12T00:22:02.032972+0000","last_fullsized":"2024-09-12T00:22:02.032972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267456+0000","last_change":"2024-09-12T00:18:44.218601+0000","last_active":"2024-09-12T00:19:24.267456+0000","last_peered":"2024-09-12T00:19:24.267456+0000","last_clean":"2024-09-12T00:19:24.267456+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:19:24.267456+0000","last_undegraded":"2024-09-12T00:19:24.267456+0000","last_fullsized":"2024-09-12T00:19:24.267456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903829+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.903829+0000","last_peered":"2024-09-12T00:22:01.903829+0000","last_clean":"2024-09-12T00:22:01.903829+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.903829+0000","last_undegraded":"2024-09-12T00:22:01.903829+0000","last_fullsized":"2024-09-12T00:22:01.903829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:35.703562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278516+0000","last_change":"2024-09-12T00:18:44.193805+0000","last_active":"2024-09-12T00:19:24.278516+0000","last_peered":"2024-09-12T00:19:24.278516+0000","last_clean":"2024-09-12T00:19:24.278516+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:19:24.278516+0000","last_undegraded":"2024-09-12T00:19:24.278516+0000","last_fullsized":"2024-09-12T00:19:24.278516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:36.997859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279902+0000","last_change":"2024-09-12T00:18:46.207506+0000","last_active":"2024-09-12T00:19:24.279902+0000","last_peered":"2024-09-12T00:19:24.279902+0000","last_clean":"2024-09-12T00:19:24.279902+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:19:24.279902+0000","last_undegraded":"2024-09-12T00:19:24.279902+0000","last_fullsized":"2024-09-12T00:19:24.279902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.213594+0000","last_change":"2024-09-12T00:18:44.218215+0000","last_active":"2024-09-12T00:19:30.213594+0000","last_peered":"2024-09-12T00:19:30.213594+0000","last_clean":"2024-09-12T00:19:30.213594+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:19:30.213594+0000","last_undegraded":"2024-09-12T00:19:30.213594+0000","last_fullsized":"2024-09-12T00:19:30.213594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685897+0000","last_change":"2024-09-12T00:18:46.186627+0000","last_active":"2024-09-12T00:22:01.685897+0000","last_peered":"2024-09-12T00:22:01.685897+0000","last_clean":"2024-09-12T00:22:01.685897+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:22:01.685897+0000","last_undegraded":"2024-09-12T00:22:01.685897+0000","last_fullsized":"2024-09-12T00:22:01.685897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290994+0000","last_change":"2024-09-12T00:18:44.212848+0000","last_active":"2024-09-12T00:19:24.290994+0000","last_peered":"2024-09-12T00:19:24.290994+0000","last_clean":"2024-09-12T00:19:24.290994+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:19:24.290994+0000","last_undegraded":"2024-09-12T00:19:24.290994+0000","last_fullsized":"2024-09-12T00:19:24.290994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:33.310089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.925305+0000","last_change":"2024-09-12T00:18:46.194590+0000","last_active":"2024-09-12T00:22:01.925305+0000","last_peered":"2024-09-12T00:22:01.925305+0000","last_clean":"2024-09-12T00:22:01.925305+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:22:01.925305+0000","last_undegraded":"2024-09-12T00:22:01.925305+0000","last_fullsized":"2024-09-12T00:22:01.925305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279673+0000","last_change":"2024-09-12T00:18:44.202523+0000","last_active":"2024-09-12T00:19:24.279673+0000","last_peered":"2024-09-12T00:19:24.279673+0000","last_clean":"2024-09-12T00:19:24.279673+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:19:24.279673+0000","last_undegraded":"2024-09-12T00:19:24.279673+0000","last_fullsized":"2024-09-12T00:19:24.279673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904113+0000","last_change":"2024-09-12T00:18:46.203242+0000","last_active":"2024-09-12T00:22:01.904113+0000","last_peered":"2024-09-12T00:22:01.904113+0000","last_clean":"2024-09-12T00:22:01.904113+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:22:01.904113+0000","last_undegraded":"2024-09-12T00:22:01.904113+0000","last_fullsized":"2024-09-12T00:22:01.904113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:24.643819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.284256+0000","last_change":"2024-09-12T00:18:44.214172+0000","last_active":"2024-09-12T00:19:24.284256+0000","last_peered":"2024-09-12T00:19:24.284256+0000","last_clean":"2024-09-12T00:19:24.284256+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:19:24.284256+0000","last_undegraded":"2024-09-12T00:19:24.284256+0000","last_fullsized":"2024-09-12T00:19:24.284256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035956+0000","last_change":"2024-09-12T00:18:46.196617+0000","last_active":"2024-09-12T00:22:02.035956+0000","last_peered":"2024-09-12T00:22:02.035956+0000","last_clean":"2024-09-12T00:22:02.035956+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:22:02.035956+0000","last_undegraded":"2024-09-12T00:22:02.035956+0000","last_fullsized":"2024-09-12T00:22:02.035956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602719+0000","last_change":"2024-09-12T00:18:44.204026+0000","last_active":"2024-09-12T00:21:12.602719+0000","last_peered":"2024-09-12T00:21:12.602719+0000","last_clean":"2024-09-12T00:21:12.602719+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:21:12.602719+0000","last_undegraded":"2024-09-12T00:21:12.602719+0000","last_fullsized":"2024-09-12T00:21:12.602719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092738+0000","last_change":"2024-09-12T00:18:46.189741+0000","last_active":"2024-09-12T00:22:02.092738+0000","last_peered":"2024-09-12T00:22:02.092738+0000","last_clean":"2024-09-12T00:22:02.092738+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:22:02.092738+0000","last_undegraded":"2024-09-12T00:22:02.092738+0000","last_fullsized":"2024-09-12T00:22:02.092738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550714+0000","last_change":"2024-09-12T00:18:44.216492+0000","last_active":"2024-09-12T00:19:24.550714+0000","last_peered":"2024-09-12T00:19:24.550714+0000","last_clean":"2024-09-12T00:19:24.550714+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:19:24.550714+0000","last_undegraded":"2024-09-12T00:19:24.550714+0000","last_fullsized":"2024-09-12T00:19:24.550714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:52.545686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'5","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602774+0000","last_change":"2024-09-12T00:18:46.187100+0000","last_active":"2024-09-12T00:21:12.602774+0000","last_peered":"2024-09-12T00:21:12.602774+0000","last_clean":"2024-09-12T00:21:12.602774+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:21:12.602774+0000","last_undegraded":"2024-09-12T00:21:12.602774+0000","last_fullsized":"2024-09-12T00:21:12.602774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.865459+0000","last_change":"2024-09-12T00:18:44.194821+0000","last_active":"2024-09-12T00:22:01.865459+0000","last_peered":"2024-09-12T00:22:01.865459+0000","last_clean":"2024-09-12T00:22:01.865459+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:22:01.865459+0000","last_undegraded":"2024-09-12T00:22:01.865459+0000","last_fullsized":"2024-09-12T00:22:01.865459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:26.427367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.466162+0000","last_change":"2024-09-12T00:18:46.181776+0000","last_active":"2024-09-12T00:19:31.466162+0000","last_peered":"2024-09-12T00:19:31.466162+0000","last_clean":"2024-09-12T00:19:31.466162+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:19:31.466162+0000","last_undegraded":"2024-09-12T00:19:31.466162+0000","last_fullsized":"2024-09-12T00:19:31.466162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:14.676977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285925+0000","last_change":"2024-09-12T00:18:44.204366+0000","last_active":"2024-09-12T00:19:24.285925+0000","last_peered":"2024-09-12T00:19:24.285925+0000","last_clean":"2024-09-12T00:19:24.285925+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:19:24.285925+0000","last_undegraded":"2024-09-12T00:19:24.285925+0000","last_fullsized":"2024-09-12T00:19:24.285925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:11.910617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'42","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.252668+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:20:58.252668+0000","last_peered":"2024-09-12T00:20:58.252668+0000","last_clean":"2024-09-12T00:20:58.252668+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:20:58.252668+0000","last_undegraded":"2024-09-12T00:20:58.252668+0000","last_fullsized":"2024-09-12T00:20:58.252668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017652+0000","last_change":"2024-09-12T00:18:46.192637+0000","last_active":"2024-09-12T00:22:02.017652+0000","last_peered":"2024-09-12T00:22:02.017652+0000","last_clean":"2024-09-12T00:22:02.017652+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:22:02.017652+0000","last_undegraded":"2024-09-12T00:22:02.017652+0000","last_fullsized":"2024-09-12T00:22:02.017652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:10.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597537+0000","last_change":"2024-09-12T00:18:44.208808+0000","last_active":"2024-09-12T00:21:07.597537+0000","last_peered":"2024-09-12T00:21:07.597537+0000","last_clean":"2024-09-12T00:21:07.597537+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:21:07.597537+0000","last_undegraded":"2024-09-12T00:21:07.597537+0000","last_fullsized":"2024-09-12T00:21:07.597537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.580130+0000","last_change":"2024-09-12T00:19:24.287113+0000","last_active":"2024-09-12T00:19:27.580130+0000","last_peered":"2024-09-12T00:19:27.580130+0000","last_clean":"2024-09-12T00:19:27.580130+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:19:27.580130+0000","last_undegraded":"2024-09-12T00:19:27.580130+0000","last_fullsized":"2024-09-12T00:19:27.580130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:38.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.467228+0000","last_change":"2024-09-12T00:18:46.189086+0000","last_active":"2024-09-12T00:19:31.467228+0000","last_peered":"2024-09-12T00:19:31.467228+0000","last_clean":"2024-09-12T00:19:31.467228+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:19:31.467228+0000","last_undegraded":"2024-09-12T00:19:31.467228+0000","last_fullsized":"2024-09-12T00:19:31.467228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:41.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277544+0000","last_change":"2024-09-12T00:18:44.204623+0000","last_active":"2024-09-12T00:19:24.277544+0000","last_peered":"2024-09-12T00:19:24.277544+0000","last_clean":"2024-09-12T00:19:24.277544+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:19:24.277544+0000","last_undegraded":"2024-09-12T00:19:24.277544+0000","last_fullsized":"2024-09-12T00:19:24.277544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:49.492628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550915+0000","last_change":"2024-09-12T00:18:48.218518+0000","last_active":"2024-09-12T00:19:24.550915+0000","last_peered":"2024-09-12T00:19:24.550915+0000","last_clean":"2024-09-12T00:19:24.550915+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:19:24.550915+0000","last_undegraded":"2024-09-12T00:19:24.550915+0000","last_fullsized":"2024-09-12T00:19:24.550915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.252605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":383,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453635+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:21:58.453635+0000","last_peered":"2024-09-12T00:21:58.453635+0000","last_clean":"2024-09-12T00:21:58.453635+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:21:58.453635+0000","last_undegraded":"2024-09-12T00:21:58.453635+0000","last_fullsized":"2024-09-12T00:21:58.453635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093892+0000","last_change":"2024-09-12T00:18:46.211042+0000","last_active":"2024-09-12T00:22:02.093892+0000","last_peered":"2024-09-12T00:22:02.093892+0000","last_clean":"2024-09-12T00:22:02.093892+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:02.093892+0000","last_undegraded":"2024-09-12T00:22:02.093892+0000","last_fullsized":"2024-09-12T00:22:02.093892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.269812+0000","last_change":"2024-09-12T00:18:44.191237+0000","last_active":"2024-09-12T00:19:24.269812+0000","last_peered":"2024-09-12T00:19:24.269812+0000","last_clean":"2024-09-12T00:19:24.269812+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:19:24.269812+0000","last_undegraded":"2024-09-12T00:19:24.269812+0000","last_fullsized":"2024-09-12T00:19:24.269812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:50.165029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883493+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:20:59.883493+0000","last_peered":"2024-09-12T00:20:59.883493+0000","last_clean":"2024-09-12T00:20:59.883493+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:20:59.883493+0000","last_undegraded":"2024-09-12T00:20:59.883493+0000","last_fullsized":"2024-09-12T00:20:59.883493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.244083+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:20:58.244083+0000","last_peered":"2024-09-12T00:20:58.244083+0000","last_clean":"2024-09-12T00:20:58.244083+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:20:58.244083+0000","last_undegraded":"2024-09-12T00:20:58.244083+0000","last_fullsized":"2024-09-12T00:20:58.244083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.103038+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:02.103038+0000","last_peered":"2024-09-12T00:22:02.103038+0000","last_clean":"2024-09-12T00:22:02.103038+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:02.103038+0000","last_undegraded":"2024-09-12T00:22:02.103038+0000","last_fullsized":"2024-09-12T00:22:02.103038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.270303+0000","last_change":"2024-09-12T00:18:46.214495+0000","last_active":"2024-09-12T00:20:15.270303+0000","last_peered":"2024-09-12T00:20:15.270303+0000","last_clean":"2024-09-12T00:20:15.270303+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:20:15.270303+0000","last_undegraded":"2024-09-12T00:20:15.270303+0000","last_fullsized":"2024-09-12T00:20:15.270303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:26.250264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.890256+0000","last_change":"2024-09-12T00:18:44.202781+0000","last_active":"2024-09-12T00:22:01.890256+0000","last_peered":"2024-09-12T00:22:01.890256+0000","last_clean":"2024-09-12T00:22:01.890256+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:01.890256+0000","last_undegraded":"2024-09-12T00:22:01.890256+0000","last_fullsized":"2024-09-12T00:22:01.890256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:53.341796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272688+0000","last_change":"2024-09-12T00:18:48.204648+0000","last_active":"2024-09-12T00:19:24.272688+0000","last_peered":"2024-09-12T00:19:24.272688+0000","last_clean":"2024-09-12T00:19:24.272688+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:19:24.272688+0000","last_undegraded":"2024-09-12T00:19:24.272688+0000","last_fullsized":"2024-09-12T00:19:24.272688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:46.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'48","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596167+0000","last_change":"2024-09-12T00:18:50.230605+0000","last_active":"2024-09-12T00:21:02.596167+0000","last_peered":"2024-09-12T00:21:02.596167+0000","last_clean":"2024-09-12T00:21:02.596167+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:21:02.596167+0000","last_undegraded":"2024-09-12T00:21:02.596167+0000","last_fullsized":"2024-09-12T00:21:02.596167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:38.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":43,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.022794+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.022794+0000","last_peered":"2024-09-12T00:22:02.022794+0000","last_clean":"2024-09-12T00:22:02.022794+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.022794+0000","last_undegraded":"2024-09-12T00:22:02.022794+0000","last_fullsized":"2024-09-12T00:22:02.022794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:06.675976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'5","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599274+0000","last_change":"2024-09-12T00:18:46.194904+0000","last_active":"2024-09-12T00:20:57.599274+0000","last_peered":"2024-09-12T00:20:57.599274+0000","last_clean":"2024-09-12T00:20:57.599274+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:20:57.599274+0000","last_undegraded":"2024-09-12T00:20:57.599274+0000","last_fullsized":"2024-09-12T00:20:57.599274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596353+0000","last_change":"2024-09-12T00:18:44.198188+0000","last_active":"2024-09-12T00:21:02.596353+0000","last_peered":"2024-09-12T00:21:02.596353+0000","last_clean":"2024-09-12T00:21:02.596353+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:21:02.596353+0000","last_undegraded":"2024-09-12T00:21:02.596353+0000","last_fullsized":"2024-09-12T00:21:02.596353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:18.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544308+0000","last_change":"2024-09-12T00:18:48.205812+0000","last_active":"2024-09-12T00:19:24.544308+0000","last_peered":"2024-09-12T00:19:24.544308+0000","last_clean":"2024-09-12T00:19:24.544308+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:19:24.544308+0000","last_undegraded":"2024-09-12T00:19:24.544308+0000","last_fullsized":"2024-09-12T00:19:24.544308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.485115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.227739+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:20:58.227739+0000","last_peered":"2024-09-12T00:20:58.227739+0000","last_clean":"2024-09-12T00:20:58.227739+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:20:58.227739+0000","last_undegraded":"2024-09-12T00:20:58.227739+0000","last_fullsized":"2024-09-12T00:20:58.227739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544349+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:19:24.544349+0000","last_peered":"2024-09-12T00:19:24.544349+0000","last_clean":"2024-09-12T00:19:24.544349+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:19:24.544349+0000","last_undegraded":"2024-09-12T00:19:24.544349+0000","last_fullsized":"2024-09-12T00:19:24.544349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:09.229873+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:20:09.229873+0000","last_peered":"2024-09-12T00:20:09.229873+0000","last_clean":"2024-09-12T00:20:09.229873+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:20:09.229873+0000","last_undegraded":"2024-09-12T00:20:09.229873+0000","last_fullsized":"2024-09-12T00:20:09.229873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.249738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092735+0000","last_change":"2024-09-12T00:18:46.190345+0000","last_active":"2024-09-12T00:22:02.092735+0000","last_peered":"2024-09-12T00:22:02.092735+0000","last_clean":"2024-09-12T00:22:02.092735+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:02.092735+0000","last_undegraded":"2024-09-12T00:22:02.092735+0000","last_fullsized":"2024-09-12T00:22:02.092735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:58.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.210951+0000","last_change":"2024-09-12T00:18:44.213120+0000","last_active":"2024-09-12T00:19:30.210951+0000","last_peered":"2024-09-12T00:19:30.210951+0000","last_clean":"2024-09-12T00:19:30.210951+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:19:30.210951+0000","last_undegraded":"2024-09-12T00:19:30.210951+0000","last_fullsized":"2024-09-12T00:19:30.210951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:49.245809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.551564+0000","last_change":"2024-09-12T00:18:48.206891+0000","last_active":"2024-09-12T00:19:24.551564+0000","last_peered":"2024-09-12T00:19:24.551564+0000","last_clean":"2024-09-12T00:19:24.551564+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:19:24.551564+0000","last_undegraded":"2024-09-12T00:19:24.551564+0000","last_fullsized":"2024-09-12T00:19:24.551564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'49","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.261684+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:20:58.261684+0000","last_peered":"2024-09-12T00:20:58.261684+0000","last_clean":"2024-09-12T00:20:58.261684+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:20:58.261684+0000","last_undegraded":"2024-09-12T00:20:58.261684+0000","last_fullsized":"2024-09-12T00:20:58.261684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.032481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":350,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.457576+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:02.457576+0000","last_peered":"2024-09-12T00:22:02.457576+0000","last_clean":"2024-09-12T00:22:02.457576+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:02.457576+0000","last_undegraded":"2024-09-12T00:22:02.457576+0000","last_fullsized":"2024-09-12T00:22:02.457576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548388+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:19:24.548388+0000","last_peered":"2024-09-12T00:19:24.548388+0000","last_clean":"2024-09-12T00:19:24.548388+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:19:24.548388+0000","last_undegraded":"2024-09-12T00:19:24.548388+0000","last_fullsized":"2024-09-12T00:19:24.548388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:44.410375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903715+0000","last_change":"2024-09-12T00:18:46.184028+0000","last_active":"2024-09-12T00:22:01.903715+0000","last_peered":"2024-09-12T00:22:01.903715+0000","last_clean":"2024-09-12T00:22:01.903715+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:01.903715+0000","last_undegraded":"2024-09-12T00:22:01.903715+0000","last_fullsized":"2024-09-12T00:22:01.903715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291451+0000","last_change":"2024-09-12T00:18:44.210945+0000","last_active":"2024-09-12T00:19:24.291451+0000","last_peered":"2024-09-12T00:19:24.291451+0000","last_clean":"2024-09-12T00:19:24.291451+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:19:24.291451+0000","last_undegraded":"2024-09-12T00:19:24.291451+0000","last_fullsized":"2024-09-12T00:19:24.291451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:35.463659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.574695+0000","last_change":"2024-09-12T00:19:24.275470+0000","last_active":"2024-09-12T00:19:27.574695+0000","last_peered":"2024-09-12T00:19:27.574695+0000","last_clean":"2024-09-12T00:19:27.574695+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:19:27.574695+0000","last_undegraded":"2024-09-12T00:19:27.574695+0000","last_fullsized":"2024-09-12T00:19:27.574695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:26.076062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":135,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.264136+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:20:58.264136+0000","last_peered":"2024-09-12T00:20:58.264136+0000","last_clean":"2024-09-12T00:20:58.264136+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:20:58.264136+0000","last_undegraded":"2024-09-12T00:20:58.264136+0000","last_fullsized":"2024-09-12T00:20:58.264136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.313371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543403+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:19:24.543403+0000","last_peered":"2024-09-12T00:19:24.543403+0000","last_clean":"2024-09-12T00:19:24.543403+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:19:24.543403+0000","last_undegraded":"2024-09-12T00:19:24.543403+0000","last_fullsized":"2024-09-12T00:19:24.543403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394734+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.394734+0000","last_peered":"2024-09-12T00:22:02.394734+0000","last_clean":"2024-09-12T00:22:02.394734+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.394734+0000","last_undegraded":"2024-09-12T00:22:02.394734+0000","last_fullsized":"2024-09-12T00:22:02.394734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:35.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.019375+0000","last_change":"2024-09-12T00:19:24.302900+0000","last_active":"2024-09-12T00:22:02.019375+0000","last_peered":"2024-09-12T00:22:02.019375+0000","last_clean":"2024-09-12T00:22:02.019375+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:02.019375+0000","last_undegraded":"2024-09-12T00:22:02.019375+0000","last_fullsized":"2024-09-12T00:22:02.019375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:27.149764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548407+0000","last_change":"2024-09-12T00:18:44.182390+0000","last_active":"2024-09-12T00:19:24.548407+0000","last_peered":"2024-09-12T00:19:24.548407+0000","last_clean":"2024-09-12T00:19:24.548407+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:19:24.548407+0000","last_undegraded":"2024-09-12T00:19:24.548407+0000","last_fullsized":"2024-09-12T00:19:24.548407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:25.955106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275681+0000","last_change":"2024-09-12T00:18:48.205192+0000","last_active":"2024-09-12T00:19:24.275681+0000","last_peered":"2024-09-12T00:19:24.275681+0000","last_clean":"2024-09-12T00:19:24.275681+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:19:24.275681+0000","last_undegraded":"2024-09-12T00:19:24.275681+0000","last_fullsized":"2024-09-12T00:19:24.275681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:53.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601657+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:21:07.601657+0000","last_peered":"2024-09-12T00:21:07.601657+0000","last_clean":"2024-09-12T00:21:07.601657+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:21:07.601657+0000","last_undegraded":"2024-09-12T00:21:07.601657+0000","last_fullsized":"2024-09-12T00:21:07.601657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.841795+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:20:57.841795+0000","last_peered":"2024-09-12T00:20:57.841795+0000","last_clean":"2024-09-12T00:20:57.841795+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:20:57.841795+0000","last_undegraded":"2024-09-12T00:20:57.841795+0000","last_fullsized":"2024-09-12T00:20:57.841795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.252316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949230+0000","last_change":"2024-09-12T00:18:46.214384+0000","last_active":"2024-09-12T00:20:55.949230+0000","last_peered":"2024-09-12T00:20:55.949230+0000","last_clean":"2024-09-12T00:20:55.949230+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:20:55.949230+0000","last_undegraded":"2024-09-12T00:20:55.949230+0000","last_fullsized":"2024-09-12T00:20:55.949230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:32.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.763687+0000","last_change":"2024-09-12T00:18:44.195641+0000","last_active":"2024-09-12T00:19:31.763687+0000","last_peered":"2024-09-12T00:19:31.763687+0000","last_clean":"2024-09-12T00:19:31.763687+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:19:31.763687+0000","last_undegraded":"2024-09-12T00:19:31.763687+0000","last_fullsized":"2024-09-12T00:19:31.763687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:32.850697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544223+0000","last_change":"2024-09-12T00:18:48.206321+0000","last_active":"2024-09-12T00:19:24.544223+0000","last_peered":"2024-09-12T00:19:24.544223+0000","last_clean":"2024-09-12T00:19:24.544223+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:19:24.544223+0000","last_undegraded":"2024-09-12T00:19:24.544223+0000","last_fullsized":"2024-09-12T00:19:24.544223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.756623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276459+0000","last_change":"2024-09-12T00:18:50.208134+0000","last_active":"2024-09-12T00:20:58.276459+0000","last_peered":"2024-09-12T00:20:58.276459+0000","last_clean":"2024-09-12T00:20:58.276459+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:20:58.276459+0000","last_undegraded":"2024-09-12T00:20:58.276459+0000","last_fullsized":"2024-09-12T00:20:58.276459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:41.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":433,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394603+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:02.394603+0000","last_peered":"2024-09-12T00:22:02.394603+0000","last_clean":"2024-09-12T00:22:02.394603+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:02.394603+0000","last_undegraded":"2024-09-12T00:22:02.394603+0000","last_fullsized":"2024-09-12T00:22:02.394603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600068+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:21:02.600068+0000","last_peered":"2024-09-12T00:21:02.600068+0000","last_clean":"2024-09-12T00:21:02.600068+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:21:02.600068+0000","last_undegraded":"2024-09-12T00:21:02.600068+0000","last_fullsized":"2024-09-12T00:21:02.600068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:32.549319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950683+0000","last_change":"2024-09-12T00:18:46.190811+0000","last_active":"2024-09-12T00:20:55.950683+0000","last_peered":"2024-09-12T00:20:55.950683+0000","last_clean":"2024-09-12T00:20:55.950683+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:20:55.950683+0000","last_undegraded":"2024-09-12T00:20:55.950683+0000","last_fullsized":"2024-09-12T00:20:55.950683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280196+0000","last_change":"2024-09-12T00:18:44.209954+0000","last_active":"2024-09-12T00:19:24.280196+0000","last_peered":"2024-09-12T00:19:24.280196+0000","last_clean":"2024-09-12T00:19:24.280196+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:19:24.280196+0000","last_undegraded":"2024-09-12T00:19:24.280196+0000","last_fullsized":"2024-09-12T00:19:24.280196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:56.345709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.883129+0000","last_change":"2024-09-12T00:18:48.204097+0000","last_active":"2024-09-12T00:20:59.883129+0000","last_peered":"2024-09-12T00:20:59.883129+0000","last_clean":"2024-09-12T00:20:59.883129+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:20:59.883129+0000","last_undegraded":"2024-09-12T00:20:59.883129+0000","last_fullsized":"2024-09-12T00:20:59.883129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.662454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":470,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.261927+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:02.261927+0000","last_peered":"2024-09-12T00:22:02.261927+0000","last_clean":"2024-09-12T00:22:02.261927+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:02.261927+0000","last_undegraded":"2024-09-12T00:22:02.261927+0000","last_fullsized":"2024-09-12T00:22:02.261927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.229253+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:00.229253+0000","last_peered":"2024-09-12T00:21:00.229253+0000","last_clean":"2024-09-12T00:21:00.229253+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:00.229253+0000","last_undegraded":"2024-09-12T00:21:00.229253+0000","last_fullsized":"2024-09-12T00:21:00.229253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.526537+0000","last_change":"2024-09-12T00:18:46.211756+0000","last_active":"2024-09-12T00:22:01.526537+0000","last_peered":"2024-09-12T00:22:01.526537+0000","last_clean":"2024-09-12T00:22:01.526537+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:01.526537+0000","last_undegraded":"2024-09-12T00:22:01.526537+0000","last_fullsized":"2024-09-12T00:22:01.526537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:58.473396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277734+0000","last_change":"2024-09-12T00:18:44.204521+0000","last_active":"2024-09-12T00:19:24.277734+0000","last_peered":"2024-09-12T00:19:24.277734+0000","last_clean":"2024-09-12T00:19:24.277734+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:19:24.277734+0000","last_undegraded":"2024-09-12T00:19:24.277734+0000","last_fullsized":"2024-09-12T00:19:24.277734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.066094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298901+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:19:24.298901+0000","last_peered":"2024-09-12T00:19:24.298901+0000","last_clean":"2024-09-12T00:19:24.298901+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:19:24.298901+0000","last_undegraded":"2024-09-12T00:19:24.298901+0000","last_fullsized":"2024-09-12T00:19:24.298901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'38","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.254646+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:20:58.254646+0000","last_peered":"2024-09-12T00:20:58.254646+0000","last_clean":"2024-09-12T00:20:58.254646+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:20:58.254646+0000","last_undegraded":"2024-09-12T00:20:58.254646+0000","last_fullsized":"2024-09-12T00:20:58.254646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.191021+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.191021+0000","last_peered":"2024-09-12T00:22:02.191021+0000","last_clean":"2024-09-12T00:22:02.191021+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.191021+0000","last_undegraded":"2024-09-12T00:22:02.191021+0000","last_fullsized":"2024-09-12T00:22:02.191021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:07.414020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:32.603727+0000","last_change":"2024-09-12T00:19:24.294913+0000","last_active":"2024-09-12T00:21:32.603727+0000","last_peered":"2024-09-12T00:21:32.603727+0000","last_clean":"2024-09-12T00:21:32.603727+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:21:32.603727+0000","last_undegraded":"2024-09-12T00:21:32.603727+0000","last_fullsized":"2024-09-12T00:21:32.603727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:01.472976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:32.594140+0000","last_change":"2024-09-12T00:18:30.032956+0000","last_active":"2024-09-12T00:20:32.594140+0000","last_peered":"2024-09-12T00:20:32.594140+0000","last_clean":"2024-09-12T00:20:32.594140+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:20:32.594140+0000","last_undegraded":"2024-09-12T00:20:32.594140+0000","last_fullsized":"2024-09-12T00:20:32.594140+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.578568+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.578568+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:44.503882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285652+0000","last_change":"2024-09-12T00:18:36.633083+0000","last_active":"2024-09-12T00:19:24.285652+0000","last_peered":"2024-09-12T00:19:24.285652+0000","last_clean":"2024-09-12T00:19:24.285652+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:19:24.285652+0000","last_undegraded":"2024-09-12T00:19:24.285652+0000","last_fullsized":"2024-09-12T00:19:24.285652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.919435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.079086+0000","last_change":"2024-09-12T00:18:44.210973+0000","last_active":"2024-09-12T00:22:02.079086+0000","last_peered":"2024-09-12T00:22:02.079086+0000","last_clean":"2024-09-12T00:22:02.079086+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:02.079086+0000","last_undegraded":"2024-09-12T00:22:02.079086+0000","last_fullsized":"2024-09-12T00:22:02.079086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:48.534399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.282323+0000","last_change":"2024-09-12T00:18:48.211948+0000","last_active":"2024-09-12T00:19:24.282323+0000","last_peered":"2024-09-12T00:19:24.282323+0000","last_clean":"2024-09-12T00:19:24.282323+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:19:24.282323+0000","last_undegraded":"2024-09-12T00:19:24.282323+0000","last_fullsized":"2024-09-12T00:19:24.282323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.933386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'82","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272194+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:20:58.272194+0000","last_peered":"2024-09-12T00:20:58.272194+0000","last_clean":"2024-09-12T00:20:58.272194+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:20:58.272194+0000","last_undegraded":"2024-09-12T00:20:58.272194+0000","last_fullsized":"2024-09-12T00:20:58.272194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.876704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547510+0000","last_change":"2024-09-12T00:18:52.245007+0000","last_active":"2024-09-12T00:19:24.547510+0000","last_peered":"2024-09-12T00:19:24.547510+0000","last_clean":"2024-09-12T00:19:24.547510+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:19:24.547510+0000","last_undegraded":"2024-09-12T00:19:24.547510+0000","last_fullsized":"2024-09-12T00:19:24.547510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:17.254061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.119534+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.119534+0000","last_peered":"2024-09-12T00:22:02.119534+0000","last_clean":"2024-09-12T00:22:02.119534+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.119534+0000","last_undegraded":"2024-09-12T00:22:02.119534+0000","last_fullsized":"2024-09-12T00:22:02.119534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:46.601602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091794+0000","last_change":"2024-09-12T00:18:46.188276+0000","last_active":"2024-09-12T00:22:02.091794+0000","last_peered":"2024-09-12T00:22:02.091794+0000","last_clean":"2024-09-12T00:22:02.091794+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:22:02.091794+0000","last_undegraded":"2024-09-12T00:22:02.091794+0000","last_fullsized":"2024-09-12T00:22:02.091794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.432662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.273369+0000","last_change":"2024-09-12T00:18:36.633162+0000","last_active":"2024-09-12T00:19:24.273369+0000","last_peered":"2024-09-12T00:19:24.273369+0000","last_clean":"2024-09-12T00:19:24.273369+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:19:24.273369+0000","last_undegraded":"2024-09-12T00:19:24.273369+0000","last_fullsized":"2024-09-12T00:19:24.273369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.861380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.949260+0000","last_change":"2024-09-12T00:18:44.198633+0000","last_active":"2024-09-12T00:20:14.949260+0000","last_peered":"2024-09-12T00:20:14.949260+0000","last_clean":"2024-09-12T00:20:14.949260+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:20:14.949260+0000","last_undegraded":"2024-09-12T00:20:14.949260+0000","last_fullsized":"2024-09-12T00:20:14.949260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.301077+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:19:24.301077+0000","last_peered":"2024-09-12T00:19:24.301077+0000","last_clean":"2024-09-12T00:19:24.301077+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:19:24.301077+0000","last_undegraded":"2024-09-12T00:19:24.301077+0000","last_fullsized":"2024-09-12T00:19:24.301077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.126928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'279","reported_seq":490,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453795+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:21:58.453795+0000","last_peered":"2024-09-12T00:21:58.453795+0000","last_clean":"2024-09-12T00:21:58.453795+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:21:58.453795+0000","last_undegraded":"2024-09-12T00:21:58.453795+0000","last_fullsized":"2024-09-12T00:21:58.453795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.974846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291239+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:19:24.291239+0000","last_peered":"2024-09-12T00:19:24.291239+0000","last_clean":"2024-09-12T00:19:24.291239+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:19:24.291239+0000","last_undegraded":"2024-09-12T00:19:24.291239+0000","last_fullsized":"2024-09-12T00:19:24.291239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:27.494970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.967961+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:20:14.967961+0000","last_peered":"2024-09-12T00:20:14.967961+0000","last_clean":"2024-09-12T00:20:14.967961+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:20:14.967961+0000","last_undegraded":"2024-09-12T00:20:14.967961+0000","last_fullsized":"2024-09-12T00:20:14.967961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.417808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020186+0000","last_change":"2024-09-12T00:18:46.211820+0000","last_active":"2024-09-12T00:22:02.020186+0000","last_peered":"2024-09-12T00:22:02.020186+0000","last_clean":"2024-09-12T00:22:02.020186+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:02.020186+0000","last_undegraded":"2024-09-12T00:22:02.020186+0000","last_fullsized":"2024-09-12T00:22:02.020186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:43.510871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270254+0000","last_change":"2024-09-12T00:18:36.689595+0000","last_active":"2024-09-12T00:19:24.270254+0000","last_peered":"2024-09-12T00:19:24.270254+0000","last_clean":"2024-09-12T00:19:24.270254+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:19:24.270254+0000","last_undegraded":"2024-09-12T00:19:24.270254+0000","last_fullsized":"2024-09-12T00:19:24.270254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:50.555469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.542991+0000","last_change":"2024-09-12T00:18:44.198208+0000","last_active":"2024-09-12T00:19:24.542991+0000","last_peered":"2024-09-12T00:19:24.542991+0000","last_clean":"2024-09-12T00:19:24.542991+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:19:24.542991+0000","last_undegraded":"2024-09-12T00:19:24.542991+0000","last_fullsized":"2024-09-12T00:19:24.542991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:02.437476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275369+0000","last_change":"2024-09-12T00:18:48.197273+0000","last_active":"2024-09-12T00:19:24.275369+0000","last_peered":"2024-09-12T00:19:24.275369+0000","last_clean":"2024-09-12T00:19:24.275369+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:19:24.275369+0000","last_undegraded":"2024-09-12T00:19:24.275369+0000","last_fullsized":"2024-09-12T00:19:24.275369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:31.361645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.454216+0000","last_change":"2024-09-12T00:18:50.235509+0000","last_active":"2024-09-12T00:21:58.454216+0000","last_peered":"2024-09-12T00:21:58.454216+0000","last_clean":"2024-09-12T00:21:58.454216+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:21:58.454216+0000","last_undegraded":"2024-09-12T00:21:58.454216+0000","last_fullsized":"2024-09-12T00:21:58.454216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.659270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545528+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:19:24.545528+0000","last_peered":"2024-09-12T00:19:24.545528+0000","last_clean":"2024-09-12T00:19:24.545528+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:19:24.545528+0000","last_undegraded":"2024-09-12T00:19:24.545528+0000","last_fullsized":"2024-09-12T00:19:24.545528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.515768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274180+0000","last_change":"2024-09-12T00:18:46.200898+0000","last_active":"2024-09-12T00:20:15.274180+0000","last_peered":"2024-09-12T00:20:15.274180+0000","last_clean":"2024-09-12T00:20:15.274180+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:20:15.274180+0000","last_undegraded":"2024-09-12T00:20:15.274180+0000","last_fullsized":"2024-09-12T00:20:15.274180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:07.775807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.285725+0000","last_change":"2024-09-12T00:18:36.634494+0000","last_active":"2024-09-12T00:19:24.285725+0000","last_peered":"2024-09-12T00:19:24.285725+0000","last_clean":"2024-09-12T00:19:24.285725+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:19:24.285725+0000","last_undegraded":"2024-09-12T00:19:24.285725+0000","last_fullsized":"2024-09-12T00:19:24.285725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:02.901283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270457+0000","last_change":"2024-09-12T00:18:44.210883+0000","last_active":"2024-09-12T00:19:24.270457+0000","last_peered":"2024-09-12T00:19:24.270457+0000","last_clean":"2024-09-12T00:19:24.270457+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:19:24.270457+0000","last_undegraded":"2024-09-12T00:19:24.270457+0000","last_fullsized":"2024-09-12T00:19:24.270457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547239+0000","last_change":"2024-09-12T00:18:48.208984+0000","last_active":"2024-09-12T00:19:24.547239+0000","last_peered":"2024-09-12T00:19:24.547239+0000","last_clean":"2024-09-12T00:19:24.547239+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:19:24.547239+0000","last_undegraded":"2024-09-12T00:19:24.547239+0000","last_fullsized":"2024-09-12T00:19:24.547239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:38.522290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.833142+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.833142+0000","last_peered":"2024-09-12T00:22:00.833142+0000","last_clean":"2024-09-12T00:22:00.833142+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.833142+0000","last_undegraded":"2024-09-12T00:22:00.833142+0000","last_fullsized":"2024-09-12T00:22:00.833142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:49.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299271+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:19:24.299271+0000","last_peered":"2024-09-12T00:19:24.299271+0000","last_clean":"2024-09-12T00:19:24.299271+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:19:24.299271+0000","last_undegraded":"2024-09-12T00:19:24.299271+0000","last_fullsized":"2024-09-12T00:19:24.299271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:40.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.160041+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:00.160041+0000","last_peered":"2024-09-12T00:21:00.160041+0000","last_clean":"2024-09-12T00:21:00.160041+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:00.160041+0000","last_undegraded":"2024-09-12T00:21:00.160041+0000","last_fullsized":"2024-09-12T00:21:00.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:16.953577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.685978+0000","last_change":"2024-09-12T00:18:46.213096+0000","last_active":"2024-09-12T00:22:01.685978+0000","last_peered":"2024-09-12T00:22:01.685978+0000","last_clean":"2024-09-12T00:22:01.685978+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:01.685978+0000","last_undegraded":"2024-09-12T00:22:01.685978+0000","last_fullsized":"2024-09-12T00:22:01.685978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:49.858730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271876+0000","last_change":"2024-09-12T00:18:44.194766+0000","last_active":"2024-09-12T00:19:24.271876+0000","last_peered":"2024-09-12T00:19:24.271876+0000","last_clean":"2024-09-12T00:19:24.271876+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:19:24.271876+0000","last_undegraded":"2024-09-12T00:19:24.271876+0000","last_fullsized":"2024-09-12T00:19:24.271876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545007+0000","last_change":"2024-09-12T00:18:36.631349+0000","last_active":"2024-09-12T00:19:24.545007+0000","last_peered":"2024-09-12T00:19:24.545007+0000","last_clean":"2024-09-12T00:19:24.545007+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:19:24.545007+0000","last_undegraded":"2024-09-12T00:19:24.545007+0000","last_fullsized":"2024-09-12T00:19:24.545007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:26.037187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597116+0000","last_change":"2024-09-12T00:18:48.207153+0000","last_active":"2024-09-12T00:20:52.597116+0000","last_peered":"2024-09-12T00:20:52.597116+0000","last_clean":"2024-09-12T00:20:52.597116+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:20:52.597116+0000","last_undegraded":"2024-09-12T00:20:52.597116+0000","last_fullsized":"2024-09-12T00:20:52.597116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:40.156001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.276330+0000","last_change":"2024-09-12T00:18:50.224303+0000","last_active":"2024-09-12T00:20:58.276330+0000","last_peered":"2024-09-12T00:20:58.276330+0000","last_clean":"2024-09-12T00:20:58.276330+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:20:58.276330+0000","last_undegraded":"2024-09-12T00:20:58.276330+0000","last_fullsized":"2024-09-12T00:20:58.276330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.322839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268956+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:19:24.268956+0000","last_peered":"2024-09-12T00:19:24.268956+0000","last_clean":"2024-09-12T00:19:24.268956+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:19:24.268956+0000","last_undegraded":"2024-09-12T00:19:24.268956+0000","last_fullsized":"2024-09-12T00:19:24.268956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.028206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:32.516814+0000","last_change":"2024-09-12T00:19:24.290331+0000","last_active":"2024-09-12T00:19:32.516814+0000","last_peered":"2024-09-12T00:19:32.516814+0000","last_clean":"2024-09-12T00:19:32.516814+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:19:32.516814+0000","last_undegraded":"2024-09-12T00:19:32.516814+0000","last_fullsized":"2024-09-12T00:19:32.516814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:30.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547212+0000","last_change":"2024-09-12T00:18:44.199819+0000","last_active":"2024-09-12T00:19:24.547212+0000","last_peered":"2024-09-12T00:19:24.547212+0000","last_clean":"2024-09-12T00:19:24.547212+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:19:24.547212+0000","last_undegraded":"2024-09-12T00:19:24.547212+0000","last_fullsized":"2024-09-12T00:19:24.547212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:41.074307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292863+0000","last_change":"2024-09-12T00:18:36.634772+0000","last_active":"2024-09-12T00:19:24.292863+0000","last_peered":"2024-09-12T00:19:24.292863+0000","last_clean":"2024-09-12T00:19:24.292863+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:19:24.292863+0000","last_undegraded":"2024-09-12T00:19:24.292863+0000","last_fullsized":"2024-09-12T00:19:24.292863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:18.959556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.303925+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:19:24.303925+0000","last_peered":"2024-09-12T00:19:24.303925+0000","last_clean":"2024-09-12T00:19:24.303925+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:19:24.303925+0000","last_undegraded":"2024-09-12T00:19:24.303925+0000","last_fullsized":"2024-09-12T00:19:24.303925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:15.689100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274457+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:19:24.274457+0000","last_peered":"2024-09-12T00:19:24.274457+0000","last_clean":"2024-09-12T00:19:24.274457+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:19:24.274457+0000","last_undegraded":"2024-09-12T00:19:24.274457+0000","last_fullsized":"2024-09-12T00:19:24.274457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.218218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":371,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453469+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:21:58.453469+0000","last_peered":"2024-09-12T00:21:58.453469+0000","last_clean":"2024-09-12T00:21:58.453469+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:21:58.453469+0000","last_undegraded":"2024-09-12T00:21:58.453469+0000","last_fullsized":"2024-09-12T00:21:58.453469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949445+0000","last_change":"2024-09-12T00:18:46.215890+0000","last_active":"2024-09-12T00:20:55.949445+0000","last_peered":"2024-09-12T00:20:55.949445+0000","last_clean":"2024-09-12T00:20:55.949445+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:20:55.949445+0000","last_undegraded":"2024-09-12T00:20:55.949445+0000","last_fullsized":"2024-09-12T00:20:55.949445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:46.309362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.873890+0000","last_change":"2024-09-12T00:18:44.212538+0000","last_active":"2024-09-12T00:22:01.873890+0000","last_peered":"2024-09-12T00:22:01.873890+0000","last_clean":"2024-09-12T00:22:01.873890+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:01.873890+0000","last_undegraded":"2024-09-12T00:22:01.873890+0000","last_fullsized":"2024-09-12T00:22:01.873890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.256228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548363+0000","last_change":"2024-09-12T00:18:36.631250+0000","last_active":"2024-09-12T00:19:24.548363+0000","last_peered":"2024-09-12T00:19:24.548363+0000","last_clean":"2024-09-12T00:19:24.548363+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:19:24.548363+0000","last_undegraded":"2024-09-12T00:19:24.548363+0000","last_fullsized":"2024-09-12T00:19:24.548363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:34.082272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291763+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:19:24.291763+0000","last_peered":"2024-09-12T00:19:24.291763+0000","last_clean":"2024-09-12T00:19:24.291763+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:19:24.291763+0000","last_undegraded":"2024-09-12T00:19:24.291763+0000","last_fullsized":"2024-09-12T00:19:24.291763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287632+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:19:24.287632+0000","last_peered":"2024-09-12T00:19:24.287632+0000","last_clean":"2024-09-12T00:19:24.287632+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:19:24.287632+0000","last_undegraded":"2024-09-12T00:19:24.287632+0000","last_fullsized":"2024-09-12T00:19:24.287632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:13.589684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":401,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.426978+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:02.426978+0000","last_peered":"2024-09-12T00:22:02.426978+0000","last_clean":"2024-09-12T00:22:02.426978+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:02.426978+0000","last_undegraded":"2024-09-12T00:22:02.426978+0000","last_fullsized":"2024-09-12T00:22:02.426978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:31.647959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.112613+0000","last_change":"2024-09-12T00:18:46.192554+0000","last_active":"2024-09-12T00:22:02.112613+0000","last_peered":"2024-09-12T00:22:02.112613+0000","last_clean":"2024-09-12T00:22:02.112613+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:02.112613+0000","last_undegraded":"2024-09-12T00:22:02.112613+0000","last_fullsized":"2024-09-12T00:22:02.112613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:28.439487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288209+0000","last_change":"2024-09-12T00:18:44.208784+0000","last_active":"2024-09-12T00:19:24.288209+0000","last_peered":"2024-09-12T00:19:24.288209+0000","last_clean":"2024-09-12T00:19:24.288209+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:19:24.288209+0000","last_undegraded":"2024-09-12T00:19:24.288209+0000","last_fullsized":"2024-09-12T00:19:24.288209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:59.889965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298936+0000","last_change":"2024-09-12T00:18:36.634922+0000","last_active":"2024-09-12T00:19:24.298936+0000","last_peered":"2024-09-12T00:19:24.298936+0000","last_clean":"2024-09-12T00:19:24.298936+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:19:24.298936+0000","last_undegraded":"2024-09-12T00:19:24.298936+0000","last_fullsized":"2024-09-12T00:19:24.298936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.601610+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.601610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.830559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:59.854016+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:20:59.854016+0000","last_peered":"2024-09-12T00:20:59.854016+0000","last_clean":"2024-09-12T00:20:59.854016+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:20:59.854016+0000","last_undegraded":"2024-09-12T00:20:59.854016+0000","last_fullsized":"2024-09-12T00:20:59.854016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:13.228327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'89","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.240753+0000","last_change":"2024-09-12T00:18:50.216704+0000","last_active":"2024-09-12T00:20:58.240753+0000","last_peered":"2024-09-12T00:20:58.240753+0000","last_clean":"2024-09-12T00:20:58.240753+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:20:58.240753+0000","last_undegraded":"2024-09-12T00:20:58.240753+0000","last_fullsized":"2024-09-12T00:20:58.240753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:30.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545585+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:19:24.545585+0000","last_peered":"2024-09-12T00:19:24.545585+0000","last_clean":"2024-09-12T00:19:24.545585+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:19:24.545585+0000","last_undegraded":"2024-09-12T00:19:24.545585+0000","last_fullsized":"2024-09-12T00:19:24.545585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.985554+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:01.985554+0000","last_peered":"2024-09-12T00:22:01.985554+0000","last_clean":"2024-09-12T00:22:01.985554+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:01.985554+0000","last_undegraded":"2024-09-12T00:22:01.985554+0000","last_fullsized":"2024-09-12T00:22:01.985554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:58.559812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904828+0000","last_change":"2024-09-12T00:18:46.189861+0000","last_active":"2024-09-12T00:22:01.904828+0000","last_peered":"2024-09-12T00:22:01.904828+0000","last_clean":"2024-09-12T00:22:01.904828+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:01.904828+0000","last_undegraded":"2024-09-12T00:22:01.904828+0000","last_fullsized":"2024-09-12T00:22:01.904828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291694+0000","last_change":"2024-09-12T00:18:44.220926+0000","last_active":"2024-09-12T00:19:24.291694+0000","last_peered":"2024-09-12T00:19:24.291694+0000","last_clean":"2024-09-12T00:19:24.291694+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:19:24.291694+0000","last_undegraded":"2024-09-12T00:19:24.291694+0000","last_fullsized":"2024-09-12T00:19:24.291694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:45.017062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279723+0000","last_change":"2024-09-12T00:18:48.216343+0000","last_active":"2024-09-12T00:19:24.279723+0000","last_peered":"2024-09-12T00:19:24.279723+0000","last_clean":"2024-09-12T00:19:24.279723+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:19:24.279723+0000","last_undegraded":"2024-09-12T00:19:24.279723+0000","last_fullsized":"2024-09-12T00:19:24.279723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:54.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.260323+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:20:58.260323+0000","last_peered":"2024-09-12T00:20:58.260323+0000","last_clean":"2024-09-12T00:20:58.260323+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:20:58.260323+0000","last_undegraded":"2024-09-12T00:20:58.260323+0000","last_fullsized":"2024-09-12T00:20:58.260323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.846790+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.846790+0000","last_peered":"2024-09-12T00:20:57.846790+0000","last_clean":"2024-09-12T00:20:57.846790+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.846790+0000","last_undegraded":"2024-09-12T00:20:57.846790+0000","last_fullsized":"2024-09-12T00:20:57.846790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.409722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.924187+0000","last_change":"2024-09-12T00:18:46.217714+0000","last_active":"2024-09-12T00:22:01.924187+0000","last_peered":"2024-09-12T00:22:01.924187+0000","last_clean":"2024-09-12T00:22:01.924187+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:01.924187+0000","last_undegraded":"2024-09-12T00:22:01.924187+0000","last_fullsized":"2024-09-12T00:22:01.924187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272131+0000","last_change":"2024-09-12T00:18:44.211179+0000","last_active":"2024-09-12T00:19:24.272131+0000","last_peered":"2024-09-12T00:19:24.272131+0000","last_clean":"2024-09-12T00:19:24.272131+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:19:24.272131+0000","last_undegraded":"2024-09-12T00:19:24.272131+0000","last_fullsized":"2024-09-12T00:19:24.272131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.909390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.906157+0000","last_change":"2024-09-12T00:18:46.194089+0000","last_active":"2024-09-12T00:22:01.906157+0000","last_peered":"2024-09-12T00:22:01.906157+0000","last_clean":"2024-09-12T00:22:01.906157+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:01.906157+0000","last_undegraded":"2024-09-12T00:22:01.906157+0000","last_fullsized":"2024-09-12T00:22:01.906157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278439+0000","last_change":"2024-09-12T00:18:44.197793+0000","last_active":"2024-09-12T00:19:24.278439+0000","last_peered":"2024-09-12T00:19:24.278439+0000","last_clean":"2024-09-12T00:19:24.278439+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:19:24.278439+0000","last_undegraded":"2024-09-12T00:19:24.278439+0000","last_fullsized":"2024-09-12T00:19:24.278439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:28.573321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267773+0000","last_change":"2024-09-12T00:18:48.200680+0000","last_active":"2024-09-12T00:19:24.267773+0000","last_peered":"2024-09-12T00:19:24.267773+0000","last_clean":"2024-09-12T00:19:24.267773+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:19:24.267773+0000","last_undegraded":"2024-09-12T00:19:24.267773+0000","last_fullsized":"2024-09-12T00:19:24.267773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'42","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.999610+0000","last_change":"2024-09-12T00:18:50.224287+0000","last_active":"2024-09-12T00:22:00.999610+0000","last_peered":"2024-09-12T00:22:00.999610+0000","last_clean":"2024-09-12T00:22:00.999610+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:22:00.999610+0000","last_undegraded":"2024-09-12T00:22:00.999610+0000","last_fullsized":"2024-09-12T00:22:00.999610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":85,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.705857+0000","last_change":"2024-09-12T00:18:46.214462+0000","last_active":"2024-09-12T00:22:01.705857+0000","last_peered":"2024-09-12T00:22:01.705857+0000","last_clean":"2024-09-12T00:22:01.705857+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:22:01.705857+0000","last_undegraded":"2024-09-12T00:22:01.705857+0000","last_fullsized":"2024-09-12T00:22:01.705857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:37.657684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.472192+0000","last_change":"2024-09-12T00:18:44.196857+0000","last_active":"2024-09-12T00:22:01.472192+0000","last_peered":"2024-09-12T00:22:01.472192+0000","last_clean":"2024-09-12T00:22:01.472192+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:01.472192+0000","last_undegraded":"2024-09-12T00:22:01.472192+0000","last_fullsized":"2024-09-12T00:22:01.472192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:56.591586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.238155+0000","last_change":"2024-09-12T00:18:50.204600+0000","last_active":"2024-09-12T00:20:58.238155+0000","last_peered":"2024-09-12T00:20:58.238155+0000","last_clean":"2024-09-12T00:20:58.238155+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:20:58.238155+0000","last_undegraded":"2024-09-12T00:20:58.238155+0000","last_fullsized":"2024-09-12T00:20:58.238155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.683615+0000","last_change":"2024-09-12T00:18:46.191419+0000","last_active":"2024-09-12T00:22:01.683615+0000","last_peered":"2024-09-12T00:22:01.683615+0000","last_clean":"2024-09-12T00:22:01.683615+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:22:01.683615+0000","last_undegraded":"2024-09-12T00:22:01.683615+0000","last_fullsized":"2024-09-12T00:22:01.683615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:24.777789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.956540+0000","last_change":"2024-09-12T00:18:44.218418+0000","last_active":"2024-09-12T00:19:30.956540+0000","last_peered":"2024-09-12T00:19:30.956540+0000","last_clean":"2024-09-12T00:19:30.956540+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:19:30.956540+0000","last_undegraded":"2024-09-12T00:19:30.956540+0000","last_fullsized":"2024-09-12T00:19:30.956540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:11.461908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550826+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:19:24.550826+0000","last_peered":"2024-09-12T00:19:24.550826+0000","last_clean":"2024-09-12T00:19:24.550826+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:19:24.550826+0000","last_undegraded":"2024-09-12T00:19:24.550826+0000","last_fullsized":"2024-09-12T00:19:24.550826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:10.736641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'60","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.272148+0000","last_change":"2024-09-12T00:18:50.216262+0000","last_active":"2024-09-12T00:20:58.272148+0000","last_peered":"2024-09-12T00:20:58.272148+0000","last_clean":"2024-09-12T00:20:58.272148+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:20:58.272148+0000","last_undegraded":"2024-09-12T00:20:58.272148+0000","last_fullsized":"2024-09-12T00:20:58.272148+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'15","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035728+0000","last_change":"2024-09-12T00:18:46.211034+0000","last_active":"2024-09-12T00:22:02.035728+0000","last_peered":"2024-09-12T00:22:02.035728+0000","last_clean":"2024-09-12T00:22:02.035728+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:22:02.035728+0000","last_undegraded":"2024-09-12T00:22:02.035728+0000","last_fullsized":"2024-09-12T00:22:02.035728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272298+0000","last_change":"2024-09-12T00:18:44.193399+0000","last_active":"2024-09-12T00:19:24.272298+0000","last_peered":"2024-09-12T00:19:24.272298+0000","last_clean":"2024-09-12T00:19:24.272298+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:19:24.272298+0000","last_undegraded":"2024-09-12T00:19:24.272298+0000","last_fullsized":"2024-09-12T00:19:24.272298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293437+0000","last_change":"2024-09-12T00:19:24.291735+0000","last_active":"2024-09-12T00:19:24.293437+0000","last_peered":"2024-09-12T00:19:24.293437+0000","last_clean":"2024-09-12T00:19:24.293437+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:19:24.293437+0000","last_undegraded":"2024-09-12T00:19:24.293437+0000","last_fullsized":"2024-09-12T00:19:24.293437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:24.444471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:22.613326+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:21:22.613326+0000","last_peered":"2024-09-12T00:21:22.613326+0000","last_clean":"2024-09-12T00:21:22.613326+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:21:22.613326+0000","last_undegraded":"2024-09-12T00:21:22.613326+0000","last_fullsized":"2024-09-12T00:21:22.613326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.520849+0000","last_change":"2024-09-12T00:18:46.214392+0000","last_active":"2024-09-12T00:22:01.520849+0000","last_peered":"2024-09-12T00:22:01.520849+0000","last_clean":"2024-09-12T00:22:01.520849+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:22:01.520849+0000","last_undegraded":"2024-09-12T00:22:01.520849+0000","last_fullsized":"2024-09-12T00:22:01.520849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.180192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.769730+0000","last_change":"2024-09-12T00:18:44.202045+0000","last_active":"2024-09-12T00:19:31.769730+0000","last_peered":"2024-09-12T00:19:31.769730+0000","last_clean":"2024-09-12T00:19:31.769730+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:19:31.769730+0000","last_undegraded":"2024-09-12T00:19:31.769730+0000","last_fullsized":"2024-09-12T00:19:31.769730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:59.554485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276461+0000","last_change":"2024-09-12T00:18:48.196567+0000","last_active":"2024-09-12T00:19:24.276461+0000","last_peered":"2024-09-12T00:19:24.276461+0000","last_clean":"2024-09-12T00:19:24.276461+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:19:24.276461+0000","last_undegraded":"2024-09-12T00:19:24.276461+0000","last_fullsized":"2024-09-12T00:19:24.276461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:59.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'38","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.830301+0000","last_change":"2024-09-12T00:18:50.222960+0000","last_active":"2024-09-12T00:20:57.830301+0000","last_peered":"2024-09-12T00:20:57.830301+0000","last_clean":"2024-09-12T00:20:57.830301+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:20:57.830301+0000","last_undegraded":"2024-09-12T00:20:57.830301+0000","last_fullsized":"2024-09-12T00:20:57.830301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:40.015121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547263+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:19:24.547263+0000","last_peered":"2024-09-12T00:19:24.547263+0000","last_clean":"2024-09-12T00:19:24.547263+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:19:24.547263+0000","last_undegraded":"2024-09-12T00:19:24.547263+0000","last_fullsized":"2024-09-12T00:19:24.547263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:36.813068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.688555+0000","last_change":"2024-09-12T00:18:46.199141+0000","last_active":"2024-09-12T00:22:01.688555+0000","last_peered":"2024-09-12T00:22:01.688555+0000","last_clean":"2024-09-12T00:22:01.688555+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:01.688555+0000","last_undegraded":"2024-09-12T00:22:01.688555+0000","last_fullsized":"2024-09-12T00:22:01.688555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:15.268348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286089+0000","last_change":"2024-09-12T00:18:44.202449+0000","last_active":"2024-09-12T00:19:24.286089+0000","last_peered":"2024-09-12T00:19:24.286089+0000","last_clean":"2024-09-12T00:19:24.286089+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:19:24.286089+0000","last_undegraded":"2024-09-12T00:19:24.286089+0000","last_fullsized":"2024-09-12T00:19:24.286089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:21.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.297596+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:19:24.297596+0000","last_peered":"2024-09-12T00:19:24.297596+0000","last_clean":"2024-09-12T00:19:24.297596+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:19:24.297596+0000","last_undegraded":"2024-09-12T00:19:24.297596+0000","last_fullsized":"2024-09-12T00:19:24.297596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.140374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.453820+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:21:58.453820+0000","last_peered":"2024-09-12T00:21:58.453820+0000","last_clean":"2024-09-12T00:21:58.453820+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:21:58.453820+0000","last_undegraded":"2024-09-12T00:21:58.453820+0000","last_fullsized":"2024-09-12T00:21:58.453820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:47.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904775+0000","last_change":"2024-09-12T00:18:46.184978+0000","last_active":"2024-09-12T00:22:01.904775+0000","last_peered":"2024-09-12T00:22:01.904775+0000","last_clean":"2024-09-12T00:22:01.904775+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:22:01.904775+0000","last_undegraded":"2024-09-12T00:22:01.904775+0000","last_fullsized":"2024-09-12T00:22:01.904775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:34.862818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.670182+0000","last_change":"2024-09-12T00:18:44.200635+0000","last_active":"2024-09-12T00:21:00.670182+0000","last_peered":"2024-09-12T00:21:00.670182+0000","last_clean":"2024-09-12T00:21:00.670182+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:21:00.670182+0000","last_undegraded":"2024-09-12T00:21:00.670182+0000","last_fullsized":"2024-09-12T00:21:00.670182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:44.651283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274386+0000","last_change":"2024-09-12T00:18:48.218098+0000","last_active":"2024-09-12T00:19:24.274386+0000","last_peered":"2024-09-12T00:19:24.274386+0000","last_clean":"2024-09-12T00:19:24.274386+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:19:24.274386+0000","last_undegraded":"2024-09-12T00:19:24.274386+0000","last_fullsized":"2024-09-12T00:19:24.274386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'63","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.603751+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:21:17.603751+0000","last_peered":"2024-09-12T00:21:17.603751+0000","last_clean":"2024-09-12T00:21:17.603751+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:21:17.603751+0000","last_undegraded":"2024-09-12T00:21:17.603751+0000","last_fullsized":"2024-09-12T00:21:17.603751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.110848+0000","last_change":"2024-09-12T00:18:46.184999+0000","last_active":"2024-09-12T00:22:02.110848+0000","last_peered":"2024-09-12T00:22:02.110848+0000","last_clean":"2024-09-12T00:22:02.110848+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:22:02.110848+0000","last_undegraded":"2024-09-12T00:22:02.110848+0000","last_fullsized":"2024-09-12T00:22:02.110848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.882201+0000","last_change":"2024-09-12T00:18:44.212572+0000","last_active":"2024-09-12T00:22:01.882201+0000","last_peered":"2024-09-12T00:22:01.882201+0000","last_clean":"2024-09-12T00:22:01.882201+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:01.882201+0000","last_undegraded":"2024-09-12T00:22:01.882201+0000","last_fullsized":"2024-09-12T00:22:01.882201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.022098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271547+0000","last_change":"2024-09-12T00:18:48.208202+0000","last_active":"2024-09-12T00:19:24.271547+0000","last_peered":"2024-09-12T00:19:24.271547+0000","last_clean":"2024-09-12T00:19:24.271547+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:19:24.271547+0000","last_undegraded":"2024-09-12T00:19:24.271547+0000","last_fullsized":"2024-09-12T00:19:24.271547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.859052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.228341+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:20:58.228341+0000","last_peered":"2024-09-12T00:20:58.228341+0000","last_clean":"2024-09-12T00:20:58.228341+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:20:58.228341+0000","last_undegraded":"2024-09-12T00:20:58.228341+0000","last_fullsized":"2024-09-12T00:20:58.228341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903921+0000","last_change":"2024-09-12T00:18:46.183379+0000","last_active":"2024-09-12T00:22:01.903921+0000","last_peered":"2024-09-12T00:22:01.903921+0000","last_clean":"2024-09-12T00:22:01.903921+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:22:01.903921+0000","last_undegraded":"2024-09-12T00:22:01.903921+0000","last_fullsized":"2024-09-12T00:22:01.903921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:35.985414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548742+0000","last_change":"2024-09-12T00:18:44.217239+0000","last_active":"2024-09-12T00:19:24.548742+0000","last_peered":"2024-09-12T00:19:24.548742+0000","last_clean":"2024-09-12T00:19:24.548742+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:19:24.548742+0000","last_undegraded":"2024-09-12T00:19:24.548742+0000","last_fullsized":"2024-09-12T00:19:24.548742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271418+0000","last_change":"2024-09-12T00:18:48.211981+0000","last_active":"2024-09-12T00:19:24.271418+0000","last_peered":"2024-09-12T00:19:24.271418+0000","last_clean":"2024-09-12T00:19:24.271418+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:19:24.271418+0000","last_undegraded":"2024-09-12T00:19:24.271418+0000","last_fullsized":"2024-09-12T00:19:24.271418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:50.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'32","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.262956+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:20:58.262956+0000","last_peered":"2024-09-12T00:20:58.262956+0000","last_clean":"2024-09-12T00:20:58.262956+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:20:58.262956+0000","last_undegraded":"2024-09-12T00:20:58.262956+0000","last_fullsized":"2024-09-12T00:20:58.262956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'3","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703821+0000","last_change":"2024-09-12T00:18:46.183984+0000","last_active":"2024-09-12T00:22:01.703821+0000","last_peered":"2024-09-12T00:22:01.703821+0000","last_clean":"2024-09-12T00:22:01.703821+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:01.703821+0000","last_undegraded":"2024-09-12T00:22:01.703821+0000","last_fullsized":"2024-09-12T00:22:01.703821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:51.504748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290737+0000","last_change":"2024-09-12T00:18:44.197634+0000","last_active":"2024-09-12T00:19:24.290737+0000","last_peered":"2024-09-12T00:19:24.290737+0000","last_clean":"2024-09-12T00:19:24.290737+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:19:24.290737+0000","last_undegraded":"2024-09-12T00:19:24.290737+0000","last_fullsized":"2024-09-12T00:19:24.290737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:42.604062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:56.491323+0000","last_change":"2024-09-12T00:18:48.204166+0000","last_active":"2024-09-12T00:20:56.491323+0000","last_peered":"2024-09-12T00:20:56.491323+0000","last_clean":"2024-09-12T00:20:56.491323+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:20:56.491323+0000","last_undegraded":"2024-09-12T00:20:56.491323+0000","last_fullsized":"2024-09-12T00:20:56.491323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.533140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'44","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845387+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:00.845387+0000","last_peered":"2024-09-12T00:22:00.845387+0000","last_clean":"2024-09-12T00:22:00.845387+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:00.845387+0000","last_undegraded":"2024-09-12T00:22:00.845387+0000","last_fullsized":"2024-09-12T00:22:00.845387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291583+0000","last_change":"2024-09-12T00:18:46.213160+0000","last_active":"2024-09-12T00:19:24.291583+0000","last_peered":"2024-09-12T00:19:24.291583+0000","last_clean":"2024-09-12T00:19:24.291583+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:19:24.291583+0000","last_undegraded":"2024-09-12T00:19:24.291583+0000","last_fullsized":"2024-09-12T00:19:24.291583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:52.139206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265951+0000","last_change":"2024-09-12T00:18:44.203057+0000","last_active":"2024-09-12T00:19:24.265951+0000","last_peered":"2024-09-12T00:19:24.265951+0000","last_clean":"2024-09-12T00:19:24.265951+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:19:24.265951+0000","last_undegraded":"2024-09-12T00:19:24.265951+0000","last_fullsized":"2024-09-12T00:19:24.265951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:48.030131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521595+0000","last_change":"2024-09-12T00:18:46.199022+0000","last_active":"2024-09-12T00:22:01.521595+0000","last_peered":"2024-09-12T00:22:01.521595+0000","last_clean":"2024-09-12T00:22:01.521595+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:22:01.521595+0000","last_undegraded":"2024-09-12T00:22:01.521595+0000","last_fullsized":"2024-09-12T00:22:01.521595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:13.922738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543621+0000","last_change":"2024-09-12T00:18:44.195990+0000","last_active":"2024-09-12T00:19:24.543621+0000","last_peered":"2024-09-12T00:19:24.543621+0000","last_clean":"2024-09-12T00:19:24.543621+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:19:24.543621+0000","last_undegraded":"2024-09-12T00:19:24.543621+0000","last_fullsized":"2024-09-12T00:19:24.543621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:54.630195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.780507+0000","last_change":"2024-09-12T00:18:46.188983+0000","last_active":"2024-09-12T00:21:00.780507+0000","last_peered":"2024-09-12T00:21:00.780507+0000","last_clean":"2024-09-12T00:21:00.780507+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:21:00.780507+0000","last_undegraded":"2024-09-12T00:21:00.780507+0000","last_fullsized":"2024-09-12T00:21:00.780507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.278021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605456+0000","last_change":"2024-09-12T00:18:44.216479+0000","last_active":"2024-09-12T00:20:52.605456+0000","last_peered":"2024-09-12T00:20:52.605456+0000","last_clean":"2024-09-12T00:20:52.605456+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:20:52.605456+0000","last_undegraded":"2024-09-12T00:20:52.605456+0000","last_fullsized":"2024-09-12T00:20:52.605456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:06.659928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020857+0000","last_change":"2024-09-12T00:18:46.199070+0000","last_active":"2024-09-12T00:22:02.020857+0000","last_peered":"2024-09-12T00:22:02.020857+0000","last_clean":"2024-09-12T00:22:02.020857+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:22:02.020857+0000","last_undegraded":"2024-09-12T00:22:02.020857+0000","last_fullsized":"2024-09-12T00:22:02.020857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550235+0000","last_change":"2024-09-12T00:18:44.216172+0000","last_active":"2024-09-12T00:19:24.550235+0000","last_peered":"2024-09-12T00:19:24.550235+0000","last_clean":"2024-09-12T00:19:24.550235+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:19:24.550235+0000","last_undegraded":"2024-09-12T00:19:24.550235+0000","last_fullsized":"2024-09-12T00:19:24.550235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:45.247891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.094167+0000","last_change":"2024-09-12T00:18:46.195536+0000","last_active":"2024-09-12T00:22:02.094167+0000","last_peered":"2024-09-12T00:22:02.094167+0000","last_clean":"2024-09-12T00:22:02.094167+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:02.094167+0000","last_undegraded":"2024-09-12T00:22:02.094167+0000","last_fullsized":"2024-09-12T00:22:02.094167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215866+0000","last_change":"2024-09-12T00:18:44.197186+0000","last_active":"2024-09-12T00:19:30.215866+0000","last_peered":"2024-09-12T00:19:30.215866+0000","last_clean":"2024-09-12T00:19:30.215866+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:19:30.215866+0000","last_undegraded":"2024-09-12T00:19:30.215866+0000","last_fullsized":"2024-09-12T00:19:30.215866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:56.784241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091927+0000","last_change":"2024-09-12T00:18:46.217504+0000","last_active":"2024-09-12T00:22:02.091927+0000","last_peered":"2024-09-12T00:22:02.091927+0000","last_clean":"2024-09-12T00:22:02.091927+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:02.091927+0000","last_undegraded":"2024-09-12T00:22:02.091927+0000","last_fullsized":"2024-09-12T00:22:02.091927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:19.889526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599343+0000","last_change":"2024-09-12T00:18:44.213699+0000","last_active":"2024-09-12T00:20:57.599343+0000","last_peered":"2024-09-12T00:20:57.599343+0000","last_clean":"2024-09-12T00:20:57.599343+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:20:57.599343+0000","last_undegraded":"2024-09-12T00:20:57.599343+0000","last_fullsized":"2024-09-12T00:20:57.599343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:11.774654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020343+0000","last_change":"2024-09-12T00:18:46.210908+0000","last_active":"2024-09-12T00:22:02.020343+0000","last_peered":"2024-09-12T00:22:02.020343+0000","last_clean":"2024-09-12T00:22:02.020343+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:22:02.020343+0000","last_undegraded":"2024-09-12T00:22:02.020343+0000","last_fullsized":"2024-09-12T00:22:02.020343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278780+0000","last_change":"2024-09-12T00:18:44.198599+0000","last_active":"2024-09-12T00:19:24.278780+0000","last_peered":"2024-09-12T00:19:24.278780+0000","last_clean":"2024-09-12T00:19:24.278780+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:19:24.278780+0000","last_undegraded":"2024-09-12T00:19:24.278780+0000","last_fullsized":"2024-09-12T00:19:24.278780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:41.321303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091749+0000","last_change":"2024-09-12T00:18:46.211137+0000","last_active":"2024-09-12T00:22:02.091749+0000","last_peered":"2024-09-12T00:22:02.091749+0000","last_clean":"2024-09-12T00:22:02.091749+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:02.091749+0000","last_undegraded":"2024-09-12T00:22:02.091749+0000","last_fullsized":"2024-09-12T00:22:02.091749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:37.475779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.932223+0000","last_change":"2024-09-12T00:18:44.198634+0000","last_active":"2024-09-12T00:20:55.932223+0000","last_peered":"2024-09-12T00:20:55.932223+0000","last_clean":"2024-09-12T00:20:55.932223+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:20:55.932223+0000","last_undegraded":"2024-09-12T00:20:55.932223+0000","last_fullsized":"2024-09-12T00:20:55.932223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:48.169091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.018907+0000","last_change":"2024-09-12T00:18:46.201393+0000","last_active":"2024-09-12T00:22:02.018907+0000","last_peered":"2024-09-12T00:22:02.018907+0000","last_clean":"2024-09-12T00:22:02.018907+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:22:02.018907+0000","last_undegraded":"2024-09-12T00:22:02.018907+0000","last_fullsized":"2024-09-12T00:22:02.018907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:13.149208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277355+0000","last_change":"2024-09-12T00:18:44.216635+0000","last_active":"2024-09-12T00:19:24.277355+0000","last_peered":"2024-09-12T00:19:24.277355+0000","last_clean":"2024-09-12T00:19:24.277355+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:19:24.277355+0000","last_undegraded":"2024-09-12T00:19:24.277355+0000","last_fullsized":"2024-09-12T00:19:24.277355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.723598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544142+0000","last_change":"2024-09-12T00:18:44.217899+0000","last_active":"2024-09-12T00:19:24.544142+0000","last_peered":"2024-09-12T00:19:24.544142+0000","last_clean":"2024-09-12T00:19:24.544142+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:19:24.544142+0000","last_undegraded":"2024-09-12T00:19:24.544142+0000","last_fullsized":"2024-09-12T00:19:24.544142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:23.029905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548033+0000","last_change":"2024-09-12T00:18:46.198204+0000","last_active":"2024-09-12T00:19:24.548033+0000","last_peered":"2024-09-12T00:19:24.548033+0000","last_clean":"2024-09-12T00:19:24.548033+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:19:24.548033+0000","last_undegraded":"2024-09-12T00:19:24.548033+0000","last_fullsized":"2024-09-12T00:19:24.548033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272805+0000","last_change":"2024-09-12T00:18:44.201625+0000","last_active":"2024-09-12T00:19:24.272805+0000","last_peered":"2024-09-12T00:19:24.272805+0000","last_clean":"2024-09-12T00:19:24.272805+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:19:24.272805+0000","last_undegraded":"2024-09-12T00:19:24.272805+0000","last_fullsized":"2024-09-12T00:19:24.272805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:25.326985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.800593+0000","last_change":"2024-09-12T00:18:46.206094+0000","last_active":"2024-09-12T00:21:00.800593+0000","last_peered":"2024-09-12T00:21:00.800593+0000","last_clean":"2024-09-12T00:21:00.800593+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:21:00.800593+0000","last_undegraded":"2024-09-12T00:21:00.800593+0000","last_fullsized":"2024-09-12T00:21:00.800593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:54.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276552+0000","last_change":"2024-09-12T00:18:44.196752+0000","last_active":"2024-09-12T00:19:24.276552+0000","last_peered":"2024-09-12T00:19:24.276552+0000","last_clean":"2024-09-12T00:19:24.276552+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:19:24.276552+0000","last_undegraded":"2024-09-12T00:19:24.276552+0000","last_fullsized":"2024-09-12T00:19:24.276552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:26.884088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521751+0000","last_change":"2024-09-12T00:19:24.549151+0000","last_active":"2024-09-12T00:22:01.521751+0000","last_peered":"2024-09-12T00:22:01.521751+0000","last_clean":"2024-09-12T00:22:01.521751+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:01.521751+0000","last_undegraded":"2024-09-12T00:22:01.521751+0000","last_fullsized":"2024-09-12T00:22:01.521751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:25.450062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.482133+0000","last_change":"2024-09-12T00:18:44.183718+0000","last_active":"2024-09-12T00:21:00.482133+0000","last_peered":"2024-09-12T00:21:00.482133+0000","last_clean":"2024-09-12T00:21:00.482133+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:21:00.482133+0000","last_undegraded":"2024-09-12T00:21:00.482133+0000","last_fullsized":"2024-09-12T00:21:00.482133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.684209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600242+0000","last_change":"2024-09-12T00:18:46.203607+0000","last_active":"2024-09-12T00:21:02.600242+0000","last_peered":"2024-09-12T00:21:02.600242+0000","last_clean":"2024-09-12T00:21:02.600242+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:21:02.600242+0000","last_undegraded":"2024-09-12T00:21:02.600242+0000","last_fullsized":"2024-09-12T00:21:02.600242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:01.158629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.255211+0000","last_change":"2024-09-12T00:18:44.205642+0000","last_active":"2024-09-12T00:20:15.255211+0000","last_peered":"2024-09-12T00:20:15.255211+0000","last_clean":"2024-09-12T00:20:15.255211+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:20:15.255211+0000","last_undegraded":"2024-09-12T00:20:15.255211+0000","last_fullsized":"2024-09-12T00:20:15.255211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.988420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950179+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:20:55.950179+0000","last_peered":"2024-09-12T00:20:55.950179+0000","last_clean":"2024-09-12T00:20:55.950179+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:20:55.950179+0000","last_undegraded":"2024-09-12T00:20:55.950179+0000","last_fullsized":"2024-09-12T00:20:55.950179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'1","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.597799+0000","last_change":"2024-09-12T00:18:44.198284+0000","last_active":"2024-09-12T00:21:07.597799+0000","last_peered":"2024-09-12T00:21:07.597799+0000","last_clean":"2024-09-12T00:21:07.597799+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:21:07.597799+0000","last_undegraded":"2024-09-12T00:21:07.597799+0000","last_fullsized":"2024-09-12T00:21:07.597799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:46.654470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270885+0000","last_change":"2024-09-12T00:18:46.210796+0000","last_active":"2024-09-12T00:19:24.270885+0000","last_peered":"2024-09-12T00:19:24.270885+0000","last_clean":"2024-09-12T00:19:24.270885+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:19:24.270885+0000","last_undegraded":"2024-09-12T00:19:24.270885+0000","last_fullsized":"2024-09-12T00:19:24.270885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299482+0000","last_change":"2024-09-12T00:18:44.216498+0000","last_active":"2024-09-12T00:19:24.299482+0000","last_peered":"2024-09-12T00:19:24.299482+0000","last_clean":"2024-09-12T00:19:24.299482+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:19:24.299482+0000","last_undegraded":"2024-09-12T00:19:24.299482+0000","last_fullsized":"2024-09-12T00:19:24.299482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.498751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215514+0000","last_change":"2024-09-12T00:18:44.216871+0000","last_active":"2024-09-12T00:19:30.215514+0000","last_peered":"2024-09-12T00:19:30.215514+0000","last_clean":"2024-09-12T00:19:30.215514+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:19:30.215514+0000","last_undegraded":"2024-09-12T00:19:30.215514+0000","last_fullsized":"2024-09-12T00:19:30.215514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:27.835553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093904+0000","last_change":"2024-09-12T00:18:46.211819+0000","last_active":"2024-09-12T00:22:02.093904+0000","last_peered":"2024-09-12T00:22:02.093904+0000","last_clean":"2024-09-12T00:22:02.093904+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:22:02.093904+0000","last_undegraded":"2024-09-12T00:22:02.093904+0000","last_fullsized":"2024-09-12T00:22:02.093904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544559+0000","last_change":"2024-09-12T00:18:44.216737+0000","last_active":"2024-09-12T00:19:24.544559+0000","last_peered":"2024-09-12T00:19:24.544559+0000","last_clean":"2024-09-12T00:19:24.544559+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:19:24.544559+0000","last_undegraded":"2024-09-12T00:19:24.544559+0000","last_fullsized":"2024-09-12T00:19:24.544559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:29.268868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.787219+0000","last_change":"2024-09-12T00:18:46.217286+0000","last_active":"2024-09-12T00:19:31.787219+0000","last_peered":"2024-09-12T00:19:31.787219+0000","last_clean":"2024-09-12T00:19:31.787219+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:19:31.787219+0000","last_undegraded":"2024-09-12T00:19:31.787219+0000","last_fullsized":"2024-09-12T00:19:31.787219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.834988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1690,"num_read_kb":1444,"num_write":723,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1472,"ondisk_log_size":1472,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52580,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319260,"statfs":{"total":96636764160,"available":96582922240,"internally_reserved":0,"allocated":13389824,"data_stored":13057412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44828,"kb_used_data":9484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327012,"statfs":{"total":96636764160,"available":96590860288,"internally_reserved":0,"allocated":9711616,"data_stored":9451046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705717,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":11240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":11509760,"data_stored":11224958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46404,"kb_used_data":6900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325436,"statfs":{"total":96636764160,"available":96589246464,"internally_reserved":0,"allocated":7065600,"data_stored":6764952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.524 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.525 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.526 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.527 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.528 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.529 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.530 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.531 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.532 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.533 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.534 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.535 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:18:28.578568+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.536 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.537 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.538 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.539 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.540 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:18:33.601610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.541 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.542 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.543 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.544 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.545 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.546 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.547 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.548 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.549 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.550 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.551 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.552 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.553 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.554 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.554 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.554 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.554 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:38.554 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:22:58.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:22:58.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e035fc640 1 Processor -- start 2024-09-12T00:22:58.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e035fc640 1 -- start start 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e035fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9dfc06f8e0 0x7f9dfc1346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e035fc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dfc06feb0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e035fc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9dfc070c80 con 0x7f9dfc06f8e0 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e01398640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9dfc06edf0 0x7f9dfc06f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39286/0 (socket says 172.21.15.31:39286) 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e01398640 1 -- 172.21.15.31:0/4069302115 learned_addr learned my addr 172.21.15.31:0/4069302115 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e00b97640 1 --2- 172.21.15.31:0/4069302115 >> v2:172.21.15.31:3300/0 conn(0x7f9dfc06f8e0 0x7f9dfc1346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9df3fff640 1 -- 172.21.15.31:0/4069302115 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387699195 0 0) 0x7f9dfc06feb0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9df3fff640 1 -- 172.21.15.31:0/4069302115 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de8003530 con 0x7f9dfc06edf0 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e00b97640 1 -- 172.21.15.31:0/4069302115 >> v1:172.21.15.31:6789/0 conn(0x7f9dfc06edf0 legacy=0x7f9dfc06f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.687+0000 7f9e00b97640 1 -- 172.21.15.31:0/4069302115 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc073ef0 con 0x7f9dfc06f8e0 2024-09-12T00:22:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e00b97640 1 --2- 172.21.15.31:0/4069302115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06f8e0 0x7f9dfc1346e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009740 tx=0x7f9dec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11d9f77bb2cf17f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9df3fff640 1 -- 172.21.15.31:0/4069302115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0b1070 con 0x7f9dfc06f8e0 2024-09-12T00:22:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9df3fff640 1 -- 172.21.15.31:0/4069302115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dec0ac570 con 0x7f9dfc06f8e0 2024-09-12T00:22:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9df3fff640 1 -- 172.21.15.31:0/4069302115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dec0ac870 con 0x7f9dfc06f8e0 2024-09-12T00:22:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- 172.21.15.31:0/4069302115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06f8e0 msgr2=0x7f9dfc1346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 --2- 172.21.15.31:0/4069302115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06f8e0 0x7f9dfc1346e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009740 tx=0x7f9dec01c400 comp rx=0 tx=0).stop 2024-09-12T00:22:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- 172.21.15.31:0/4069302115 shutdown_connections 2024-09-12T00:22:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 --2- 172.21.15.31:0/4069302115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06f8e0 0x7f9dfc1346e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- 172.21.15.31:0/4069302115 >> 172.21.15.31:0/4069302115 conn(0x7f9dfc071e50 msgr2=0x7f9dfc072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- 172.21.15.31:0/4069302115 shutdown_connections 2024-09-12T00:22:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- 172.21.15.31:0/4069302115 wait complete. 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 Processor -- start 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- start start 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e035fc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1375c0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e01398640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e01398640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52850/0 (socket says 172.21.15.31:52850) 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e01398640 1 -- 172.21.15.31:0/3106741375 learned_addr learned my addr 172.21.15.31:0/3106741375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.691+0000 7f9e01398640 1 -- 172.21.15.31:0/3106741375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc134070 con 0x7f9dfc06edf0 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e01398640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb40 tx=0x7f9df800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df800ab50 con 0x7f9dfc06edf0 2024-09-12T00:22:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df800acf0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc134300 con 0x7f9dfc06edf0 2024-09-12T00:22:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df8012530 con 0x7f9dfc06edf0 2024-09-12T00:22:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc124460 con 0x7f9dfc06edf0 2024-09-12T00:22:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc133690 con 0x7f9dfc06edf0 2024-09-12T00:22:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9df80126d0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 0x7f9de003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:22:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f9df804fde0 con 0x7f9dfc06edf0 2024-09-12T00:22:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e00b97640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 0x7f9de003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:22:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.695+0000 7f9e00b97640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 0x7f9de003d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0ae000 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:22:58.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.699+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9df801a360 con 0x7f9dfc06edf0 2024-09-12T00:22:58.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.871+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dfc1298a0 con 0x7f9de003b1d0 2024-09-12T00:22:58.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.899+0000 7f9df1ffb640 1 -- 172.21.15.31:0/3106741375 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664900 (secure 0 0 0) 0x7f9dec0b2040 con 0x7f9de003b1d0 2024-09-12T00:22:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:22:58.914 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:22:58.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 msgr2=0x7f9de003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:58.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 0x7f9de003d690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0ae000 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 msgr2=0x7f9dfc123d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb40 tx=0x7f9df800a060 comp rx=0 tx=0).stop 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 shutdown_connections 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f9de003b1d0 0x7f9de003d690 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 --2- 172.21.15.31:0/3106741375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dfc06edf0 0x7f9dfc123d50 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 >> 172.21.15.31:0/3106741375 conn(0x7f9dfc071e50 msgr2=0x7f9dfc126480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 shutdown_connections 2024-09-12T00:22:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:22:58.907+0000 7f9e035fc640 1 -- 172.21.15.31:0/3106741375 wait complete. 2024-09-12T00:22:58.928 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-12T00:22:58.629431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5401,"num_read_kb":4955,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4768,"ondisk_log_size":4768,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156736,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330624,"statfs":{"total":386547056640,"available":386386558976,"internally_reserved":0,"allocated":2949120,"data_stored":1775460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":157476633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006130"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.776360+0000","last_change":"2024-09-12T00:22:51.776190+0000","last_active":"2024-09-12T00:22:51.776360+0000","last_peered":"2024-09-12T00:22:51.776360+0000","last_clean":"2024-09-12T00:22:51.776360+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:22:51.776360+0000","last_undegraded":"2024-09-12T00:22:51.776360+0000","last_fullsized":"2024-09-12T00:22:51.776360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.776007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.205681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903656+0000","last_change":"2024-09-12T00:18:46.211272+0000","last_active":"2024-09-12T00:22:01.903656+0000","last_peered":"2024-09-12T00:22:01.903656+0000","last_clean":"2024-09-12T00:22:01.903656+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:22:01.903656+0000","last_undegraded":"2024-09-12T00:22:01.903656+0000","last_fullsized":"2024-09-12T00:22:01.903656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.963190+0000","last_change":"2024-09-12T00:22:53.963022+0000","last_active":"2024-09-12T00:22:53.963190+0000","last_peered":"2024-09-12T00:22:53.963190+0000","last_clean":"2024-09-12T00:22:53.963190+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:22:53.963190+0000","last_undegraded":"2024-09-12T00:22:53.963190+0000","last_fullsized":"2024-09-12T00:22:53.963190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.962810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:20.507384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.735970+0000","last_change":"2024-09-12T00:18:44.210055+0000","last_active":"2024-09-12T00:21:00.735970+0000","last_peered":"2024-09-12T00:21:00.735970+0000","last_clean":"2024-09-12T00:21:00.735970+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:21:00.735970+0000","last_undegraded":"2024-09-12T00:21:00.735970+0000","last_fullsized":"2024-09-12T00:21:00.735970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.765815+0000","last_change":"2024-09-12T00:22:50.765815+0000","last_active":"2024-09-12T00:22:50.765815+0000","last_peered":"2024-09-12T00:22:50.765815+0000","last_clean":"2024-09-12T00:22:50.765815+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:50.765815+0000","last_undegraded":"2024-09-12T00:22:50.765815+0000","last_fullsized":"2024-09-12T00:22:50.765815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.765631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:43.898814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286428+0000","last_change":"2024-09-12T00:18:44.206065+0000","last_active":"2024-09-12T00:19:24.286428+0000","last_peered":"2024-09-12T00:19:24.286428+0000","last_clean":"2024-09-12T00:19:24.286428+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:19:24.286428+0000","last_undegraded":"2024-09-12T00:19:24.286428+0000","last_fullsized":"2024-09-12T00:19:24.286428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:40.433166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'9","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.248819+0000","last_change":"2024-09-12T00:18:46.205029+0000","last_active":"2024-09-12T00:22:02.248819+0000","last_peered":"2024-09-12T00:22:02.248819+0000","last_clean":"2024-09-12T00:22:02.248819+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:22:02.248819+0000","last_undegraded":"2024-09-12T00:22:02.248819+0000","last_fullsized":"2024-09-12T00:22:02.248819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.751719+0000","last_change":"2024-09-12T00:22:49.751719+0000","last_active":"2024-09-12T00:22:49.751719+0000","last_peered":"2024-09-12T00:22:49.751719+0000","last_clean":"2024-09-12T00:22:49.751719+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:22:49.751719+0000","last_undegraded":"2024-09-12T00:22:49.751719+0000","last_fullsized":"2024-09-12T00:22:49.751719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.751527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.037605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.923597+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.923597+0000","last_peered":"2024-09-12T00:22:01.923597+0000","last_clean":"2024-09-12T00:22:01.923597+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.923597+0000","last_undegraded":"2024-09-12T00:22:01.923597+0000","last_fullsized":"2024-09-12T00:22:01.923597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278516+0000","last_change":"2024-09-12T00:18:44.193805+0000","last_active":"2024-09-12T00:19:24.278516+0000","last_peered":"2024-09-12T00:19:24.278516+0000","last_clean":"2024-09-12T00:19:24.278516+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:19:24.278516+0000","last_undegraded":"2024-09-12T00:19:24.278516+0000","last_fullsized":"2024-09-12T00:19:24.278516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:36.997859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.593890+0000","last_change":"2024-09-12T00:18:46.207506+0000","last_active":"2024-09-12T00:20:52.593890+0000","last_peered":"2024-09-12T00:20:52.593890+0000","last_clean":"2024-09-12T00:20:52.593890+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:20:52.593890+0000","last_undegraded":"2024-09-12T00:20:52.593890+0000","last_fullsized":"2024-09-12T00:20:52.593890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.893869+0000","last_change":"2024-09-12T00:22:48.893869+0000","last_active":"2024-09-12T00:22:48.893869+0000","last_peered":"2024-09-12T00:22:48.893869+0000","last_clean":"2024-09-12T00:22:48.893869+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:22:48.893869+0000","last_undegraded":"2024-09-12T00:22:48.893869+0000","last_fullsized":"2024-09-12T00:22:48.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.893683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:04.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.704291+0000","last_change":"2024-09-12T00:18:46.186627+0000","last_active":"2024-09-12T00:22:01.704291+0000","last_peered":"2024-09-12T00:22:01.704291+0000","last_clean":"2024-09-12T00:22:01.704291+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:22:01.704291+0000","last_undegraded":"2024-09-12T00:22:01.704291+0000","last_fullsized":"2024-09-12T00:22:01.704291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.381220+0000","last_change":"2024-09-12T00:22:50.381220+0000","last_active":"2024-09-12T00:22:50.381220+0000","last_peered":"2024-09-12T00:22:50.381220+0000","last_clean":"2024-09-12T00:22:50.381220+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:22:50.381220+0000","last_undegraded":"2024-09-12T00:22:50.381220+0000","last_fullsized":"2024-09-12T00:22:50.381220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:05.740216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'7","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.925305+0000","last_change":"2024-09-12T00:18:46.194590+0000","last_active":"2024-09-12T00:22:01.925305+0000","last_peered":"2024-09-12T00:22:01.925305+0000","last_clean":"2024-09-12T00:22:01.925305+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:22:01.925305+0000","last_undegraded":"2024-09-12T00:22:01.925305+0000","last_fullsized":"2024-09-12T00:22:01.925305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.797589+0000","last_change":"2024-09-12T00:22:48.797589+0000","last_active":"2024-09-12T00:22:48.797589+0000","last_peered":"2024-09-12T00:22:48.797589+0000","last_clean":"2024-09-12T00:22:48.797589+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:22:48.797589+0000","last_undegraded":"2024-09-12T00:22:48.797589+0000","last_fullsized":"2024-09-12T00:22:48.797589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.797378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:43.134132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904113+0000","last_change":"2024-09-12T00:18:46.203242+0000","last_active":"2024-09-12T00:22:01.904113+0000","last_peered":"2024-09-12T00:22:01.904113+0000","last_clean":"2024-09-12T00:22:01.904113+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:22:01.904113+0000","last_undegraded":"2024-09-12T00:22:01.904113+0000","last_fullsized":"2024-09-12T00:22:01.904113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:24.643819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.390120+0000","last_change":"2024-09-12T00:22:48.390120+0000","last_active":"2024-09-12T00:22:48.390120+0000","last_peered":"2024-09-12T00:22:48.390120+0000","last_clean":"2024-09-12T00:22:48.390120+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:22:48.390120+0000","last_undegraded":"2024-09-12T00:22:48.390120+0000","last_fullsized":"2024-09-12T00:22:48.390120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.389942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.548963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035956+0000","last_change":"2024-09-12T00:18:46.196617+0000","last_active":"2024-09-12T00:22:02.035956+0000","last_peered":"2024-09-12T00:22:02.035956+0000","last_clean":"2024-09-12T00:22:02.035956+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:22:02.035956+0000","last_undegraded":"2024-09-12T00:22:02.035956+0000","last_fullsized":"2024-09-12T00:22:02.035956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:16.000540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.393858+0000","last_change":"2024-09-12T00:22:49.393858+0000","last_active":"2024-09-12T00:22:49.393858+0000","last_peered":"2024-09-12T00:22:49.393858+0000","last_clean":"2024-09-12T00:22:49.393858+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:22:49.393858+0000","last_undegraded":"2024-09-12T00:22:49.393858+0000","last_fullsized":"2024-09-12T00:22:49.393858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.393664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.905345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.092738+0000","last_change":"2024-09-12T00:18:46.189741+0000","last_active":"2024-09-12T00:22:02.092738+0000","last_peered":"2024-09-12T00:22:02.092738+0000","last_clean":"2024-09-12T00:22:02.092738+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:22:02.092738+0000","last_undegraded":"2024-09-12T00:22:02.092738+0000","last_fullsized":"2024-09-12T00:22:02.092738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:13.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.985430+0000","last_change":"2024-09-12T00:22:52.985430+0000","last_active":"2024-09-12T00:22:52.985430+0000","last_peered":"2024-09-12T00:22:52.985430+0000","last_clean":"2024-09-12T00:22:52.985430+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:22:52.985430+0000","last_undegraded":"2024-09-12T00:22:52.985430+0000","last_fullsized":"2024-09-12T00:22:52.985430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:11.458618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'5","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.602774+0000","last_change":"2024-09-12T00:18:46.187100+0000","last_active":"2024-09-12T00:21:12.602774+0000","last_peered":"2024-09-12T00:21:12.602774+0000","last_clean":"2024-09-12T00:21:12.602774+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:21:12.602774+0000","last_undegraded":"2024-09-12T00:21:12.602774+0000","last_fullsized":"2024-09-12T00:21:12.602774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:53.592548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.872911+0000","last_change":"2024-09-12T00:18:44.194821+0000","last_active":"2024-09-12T00:22:01.872911+0000","last_peered":"2024-09-12T00:22:01.872911+0000","last_clean":"2024-09-12T00:22:01.872911+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:22:01.872911+0000","last_undegraded":"2024-09-12T00:22:01.872911+0000","last_fullsized":"2024-09-12T00:22:01.872911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:26.427367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.466162+0000","last_change":"2024-09-12T00:18:46.181776+0000","last_active":"2024-09-12T00:19:31.466162+0000","last_peered":"2024-09-12T00:19:31.466162+0000","last_clean":"2024-09-12T00:19:31.466162+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:19:31.466162+0000","last_undegraded":"2024-09-12T00:19:31.466162+0000","last_fullsized":"2024-09-12T00:19:31.466162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:14.676977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.016861+0000","last_change":"2024-09-12T00:22:51.016861+0000","last_active":"2024-09-12T00:22:51.016861+0000","last_peered":"2024-09-12T00:22:51.016861+0000","last_clean":"2024-09-12T00:22:51.016861+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:22:51.016861+0000","last_undegraded":"2024-09-12T00:22:51.016861+0000","last_fullsized":"2024-09-12T00:22:51.016861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.016681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'45","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.541669+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:22:33.541669+0000","last_peered":"2024-09-12T00:22:33.541669+0000","last_clean":"2024-09-12T00:22:33.541669+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:22:33.541669+0000","last_undegraded":"2024-09-12T00:22:33.541669+0000","last_fullsized":"2024-09-12T00:22:33.541669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017652+0000","last_change":"2024-09-12T00:18:46.192637+0000","last_active":"2024-09-12T00:22:02.017652+0000","last_peered":"2024-09-12T00:22:02.017652+0000","last_clean":"2024-09-12T00:22:02.017652+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:22:02.017652+0000","last_undegraded":"2024-09-12T00:22:02.017652+0000","last_fullsized":"2024-09-12T00:22:02.017652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:10.135757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.797026+0000","last_change":"2024-09-12T00:22:43.797026+0000","last_active":"2024-09-12T00:22:43.797026+0000","last_peered":"2024-09-12T00:22:43.797026+0000","last_clean":"2024-09-12T00:22:43.797026+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:22:43.797026+0000","last_undegraded":"2024-09-12T00:22:43.797026+0000","last_fullsized":"2024-09-12T00:22:43.797026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.796840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:32.300041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.580130+0000","last_change":"2024-09-12T00:19:24.287113+0000","last_active":"2024-09-12T00:19:27.580130+0000","last_peered":"2024-09-12T00:19:27.580130+0000","last_clean":"2024-09-12T00:19:27.580130+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:19:27.580130+0000","last_undegraded":"2024-09-12T00:19:27.580130+0000","last_fullsized":"2024-09-12T00:19:27.580130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:38.367814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.467228+0000","last_change":"2024-09-12T00:18:46.189086+0000","last_active":"2024-09-12T00:19:31.467228+0000","last_peered":"2024-09-12T00:19:31.467228+0000","last_clean":"2024-09-12T00:19:31.467228+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:19:31.467228+0000","last_undegraded":"2024-09-12T00:19:31.467228+0000","last_fullsized":"2024-09-12T00:19:31.467228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:41.613955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.061542+0000","last_change":"2024-09-12T00:22:50.061542+0000","last_active":"2024-09-12T00:22:50.061542+0000","last_peered":"2024-09-12T00:22:50.061542+0000","last_clean":"2024-09-12T00:22:50.061542+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:22:50.061542+0000","last_undegraded":"2024-09-12T00:22:50.061542+0000","last_fullsized":"2024-09-12T00:22:50.061542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.061348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:59.156666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550915+0000","last_change":"2024-09-12T00:18:48.218518+0000","last_active":"2024-09-12T00:19:24.550915+0000","last_peered":"2024-09-12T00:19:24.550915+0000","last_clean":"2024-09-12T00:19:24.550915+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:19:24.550915+0000","last_undegraded":"2024-09-12T00:19:24.550915+0000","last_fullsized":"2024-09-12T00:19:24.550915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.252605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.251962+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:22:33.251962+0000","last_peered":"2024-09-12T00:22:33.251962+0000","last_clean":"2024-09-12T00:22:33.251962+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:22:33.251962+0000","last_undegraded":"2024-09-12T00:22:33.251962+0000","last_fullsized":"2024-09-12T00:22:33.251962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093892+0000","last_change":"2024-09-12T00:18:46.211042+0000","last_active":"2024-09-12T00:22:02.093892+0000","last_peered":"2024-09-12T00:22:02.093892+0000","last_clean":"2024-09-12T00:22:02.093892+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:02.093892+0000","last_undegraded":"2024-09-12T00:22:02.093892+0000","last_fullsized":"2024-09-12T00:22:02.093892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.546519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.345748+0000","last_change":"2024-09-12T00:22:41.345748+0000","last_active":"2024-09-12T00:22:41.345748+0000","last_peered":"2024-09-12T00:22:41.345748+0000","last_clean":"2024-09-12T00:22:41.345748+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:22:41.345748+0000","last_undegraded":"2024-09-12T00:22:41.345748+0000","last_fullsized":"2024-09-12T00:22:41.345748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.345566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:36.735410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.211285+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:22:33.211285+0000","last_peered":"2024-09-12T00:22:33.211285+0000","last_clean":"2024-09-12T00:22:33.211285+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:22:33.211285+0000","last_undegraded":"2024-09-12T00:22:33.211285+0000","last_fullsized":"2024-09-12T00:22:33.211285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'39","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.502600+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:22:33.502600+0000","last_peered":"2024-09-12T00:22:33.502600+0000","last_clean":"2024-09-12T00:22:33.502600+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:22:33.502600+0000","last_undegraded":"2024-09-12T00:22:33.502600+0000","last_fullsized":"2024-09-12T00:22:33.502600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":446,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.262847+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:33.262847+0000","last_peered":"2024-09-12T00:22:33.262847+0000","last_clean":"2024-09-12T00:22:33.262847+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:33.262847+0000","last_undegraded":"2024-09-12T00:22:33.262847+0000","last_fullsized":"2024-09-12T00:22:33.262847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.270303+0000","last_change":"2024-09-12T00:18:46.214495+0000","last_active":"2024-09-12T00:20:15.270303+0000","last_peered":"2024-09-12T00:20:15.270303+0000","last_clean":"2024-09-12T00:20:15.270303+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:20:15.270303+0000","last_undegraded":"2024-09-12T00:20:15.270303+0000","last_fullsized":"2024-09-12T00:20:15.270303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:26.250264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.772590+0000","last_change":"2024-09-12T00:22:41.772590+0000","last_active":"2024-09-12T00:22:41.772590+0000","last_peered":"2024-09-12T00:22:41.772590+0000","last_clean":"2024-09-12T00:22:41.772590+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:41.772590+0000","last_undegraded":"2024-09-12T00:22:41.772590+0000","last_fullsized":"2024-09-12T00:22:41.772590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.772363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272688+0000","last_change":"2024-09-12T00:18:48.204648+0000","last_active":"2024-09-12T00:19:24.272688+0000","last_peered":"2024-09-12T00:19:24.272688+0000","last_clean":"2024-09-12T00:19:24.272688+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:19:24.272688+0000","last_undegraded":"2024-09-12T00:19:24.272688+0000","last_fullsized":"2024-09-12T00:19:24.272688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:46.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'52","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.346560+0000","last_change":"2024-09-12T00:18:50.230605+0000","last_active":"2024-09-12T00:22:33.346560+0000","last_peered":"2024-09-12T00:22:33.346560+0000","last_clean":"2024-09-12T00:22:33.346560+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:22:33.346560+0000","last_undegraded":"2024-09-12T00:22:33.346560+0000","last_fullsized":"2024-09-12T00:22:33.346560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:38.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.022794+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.022794+0000","last_peered":"2024-09-12T00:22:02.022794+0000","last_clean":"2024-09-12T00:22:02.022794+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.022794+0000","last_undegraded":"2024-09-12T00:22:02.022794+0000","last_fullsized":"2024-09-12T00:22:02.022794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:06.675976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.432048+0000","last_change":"2024-09-12T00:22:52.432048+0000","last_active":"2024-09-12T00:22:52.432048+0000","last_peered":"2024-09-12T00:22:52.432048+0000","last_clean":"2024-09-12T00:22:52.432048+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:22:52.432048+0000","last_undegraded":"2024-09-12T00:22:52.432048+0000","last_fullsized":"2024-09-12T00:22:52.432048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.431871+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.876093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.795499+0000","last_change":"2024-09-12T00:22:40.795499+0000","last_active":"2024-09-12T00:22:40.795499+0000","last_peered":"2024-09-12T00:22:40.795499+0000","last_clean":"2024-09-12T00:22:40.795499+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:22:40.795499+0000","last_undegraded":"2024-09-12T00:22:40.795499+0000","last_fullsized":"2024-09-12T00:22:40.795499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.795325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:29.485413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544308+0000","last_change":"2024-09-12T00:18:48.205812+0000","last_active":"2024-09-12T00:19:24.544308+0000","last_peered":"2024-09-12T00:19:24.544308+0000","last_clean":"2024-09-12T00:19:24.544308+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:19:24.544308+0000","last_undegraded":"2024-09-12T00:19:24.544308+0000","last_fullsized":"2024-09-12T00:19:24.544308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.485115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'39","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.431049+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:22:33.431049+0000","last_peered":"2024-09-12T00:22:33.431049+0000","last_clean":"2024-09-12T00:22:33.431049+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:22:33.431049+0000","last_undegraded":"2024-09-12T00:22:33.431049+0000","last_fullsized":"2024-09-12T00:22:33.431049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544349+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:19:24.544349+0000","last_peered":"2024-09-12T00:19:24.544349+0000","last_clean":"2024-09-12T00:19:24.544349+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:19:24.544349+0000","last_undegraded":"2024-09-12T00:19:24.544349+0000","last_fullsized":"2024-09-12T00:19:24.544349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:09.229873+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:20:09.229873+0000","last_peered":"2024-09-12T00:20:09.229873+0000","last_clean":"2024-09-12T00:20:09.229873+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:20:09.229873+0000","last_undegraded":"2024-09-12T00:20:09.229873+0000","last_fullsized":"2024-09-12T00:20:09.229873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:44.249738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.652212+0000","last_change":"2024-09-12T00:22:56.652212+0000","last_active":"2024-09-12T00:22:56.652212+0000","last_peered":"2024-09-12T00:22:56.652212+0000","last_clean":"2024-09-12T00:22:56.652212+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:56.652212+0000","last_undegraded":"2024-09-12T00:22:56.652212+0000","last_fullsized":"2024-09-12T00:22:56.652212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.652038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.998075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.097322+0000","last_change":"2024-09-12T00:22:49.097322+0000","last_active":"2024-09-12T00:22:49.097322+0000","last_peered":"2024-09-12T00:22:49.097322+0000","last_clean":"2024-09-12T00:22:49.097322+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:22:49.097322+0000","last_undegraded":"2024-09-12T00:22:49.097322+0000","last_fullsized":"2024-09-12T00:22:49.097322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.097141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:19.046570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.551564+0000","last_change":"2024-09-12T00:18:48.206891+0000","last_active":"2024-09-12T00:19:24.551564+0000","last_peered":"2024-09-12T00:19:24.551564+0000","last_clean":"2024-09-12T00:19:24.551564+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:19:24.551564+0000","last_undegraded":"2024-09-12T00:19:24.551564+0000","last_fullsized":"2024-09-12T00:19:24.551564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'52","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.356399+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:22:33.356399+0000","last_peered":"2024-09-12T00:22:33.356399+0000","last_clean":"2024-09-12T00:22:33.356399+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:22:33.356399+0000","last_undegraded":"2024-09-12T00:22:33.356399+0000","last_fullsized":"2024-09-12T00:22:33.356399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.032481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":353,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.265126+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:33.265126+0000","last_peered":"2024-09-12T00:22:33.265126+0000","last_clean":"2024-09-12T00:22:33.265126+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:33.265126+0000","last_undegraded":"2024-09-12T00:22:33.265126+0000","last_fullsized":"2024-09-12T00:22:33.265126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548388+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:19:24.548388+0000","last_peered":"2024-09-12T00:19:24.548388+0000","last_clean":"2024-09-12T00:19:24.548388+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:19:24.548388+0000","last_undegraded":"2024-09-12T00:19:24.548388+0000","last_fullsized":"2024-09-12T00:19:24.548388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:44.410375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.683235+0000","last_change":"2024-09-12T00:22:55.683235+0000","last_active":"2024-09-12T00:22:55.683235+0000","last_peered":"2024-09-12T00:22:55.683235+0000","last_clean":"2024-09-12T00:22:55.683235+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:55.683235+0000","last_undegraded":"2024-09-12T00:22:55.683235+0000","last_fullsized":"2024-09-12T00:22:55.683235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.683049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:38.119930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.023618+0000","last_change":"2024-09-12T00:22:47.023618+0000","last_active":"2024-09-12T00:22:47.023618+0000","last_peered":"2024-09-12T00:22:47.023618+0000","last_clean":"2024-09-12T00:22:47.023618+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:22:47.023618+0000","last_undegraded":"2024-09-12T00:22:47.023618+0000","last_fullsized":"2024-09-12T00:22:47.023618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.023424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:59.258309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:27.574695+0000","last_change":"2024-09-12T00:19:24.275470+0000","last_active":"2024-09-12T00:19:27.574695+0000","last_peered":"2024-09-12T00:19:27.574695+0000","last_clean":"2024-09-12T00:19:27.574695+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:19:27.574695+0000","last_undegraded":"2024-09-12T00:19:27.574695+0000","last_fullsized":"2024-09-12T00:19:27.574695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:26.076062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.449653+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:22:33.449653+0000","last_peered":"2024-09-12T00:22:33.449653+0000","last_clean":"2024-09-12T00:22:33.449653+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:22:33.449653+0000","last_undegraded":"2024-09-12T00:22:33.449653+0000","last_fullsized":"2024-09-12T00:22:33.449653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.313371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543403+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:19:24.543403+0000","last_peered":"2024-09-12T00:19:24.543403+0000","last_clean":"2024-09-12T00:19:24.543403+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:19:24.543403+0000","last_undegraded":"2024-09-12T00:19:24.543403+0000","last_fullsized":"2024-09-12T00:19:24.543403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:34.914140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.394734+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.394734+0000","last_peered":"2024-09-12T00:22:02.394734+0000","last_clean":"2024-09-12T00:22:02.394734+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.394734+0000","last_undegraded":"2024-09-12T00:22:02.394734+0000","last_fullsized":"2024-09-12T00:22:02.394734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:35.209383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.392952+0000","last_change":"2024-09-12T00:22:54.392952+0000","last_active":"2024-09-12T00:22:54.392952+0000","last_peered":"2024-09-12T00:22:54.392952+0000","last_clean":"2024-09-12T00:22:54.392952+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:54.392952+0000","last_undegraded":"2024-09-12T00:22:54.392952+0000","last_fullsized":"2024-09-12T00:22:54.392952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.392767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:12.866147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.874023+0000","last_change":"2024-09-12T00:22:46.874023+0000","last_active":"2024-09-12T00:22:46.874023+0000","last_peered":"2024-09-12T00:22:46.874023+0000","last_clean":"2024-09-12T00:22:46.874023+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:22:46.874023+0000","last_undegraded":"2024-09-12T00:22:46.874023+0000","last_fullsized":"2024-09-12T00:22:46.874023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.873837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:16.339279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275681+0000","last_change":"2024-09-12T00:18:48.205192+0000","last_active":"2024-09-12T00:19:24.275681+0000","last_peered":"2024-09-12T00:19:24.275681+0000","last_clean":"2024-09-12T00:19:24.275681+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:19:24.275681+0000","last_undegraded":"2024-09-12T00:19:24.275681+0000","last_fullsized":"2024-09-12T00:19:24.275681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:53.367165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'42","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.456226+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:22:33.456226+0000","last_peered":"2024-09-12T00:22:33.456226+0000","last_clean":"2024-09-12T00:22:33.456226+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:22:33.456226+0000","last_undegraded":"2024-09-12T00:22:33.456226+0000","last_fullsized":"2024-09-12T00:22:33.456226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.260350+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:22:02.260350+0000","last_peered":"2024-09-12T00:22:02.260350+0000","last_clean":"2024-09-12T00:22:02.260350+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:22:02.260350+0000","last_undegraded":"2024-09-12T00:22:02.260350+0000","last_fullsized":"2024-09-12T00:22:02.260350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.949230+0000","last_change":"2024-09-12T00:18:46.214384+0000","last_active":"2024-09-12T00:20:55.949230+0000","last_peered":"2024-09-12T00:20:55.949230+0000","last_clean":"2024-09-12T00:20:55.949230+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:20:55.949230+0000","last_undegraded":"2024-09-12T00:20:55.949230+0000","last_fullsized":"2024-09-12T00:20:55.949230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:32.309196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.991549+0000","last_change":"2024-09-12T00:22:45.991549+0000","last_active":"2024-09-12T00:22:45.991549+0000","last_peered":"2024-09-12T00:22:45.991549+0000","last_clean":"2024-09-12T00:22:45.991549+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:22:45.991549+0000","last_undegraded":"2024-09-12T00:22:45.991549+0000","last_fullsized":"2024-09-12T00:22:45.991549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.991336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:42.782875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544223+0000","last_change":"2024-09-12T00:18:48.206321+0000","last_active":"2024-09-12T00:19:24.544223+0000","last_peered":"2024-09-12T00:19:24.544223+0000","last_clean":"2024-09-12T00:19:24.544223+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:19:24.544223+0000","last_undegraded":"2024-09-12T00:19:24.544223+0000","last_fullsized":"2024-09-12T00:19:24.544223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.756623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'40","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.410067+0000","last_change":"2024-09-12T00:18:50.208134+0000","last_active":"2024-09-12T00:22:33.410067+0000","last_peered":"2024-09-12T00:22:33.410067+0000","last_clean":"2024-09-12T00:22:33.410067+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:22:33.410067+0000","last_undegraded":"2024-09-12T00:22:33.410067+0000","last_fullsized":"2024-09-12T00:22:33.410067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:41.043109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":436,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.252716+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:33.252716+0000","last_peered":"2024-09-12T00:22:33.252716+0000","last_clean":"2024-09-12T00:22:33.252716+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:33.252716+0000","last_undegraded":"2024-09-12T00:22:33.252716+0000","last_fullsized":"2024-09-12T00:22:33.252716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600068+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:21:02.600068+0000","last_peered":"2024-09-12T00:21:02.600068+0000","last_clean":"2024-09-12T00:21:02.600068+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:21:02.600068+0000","last_undegraded":"2024-09-12T00:21:02.600068+0000","last_fullsized":"2024-09-12T00:21:02.600068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:32.549319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950683+0000","last_change":"2024-09-12T00:18:46.190811+0000","last_active":"2024-09-12T00:20:55.950683+0000","last_peered":"2024-09-12T00:20:55.950683+0000","last_clean":"2024-09-12T00:20:55.950683+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:20:55.950683+0000","last_undegraded":"2024-09-12T00:20:55.950683+0000","last_fullsized":"2024-09-12T00:20:55.950683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.055242+0000","last_change":"2024-09-12T00:22:48.055242+0000","last_active":"2024-09-12T00:22:48.055242+0000","last_peered":"2024-09-12T00:22:48.055242+0000","last_clean":"2024-09-12T00:22:48.055242+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:22:48.055242+0000","last_undegraded":"2024-09-12T00:22:48.055242+0000","last_fullsized":"2024-09-12T00:22:48.055242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.055065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:08.979877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":418,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.224266+0000","last_change":"2024-09-12T00:18:48.204097+0000","last_active":"2024-09-12T00:22:33.224266+0000","last_peered":"2024-09-12T00:22:33.224266+0000","last_clean":"2024-09-12T00:22:33.224266+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:22:33.224266+0000","last_undegraded":"2024-09-12T00:22:33.224266+0000","last_fullsized":"2024-09-12T00:22:33.224266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.662454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":473,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.255674+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:33.255674+0000","last_peered":"2024-09-12T00:22:33.255674+0000","last_clean":"2024-09-12T00:22:33.255674+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:33.255674+0000","last_undegraded":"2024-09-12T00:22:33.255674+0000","last_fullsized":"2024-09-12T00:22:33.255674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.229253+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:00.229253+0000","last_peered":"2024-09-12T00:21:00.229253+0000","last_clean":"2024-09-12T00:21:00.229253+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:00.229253+0000","last_undegraded":"2024-09-12T00:21:00.229253+0000","last_fullsized":"2024-09-12T00:21:00.229253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.425858+0000","last_change":"2024-09-12T00:22:53.425858+0000","last_active":"2024-09-12T00:22:53.425858+0000","last_peered":"2024-09-12T00:22:53.425858+0000","last_clean":"2024-09-12T00:22:53.425858+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:53.425858+0000","last_undegraded":"2024-09-12T00:22:53.425858+0000","last_fullsized":"2024-09-12T00:22:53.425858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.425681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:50.989571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.037018+0000","last_change":"2024-09-12T00:22:45.037018+0000","last_active":"2024-09-12T00:22:45.037018+0000","last_peered":"2024-09-12T00:22:45.037018+0000","last_clean":"2024-09-12T00:22:45.037018+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:22:45.037018+0000","last_undegraded":"2024-09-12T00:22:45.037018+0000","last_fullsized":"2024-09-12T00:22:45.037018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.036831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:05.107642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298901+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:19:24.298901+0000","last_peered":"2024-09-12T00:19:24.298901+0000","last_clean":"2024-09-12T00:19:24.298901+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:19:24.298901+0000","last_undegraded":"2024-09-12T00:19:24.298901+0000","last_fullsized":"2024-09-12T00:19:24.298901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:06.149485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'41","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.548141+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:22:33.548141+0000","last_peered":"2024-09-12T00:22:33.548141+0000","last_clean":"2024-09-12T00:22:33.548141+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:22:33.548141+0000","last_undegraded":"2024-09-12T00:22:33.548141+0000","last_fullsized":"2024-09-12T00:22:33.548141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.191021+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.191021+0000","last_peered":"2024-09-12T00:22:02.191021+0000","last_clean":"2024-09-12T00:22:02.191021+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.191021+0000","last_undegraded":"2024-09-12T00:22:02.191021+0000","last_fullsized":"2024-09-12T00:22:02.191021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:07.414020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.741667+0000","last_change":"2024-09-12T00:22:53.741667+0000","last_active":"2024-09-12T00:22:53.741667+0000","last_peered":"2024-09-12T00:22:53.741667+0000","last_clean":"2024-09-12T00:22:53.741667+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:22:53.741667+0000","last_undegraded":"2024-09-12T00:22:53.741667+0000","last_fullsized":"2024-09-12T00:22:53.741667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.741481+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:54.588986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.330431+0000","last_change":"2024-09-12T00:22:38.330431+0000","last_active":"2024-09-12T00:22:38.330431+0000","last_peered":"2024-09-12T00:22:38.330431+0000","last_clean":"2024-09-12T00:22:38.330431+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:22:38.330431+0000","last_undegraded":"2024-09-12T00:22:38.330431+0000","last_fullsized":"2024-09-12T00:22:38.330431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.330231+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:47.818803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.088492+0000","last_change":"2024-09-12T00:22:40.088223+0000","last_active":"2024-09-12T00:22:40.088492+0000","last_peered":"2024-09-12T00:22:40.088492+0000","last_clean":"2024-09-12T00:22:40.088492+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:22:40.088492+0000","last_undegraded":"2024-09-12T00:22:40.088492+0000","last_fullsized":"2024-09-12T00:22:40.088492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.087970+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.489548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.015916+0000","last_change":"2024-09-12T00:22:43.015652+0000","last_active":"2024-09-12T00:22:43.015916+0000","last_peered":"2024-09-12T00:22:43.015916+0000","last_clean":"2024-09-12T00:22:43.015916+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:43.015916+0000","last_undegraded":"2024-09-12T00:22:43.015916+0000","last_fullsized":"2024-09-12T00:22:43.015916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.015422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:23.844048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.598616+0000","last_change":"2024-09-12T00:18:48.211948+0000","last_active":"2024-09-12T00:20:52.598616+0000","last_peered":"2024-09-12T00:20:52.598616+0000","last_clean":"2024-09-12T00:20:52.598616+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:20:52.598616+0000","last_undegraded":"2024-09-12T00:20:52.598616+0000","last_fullsized":"2024-09-12T00:20:52.598616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'91","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.527502+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:22:33.527502+0000","last_peered":"2024-09-12T00:22:33.527502+0000","last_clean":"2024-09-12T00:22:33.527502+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:22:33.527502+0000","last_undegraded":"2024-09-12T00:22:33.527502+0000","last_fullsized":"2024-09-12T00:22:33.527502+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:37.876704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547510+0000","last_change":"2024-09-12T00:18:52.245007+0000","last_active":"2024-09-12T00:19:24.547510+0000","last_peered":"2024-09-12T00:19:24.547510+0000","last_clean":"2024-09-12T00:19:24.547510+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:19:24.547510+0000","last_undegraded":"2024-09-12T00:19:24.547510+0000","last_fullsized":"2024-09-12T00:19:24.547510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:17.254061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.119534+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.119534+0000","last_peered":"2024-09-12T00:22:02.119534+0000","last_clean":"2024-09-12T00:22:02.119534+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.119534+0000","last_undegraded":"2024-09-12T00:22:02.119534+0000","last_fullsized":"2024-09-12T00:22:02.119534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:46.601602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.091794+0000","last_change":"2024-09-12T00:18:46.188276+0000","last_active":"2024-09-12T00:22:02.091794+0000","last_peered":"2024-09-12T00:22:02.091794+0000","last_clean":"2024-09-12T00:22:02.091794+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:22:02.091794+0000","last_undegraded":"2024-09-12T00:22:02.091794+0000","last_fullsized":"2024-09-12T00:22:02.091794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.432662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.101143+0000","last_change":"2024-09-12T00:22:38.101143+0000","last_active":"2024-09-12T00:22:38.101143+0000","last_peered":"2024-09-12T00:22:38.101143+0000","last_clean":"2024-09-12T00:22:38.101143+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:22:38.101143+0000","last_undegraded":"2024-09-12T00:22:38.101143+0000","last_fullsized":"2024-09-12T00:22:38.101143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.100967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:57.104038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.819521+0000","last_change":"2024-09-12T00:22:41.819357+0000","last_active":"2024-09-12T00:22:41.819521+0000","last_peered":"2024-09-12T00:22:41.819521+0000","last_clean":"2024-09-12T00:22:41.819521+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:22:41.819521+0000","last_undegraded":"2024-09-12T00:22:41.819521+0000","last_fullsized":"2024-09-12T00:22:41.819521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.819171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.252502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.301077+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:19:24.301077+0000","last_peered":"2024-09-12T00:19:24.301077+0000","last_clean":"2024-09-12T00:19:24.301077+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:19:24.301077+0000","last_undegraded":"2024-09-12T00:19:24.301077+0000","last_fullsized":"2024-09-12T00:19:24.301077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:59.126928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":514,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.559088+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:22:33.559088+0000","last_peered":"2024-09-12T00:22:33.559088+0000","last_clean":"2024-09-12T00:22:33.559088+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:22:33.559088+0000","last_undegraded":"2024-09-12T00:22:33.559088+0000","last_fullsized":"2024-09-12T00:22:33.559088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.974846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.291239+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:19:24.291239+0000","last_peered":"2024-09-12T00:19:24.291239+0000","last_clean":"2024-09-12T00:19:24.291239+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:19:24.291239+0000","last_undegraded":"2024-09-12T00:19:24.291239+0000","last_fullsized":"2024-09-12T00:19:24.291239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:27.494970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.967961+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:20:14.967961+0000","last_peered":"2024-09-12T00:20:14.967961+0000","last_clean":"2024-09-12T00:20:14.967961+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:20:14.967961+0000","last_undegraded":"2024-09-12T00:20:14.967961+0000","last_fullsized":"2024-09-12T00:20:14.967961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.417808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.892682+0000","last_change":"2024-09-12T00:22:56.892682+0000","last_active":"2024-09-12T00:22:56.892682+0000","last_peered":"2024-09-12T00:22:56.892682+0000","last_clean":"2024-09-12T00:22:56.892682+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:56.892682+0000","last_undegraded":"2024-09-12T00:22:56.892682+0000","last_fullsized":"2024-09-12T00:22:56.892682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.892476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:41.105061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.794403+0000","last_change":"2024-09-12T00:22:38.794195+0000","last_active":"2024-09-12T00:22:38.794403+0000","last_peered":"2024-09-12T00:22:38.794403+0000","last_clean":"2024-09-12T00:22:38.794403+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:22:38.794403+0000","last_undegraded":"2024-09-12T00:22:38.794403+0000","last_fullsized":"2024-09-12T00:22:38.794403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.794009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:39.382664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.745657+0000","last_change":"2024-09-12T00:22:39.745499+0000","last_active":"2024-09-12T00:22:39.745657+0000","last_peered":"2024-09-12T00:22:39.745657+0000","last_clean":"2024-09-12T00:22:39.745657+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:22:39.745657+0000","last_undegraded":"2024-09-12T00:22:39.745657+0000","last_fullsized":"2024-09-12T00:22:39.745657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.745298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.209943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275369+0000","last_change":"2024-09-12T00:18:48.197273+0000","last_active":"2024-09-12T00:19:24.275369+0000","last_peered":"2024-09-12T00:19:24.275369+0000","last_clean":"2024-09-12T00:19:24.275369+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:19:24.275369+0000","last_undegraded":"2024-09-12T00:19:24.275369+0000","last_fullsized":"2024-09-12T00:19:24.275369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:31.361645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'16","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:58.454216+0000","last_change":"2024-09-12T00:18:50.235509+0000","last_active":"2024-09-12T00:21:58.454216+0000","last_peered":"2024-09-12T00:21:58.454216+0000","last_clean":"2024-09-12T00:21:58.454216+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:21:58.454216+0000","last_undegraded":"2024-09-12T00:21:58.454216+0000","last_fullsized":"2024-09-12T00:21:58.454216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.659270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545528+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:19:24.545528+0000","last_peered":"2024-09-12T00:19:24.545528+0000","last_clean":"2024-09-12T00:19:24.545528+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:19:24.545528+0000","last_undegraded":"2024-09-12T00:19:24.545528+0000","last_fullsized":"2024-09-12T00:19:24.545528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.515768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.935849+0000","last_change":"2024-09-12T00:22:50.935612+0000","last_active":"2024-09-12T00:22:50.935849+0000","last_peered":"2024-09-12T00:22:50.935849+0000","last_clean":"2024-09-12T00:22:50.935849+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:22:50.935849+0000","last_undegraded":"2024-09-12T00:22:50.935849+0000","last_fullsized":"2024-09-12T00:22:50.935849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.935377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:27.379599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.123005+0000","last_change":"2024-09-12T00:22:39.122842+0000","last_active":"2024-09-12T00:22:39.123005+0000","last_peered":"2024-09-12T00:22:39.123005+0000","last_clean":"2024-09-12T00:22:39.123005+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:22:39.123005+0000","last_undegraded":"2024-09-12T00:22:39.123005+0000","last_fullsized":"2024-09-12T00:22:39.123005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.122671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.081831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.755968+0000","last_change":"2024-09-12T00:22:37.755805+0000","last_active":"2024-09-12T00:22:37.755968+0000","last_peered":"2024-09-12T00:22:37.755968+0000","last_clean":"2024-09-12T00:22:37.755968+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:22:37.755968+0000","last_undegraded":"2024-09-12T00:22:37.755968+0000","last_fullsized":"2024-09-12T00:22:37.755968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.755556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:00.374036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597210+0000","last_change":"2024-09-12T00:18:48.208984+0000","last_active":"2024-09-12T00:20:52.597210+0000","last_peered":"2024-09-12T00:20:52.597210+0000","last_clean":"2024-09-12T00:20:52.597210+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:20:52.597210+0000","last_undegraded":"2024-09-12T00:20:52.597210+0000","last_fullsized":"2024-09-12T00:20:52.597210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.833142+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.833142+0000","last_peered":"2024-09-12T00:22:00.833142+0000","last_clean":"2024-09-12T00:22:00.833142+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.833142+0000","last_undegraded":"2024-09-12T00:22:00.833142+0000","last_fullsized":"2024-09-12T00:22:00.833142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:49.775272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299271+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:19:24.299271+0000","last_peered":"2024-09-12T00:19:24.299271+0000","last_clean":"2024-09-12T00:19:24.299271+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:19:24.299271+0000","last_undegraded":"2024-09-12T00:19:24.299271+0000","last_fullsized":"2024-09-12T00:19:24.299271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:40.948076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.160041+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:00.160041+0000","last_peered":"2024-09-12T00:21:00.160041+0000","last_clean":"2024-09-12T00:21:00.160041+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:00.160041+0000","last_undegraded":"2024-09-12T00:21:00.160041+0000","last_fullsized":"2024-09-12T00:21:00.160041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:16.953577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.391150+0000","last_change":"2024-09-12T00:22:51.390965+0000","last_active":"2024-09-12T00:22:51.391150+0000","last_peered":"2024-09-12T00:22:51.391150+0000","last_clean":"2024-09-12T00:22:51.391150+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:51.391150+0000","last_undegraded":"2024-09-12T00:22:51.391150+0000","last_fullsized":"2024-09-12T00:22:51.391150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.390779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:45.398139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.771257+0000","last_change":"2024-09-12T00:22:39.771132+0000","last_active":"2024-09-12T00:22:39.771257+0000","last_peered":"2024-09-12T00:22:39.771257+0000","last_clean":"2024-09-12T00:22:39.771257+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:22:39.771257+0000","last_undegraded":"2024-09-12T00:22:39.771257+0000","last_fullsized":"2024-09-12T00:22:39.771257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.770939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.724696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.712557+0000","last_change":"2024-09-12T00:22:38.712422+0000","last_active":"2024-09-12T00:22:38.712557+0000","last_peered":"2024-09-12T00:22:38.712557+0000","last_clean":"2024-09-12T00:22:38.712557+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:22:38.712557+0000","last_undegraded":"2024-09-12T00:22:38.712557+0000","last_fullsized":"2024-09-12T00:22:38.712557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.712222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:33.915095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.244884+0000","last_change":"2024-09-12T00:18:48.207153+0000","last_active":"2024-09-12T00:22:33.244884+0000","last_peered":"2024-09-12T00:22:33.244884+0000","last_clean":"2024-09-12T00:22:33.244884+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:22:33.244884+0000","last_undegraded":"2024-09-12T00:22:33.244884+0000","last_fullsized":"2024-09-12T00:22:33.244884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'81","reported_seq":162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.515016+0000","last_change":"2024-09-12T00:18:50.224303+0000","last_active":"2024-09-12T00:22:33.515016+0000","last_peered":"2024-09-12T00:22:33.515016+0000","last_clean":"2024-09-12T00:22:33.515016+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:22:33.515016+0000","last_undegraded":"2024-09-12T00:22:33.515016+0000","last_fullsized":"2024-09-12T00:22:33.515016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268956+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:19:24.268956+0000","last_peered":"2024-09-12T00:19:24.268956+0000","last_clean":"2024-09-12T00:19:24.268956+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:19:24.268956+0000","last_undegraded":"2024-09-12T00:19:24.268956+0000","last_fullsized":"2024-09-12T00:19:24.268956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.028206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.726884+0000","last_change":"2024-09-12T00:22:54.726884+0000","last_active":"2024-09-12T00:22:54.726884+0000","last_peered":"2024-09-12T00:22:54.726884+0000","last_clean":"2024-09-12T00:22:54.726884+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:22:54.726884+0000","last_undegraded":"2024-09-12T00:22:54.726884+0000","last_fullsized":"2024-09-12T00:22:54.726884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.726712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:01.342735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.855296+0000","last_change":"2024-09-12T00:22:42.855131+0000","last_active":"2024-09-12T00:22:42.855296+0000","last_peered":"2024-09-12T00:22:42.855296+0000","last_clean":"2024-09-12T00:22:42.855296+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:22:42.855296+0000","last_undegraded":"2024-09-12T00:22:42.855296+0000","last_fullsized":"2024-09-12T00:22:42.855296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.854911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.063391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.050175+0000","last_change":"2024-09-12T00:22:41.050057+0000","last_active":"2024-09-12T00:22:41.050175+0000","last_peered":"2024-09-12T00:22:41.050175+0000","last_clean":"2024-09-12T00:22:41.050175+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:22:41.050175+0000","last_undegraded":"2024-09-12T00:22:41.050175+0000","last_fullsized":"2024-09-12T00:22:41.050175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.049881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:33.601411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605429+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:20:52.605429+0000","last_peered":"2024-09-12T00:20:52.605429+0000","last_clean":"2024-09-12T00:20:52.605429+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:20:52.605429+0000","last_undegraded":"2024-09-12T00:20:52.605429+0000","last_fullsized":"2024-09-12T00:20:52.605429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274457+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:19:24.274457+0000","last_peered":"2024-09-12T00:19:24.274457+0000","last_clean":"2024-09-12T00:19:24.274457+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:19:24.274457+0000","last_undegraded":"2024-09-12T00:19:24.274457+0000","last_fullsized":"2024-09-12T00:19:24.274457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:14.218218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.567592+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:22:33.567592+0000","last_peered":"2024-09-12T00:22:33.567592+0000","last_clean":"2024-09-12T00:22:33.567592+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:22:33.567592+0000","last_undegraded":"2024-09-12T00:22:33.567592+0000","last_fullsized":"2024-09-12T00:22:33.567592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950416+0000","last_change":"2024-09-12T00:18:46.215890+0000","last_active":"2024-09-12T00:20:55.950416+0000","last_peered":"2024-09-12T00:20:55.950416+0000","last_clean":"2024-09-12T00:20:55.950416+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:20:55.950416+0000","last_undegraded":"2024-09-12T00:20:55.950416+0000","last_fullsized":"2024-09-12T00:20:55.950416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.058569+0000","last_change":"2024-09-12T00:22:44.058569+0000","last_active":"2024-09-12T00:22:44.058569+0000","last_peered":"2024-09-12T00:22:44.058569+0000","last_clean":"2024-09-12T00:22:44.058569+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:44.058569+0000","last_undegraded":"2024-09-12T00:22:44.058569+0000","last_fullsized":"2024-09-12T00:22:44.058569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.058384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.669388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.675883+0000","last_change":"2024-09-12T00:22:37.675755+0000","last_active":"2024-09-12T00:22:37.675883+0000","last_peered":"2024-09-12T00:22:37.675883+0000","last_clean":"2024-09-12T00:22:37.675883+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:22:37.675883+0000","last_undegraded":"2024-09-12T00:22:37.675883+0000","last_fullsized":"2024-09-12T00:22:37.675883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.675639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:18.021676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605385+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:20:52.605385+0000","last_peered":"2024-09-12T00:20:52.605385+0000","last_clean":"2024-09-12T00:20:52.605385+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:20:52.605385+0000","last_undegraded":"2024-09-12T00:20:52.605385+0000","last_fullsized":"2024-09-12T00:20:52.605385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287632+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:19:24.287632+0000","last_peered":"2024-09-12T00:19:24.287632+0000","last_clean":"2024-09-12T00:19:24.287632+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:19:24.287632+0000","last_undegraded":"2024-09-12T00:19:24.287632+0000","last_fullsized":"2024-09-12T00:19:24.287632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:13.589684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":404,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.260341+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:33.260341+0000","last_peered":"2024-09-12T00:22:33.260341+0000","last_clean":"2024-09-12T00:22:33.260341+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:33.260341+0000","last_undegraded":"2024-09-12T00:22:33.260341+0000","last_fullsized":"2024-09-12T00:22:33.260341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:31.647959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.751001+0000","last_change":"2024-09-12T00:22:52.750826+0000","last_active":"2024-09-12T00:22:52.751001+0000","last_peered":"2024-09-12T00:22:52.751001+0000","last_clean":"2024-09-12T00:22:52.751001+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:52.751001+0000","last_undegraded":"2024-09-12T00:22:52.751001+0000","last_fullsized":"2024-09-12T00:22:52.751001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.750640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:43.087670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.284618+0000","last_change":"2024-09-12T00:22:37.284618+0000","last_active":"2024-09-12T00:22:37.284618+0000","last_peered":"2024-09-12T00:22:37.284618+0000","last_clean":"2024-09-12T00:22:37.284618+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:22:37.284618+0000","last_undegraded":"2024-09-12T00:22:37.284618+0000","last_fullsized":"2024-09-12T00:22:37.284618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.284374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:35.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.021196+0000","last_change":"2024-09-12T00:22:42.021039+0000","last_active":"2024-09-12T00:22:42.021196+0000","last_peered":"2024-09-12T00:22:42.021196+0000","last_clean":"2024-09-12T00:22:42.021196+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:22:42.021196+0000","last_undegraded":"2024-09-12T00:22:42.021196+0000","last_fullsized":"2024-09-12T00:22:42.021196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.020861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:34.147473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":230,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.225156+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:22:33.225156+0000","last_peered":"2024-09-12T00:22:33.225156+0000","last_clean":"2024-09-12T00:22:33.225156+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:22:33.225156+0000","last_undegraded":"2024-09-12T00:22:33.225156+0000","last_fullsized":"2024-09-12T00:22:33.225156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'98","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.534276+0000","last_change":"2024-09-12T00:18:50.216704+0000","last_active":"2024-09-12T00:22:33.534276+0000","last_peered":"2024-09-12T00:22:33.534276+0000","last_clean":"2024-09-12T00:22:33.534276+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:22:33.534276+0000","last_undegraded":"2024-09-12T00:22:33.534276+0000","last_fullsized":"2024-09-12T00:22:33.534276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:30.071191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.545585+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:19:24.545585+0000","last_peered":"2024-09-12T00:19:24.545585+0000","last_clean":"2024-09-12T00:19:24.545585+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:19:24.545585+0000","last_undegraded":"2024-09-12T00:19:24.545585+0000","last_fullsized":"2024-09-12T00:19:24.545585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.985554+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:01.985554+0000","last_peered":"2024-09-12T00:22:01.985554+0000","last_clean":"2024-09-12T00:22:01.985554+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:01.985554+0000","last_undegraded":"2024-09-12T00:22:01.985554+0000","last_fullsized":"2024-09-12T00:22:01.985554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:58.559812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904828+0000","last_change":"2024-09-12T00:18:46.189861+0000","last_active":"2024-09-12T00:22:01.904828+0000","last_peered":"2024-09-12T00:22:01.904828+0000","last_clean":"2024-09-12T00:22:01.904828+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:01.904828+0000","last_undegraded":"2024-09-12T00:22:01.904828+0000","last_fullsized":"2024-09-12T00:22:01.904828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:08.672048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.009865+0000","last_change":"2024-09-12T00:22:52.009865+0000","last_active":"2024-09-12T00:22:52.009865+0000","last_peered":"2024-09-12T00:22:52.009865+0000","last_clean":"2024-09-12T00:22:52.009865+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:22:52.009865+0000","last_undegraded":"2024-09-12T00:22:52.009865+0000","last_fullsized":"2024-09-12T00:22:52.009865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.009684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.867922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.279723+0000","last_change":"2024-09-12T00:18:48.216343+0000","last_active":"2024-09-12T00:19:24.279723+0000","last_peered":"2024-09-12T00:19:24.279723+0000","last_clean":"2024-09-12T00:19:24.279723+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:19:24.279723+0000","last_undegraded":"2024-09-12T00:19:24.279723+0000","last_fullsized":"2024-09-12T00:19:24.279723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:54.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.352149+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:22:33.352149+0000","last_peered":"2024-09-12T00:22:33.352149+0000","last_clean":"2024-09-12T00:22:33.352149+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:22:33.352149+0000","last_undegraded":"2024-09-12T00:22:33.352149+0000","last_fullsized":"2024-09-12T00:22:33.352149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.849090+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.849090+0000","last_peered":"2024-09-12T00:20:57.849090+0000","last_clean":"2024-09-12T00:20:57.849090+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.849090+0000","last_undegraded":"2024-09-12T00:20:57.849090+0000","last_fullsized":"2024-09-12T00:20:57.849090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.924187+0000","last_change":"2024-09-12T00:18:46.217714+0000","last_active":"2024-09-12T00:22:01.924187+0000","last_peered":"2024-09-12T00:22:01.924187+0000","last_clean":"2024-09-12T00:22:01.924187+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:01.924187+0000","last_undegraded":"2024-09-12T00:22:01.924187+0000","last_fullsized":"2024-09-12T00:22:01.924187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.779281+0000","last_change":"2024-09-12T00:22:42.779281+0000","last_active":"2024-09-12T00:22:42.779281+0000","last_peered":"2024-09-12T00:22:42.779281+0000","last_clean":"2024-09-12T00:22:42.779281+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:22:42.779281+0000","last_undegraded":"2024-09-12T00:22:42.779281+0000","last_fullsized":"2024-09-12T00:22:42.779281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.779092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.713311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.942747+0000","last_change":"2024-09-12T00:22:54.942747+0000","last_active":"2024-09-12T00:22:54.942747+0000","last_peered":"2024-09-12T00:22:54.942747+0000","last_clean":"2024-09-12T00:22:54.942747+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:54.942747+0000","last_undegraded":"2024-09-12T00:22:54.942747+0000","last_fullsized":"2024-09-12T00:22:54.942747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.942553+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:15.834853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.806286+0000","last_change":"2024-09-12T00:22:44.806286+0000","last_active":"2024-09-12T00:22:44.806286+0000","last_peered":"2024-09-12T00:22:44.806286+0000","last_clean":"2024-09-12T00:22:44.806286+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:22:44.806286+0000","last_undegraded":"2024-09-12T00:22:44.806286+0000","last_fullsized":"2024-09-12T00:22:44.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.806101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.067872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267773+0000","last_change":"2024-09-12T00:18:48.200680+0000","last_active":"2024-09-12T00:19:24.267773+0000","last_peered":"2024-09-12T00:19:24.267773+0000","last_clean":"2024-09-12T00:19:24.267773+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:19:24.267773+0000","last_undegraded":"2024-09-12T00:19:24.267773+0000","last_fullsized":"2024-09-12T00:19:24.267773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.567983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'45","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.497869+0000","last_change":"2024-09-12T00:18:50.224287+0000","last_active":"2024-09-12T00:22:33.497869+0000","last_peered":"2024-09-12T00:22:33.497869+0000","last_clean":"2024-09-12T00:22:33.497869+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:22:33.497869+0000","last_undegraded":"2024-09-12T00:22:33.497869+0000","last_fullsized":"2024-09-12T00:22:33.497869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.705857+0000","last_change":"2024-09-12T00:18:46.214462+0000","last_active":"2024-09-12T00:22:01.705857+0000","last_peered":"2024-09-12T00:22:01.705857+0000","last_clean":"2024-09-12T00:22:01.705857+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:22:01.705857+0000","last_undegraded":"2024-09-12T00:22:01.705857+0000","last_fullsized":"2024-09-12T00:22:01.705857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:37.657684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.300694+0000","last_change":"2024-09-12T00:22:39.300694+0000","last_active":"2024-09-12T00:22:39.300694+0000","last_peered":"2024-09-12T00:22:39.300694+0000","last_clean":"2024-09-12T00:22:39.300694+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:39.300694+0000","last_undegraded":"2024-09-12T00:22:39.300694+0000","last_fullsized":"2024-09-12T00:22:39.300694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.300502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:21.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'33","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.472919+0000","last_change":"2024-09-12T00:18:50.204600+0000","last_active":"2024-09-12T00:22:33.472919+0000","last_peered":"2024-09-12T00:22:33.472919+0000","last_clean":"2024-09-12T00:22:33.472919+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:22:33.472919+0000","last_undegraded":"2024-09-12T00:22:33.472919+0000","last_fullsized":"2024-09-12T00:22:33.472919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:18.942466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703498+0000","last_change":"2024-09-12T00:18:46.191419+0000","last_active":"2024-09-12T00:22:01.703498+0000","last_peered":"2024-09-12T00:22:01.703498+0000","last_clean":"2024-09-12T00:22:01.703498+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:22:01.703498+0000","last_undegraded":"2024-09-12T00:22:01.703498+0000","last_fullsized":"2024-09-12T00:22:01.703498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.034956+0000","last_change":"2024-09-12T00:22:53.034956+0000","last_active":"2024-09-12T00:22:53.034956+0000","last_peered":"2024-09-12T00:22:53.034956+0000","last_clean":"2024-09-12T00:22:53.034956+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:22:53.034956+0000","last_undegraded":"2024-09-12T00:22:53.034956+0000","last_fullsized":"2024-09-12T00:22:53.034956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.034651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:57.265344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:47.595959+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:20:47.595959+0000","last_peered":"2024-09-12T00:20:47.595959+0000","last_clean":"2024-09-12T00:20:47.595959+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:20:47.595959+0000","last_undegraded":"2024-09-12T00:20:47.595959+0000","last_fullsized":"2024-09-12T00:20:47.595959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'66","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.467902+0000","last_change":"2024-09-12T00:18:50.216262+0000","last_active":"2024-09-12T00:22:33.467902+0000","last_peered":"2024-09-12T00:22:33.467902+0000","last_clean":"2024-09-12T00:22:33.467902+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:22:33.467902+0000","last_undegraded":"2024-09-12T00:22:33.467902+0000","last_fullsized":"2024-09-12T00:22:33.467902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.733268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'15","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.251484+0000","last_change":"2024-09-12T00:18:46.211034+0000","last_active":"2024-09-12T00:22:02.251484+0000","last_peered":"2024-09-12T00:22:02.251484+0000","last_clean":"2024-09-12T00:22:02.251484+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:22:02.251484+0000","last_undegraded":"2024-09-12T00:22:02.251484+0000","last_fullsized":"2024-09-12T00:22:02.251484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.306113+0000","last_change":"2024-09-12T00:22:40.306113+0000","last_active":"2024-09-12T00:22:40.306113+0000","last_peered":"2024-09-12T00:22:40.306113+0000","last_clean":"2024-09-12T00:22:40.306113+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:22:40.306113+0000","last_undegraded":"2024-09-12T00:22:40.306113+0000","last_fullsized":"2024-09-12T00:22:40.306113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.305907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.508780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.593974+0000","last_change":"2024-09-12T00:19:24.291735+0000","last_active":"2024-09-12T00:20:52.593974+0000","last_peered":"2024-09-12T00:20:52.593974+0000","last_clean":"2024-09-12T00:20:52.593974+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:20:52.593974+0000","last_undegraded":"2024-09-12T00:20:52.593974+0000","last_fullsized":"2024-09-12T00:20:52.593974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'40","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.479270+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:22:33.479270+0000","last_peered":"2024-09-12T00:22:33.479270+0000","last_clean":"2024-09-12T00:22:33.479270+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:22:33.479270+0000","last_undegraded":"2024-09-12T00:22:33.479270+0000","last_fullsized":"2024-09-12T00:22:33.479270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.520849+0000","last_change":"2024-09-12T00:18:46.214392+0000","last_active":"2024-09-12T00:22:01.520849+0000","last_peered":"2024-09-12T00:22:01.520849+0000","last_clean":"2024-09-12T00:22:01.520849+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:22:01.520849+0000","last_undegraded":"2024-09-12T00:22:01.520849+0000","last_fullsized":"2024-09-12T00:22:01.520849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:50.180192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.385967+0000","last_change":"2024-09-12T00:22:42.385967+0000","last_active":"2024-09-12T00:22:42.385967+0000","last_peered":"2024-09-12T00:22:42.385967+0000","last_clean":"2024-09-12T00:22:42.385967+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:22:42.385967+0000","last_undegraded":"2024-09-12T00:22:42.385967+0000","last_fullsized":"2024-09-12T00:22:42.385967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.385774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:36.864966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276461+0000","last_change":"2024-09-12T00:18:48.196567+0000","last_active":"2024-09-12T00:19:24.276461+0000","last_peered":"2024-09-12T00:19:24.276461+0000","last_clean":"2024-09-12T00:19:24.276461+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:19:24.276461+0000","last_undegraded":"2024-09-12T00:19:24.276461+0000","last_fullsized":"2024-09-12T00:19:24.276461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:59.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.374632+0000","last_change":"2024-09-12T00:18:50.222960+0000","last_active":"2024-09-12T00:22:33.374632+0000","last_peered":"2024-09-12T00:22:33.374632+0000","last_clean":"2024-09-12T00:22:33.374632+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:22:33.374632+0000","last_undegraded":"2024-09-12T00:22:33.374632+0000","last_fullsized":"2024-09-12T00:22:33.374632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:40.015121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597248+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:20:52.597248+0000","last_peered":"2024-09-12T00:20:52.597248+0000","last_clean":"2024-09-12T00:20:52.597248+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:20:52.597248+0000","last_undegraded":"2024-09-12T00:20:52.597248+0000","last_fullsized":"2024-09-12T00:20:52.597248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.936957+0000","last_change":"2024-09-12T00:22:55.936957+0000","last_active":"2024-09-12T00:22:55.936957+0000","last_peered":"2024-09-12T00:22:55.936957+0000","last_clean":"2024-09-12T00:22:55.936957+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:55.936957+0000","last_undegraded":"2024-09-12T00:22:55.936957+0000","last_fullsized":"2024-09-12T00:22:55.936957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.936751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.262382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.067458+0000","last_change":"2024-09-12T00:22:54.067458+0000","last_active":"2024-09-12T00:22:54.067458+0000","last_peered":"2024-09-12T00:22:54.067458+0000","last_clean":"2024-09-12T00:22:54.067458+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:22:54.067458+0000","last_undegraded":"2024-09-12T00:22:54.067458+0000","last_fullsized":"2024-09-12T00:22:54.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.067268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:29.961955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605672+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:20:52.605672+0000","last_peered":"2024-09-12T00:20:52.605672+0000","last_clean":"2024-09-12T00:20:52.605672+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:20:52.605672+0000","last_undegraded":"2024-09-12T00:20:52.605672+0000","last_fullsized":"2024-09-12T00:20:52.605672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":371,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.246267+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:22:33.246267+0000","last_peered":"2024-09-12T00:22:33.246267+0000","last_clean":"2024-09-12T00:22:33.246267+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:22:33.246267+0000","last_undegraded":"2024-09-12T00:22:33.246267+0000","last_fullsized":"2024-09-12T00:22:33.246267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:47.656746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904775+0000","last_change":"2024-09-12T00:18:46.184978+0000","last_active":"2024-09-12T00:22:01.904775+0000","last_peered":"2024-09-12T00:22:01.904775+0000","last_clean":"2024-09-12T00:22:01.904775+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:22:01.904775+0000","last_undegraded":"2024-09-12T00:22:01.904775+0000","last_fullsized":"2024-09-12T00:22:01.904775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:34.862818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.393154+0000","last_change":"2024-09-12T00:22:43.393154+0000","last_active":"2024-09-12T00:22:43.393154+0000","last_peered":"2024-09-12T00:22:43.393154+0000","last_clean":"2024-09-12T00:22:43.393154+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:22:43.393154+0000","last_undegraded":"2024-09-12T00:22:43.393154+0000","last_fullsized":"2024-09-12T00:22:43.393154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.392968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:10.459069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274386+0000","last_change":"2024-09-12T00:18:48.218098+0000","last_active":"2024-09-12T00:19:24.274386+0000","last_peered":"2024-09-12T00:19:24.274386+0000","last_clean":"2024-09-12T00:19:24.274386+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:19:24.274386+0000","last_undegraded":"2024-09-12T00:19:24.274386+0000","last_fullsized":"2024-09-12T00:19:24.274386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.133530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'66","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.416826+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:22:33.416826+0000","last_peered":"2024-09-12T00:22:33.416826+0000","last_clean":"2024-09-12T00:22:33.416826+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:22:33.416826+0000","last_undegraded":"2024-09-12T00:22:33.416826+0000","last_fullsized":"2024-09-12T00:22:33.416826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.110848+0000","last_change":"2024-09-12T00:18:46.184999+0000","last_active":"2024-09-12T00:22:02.110848+0000","last_peered":"2024-09-12T00:22:02.110848+0000","last_clean":"2024-09-12T00:22:02.110848+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:22:02.110848+0000","last_undegraded":"2024-09-12T00:22:02.110848+0000","last_fullsized":"2024-09-12T00:22:02.110848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:18.034219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.088790+0000","last_change":"2024-09-12T00:22:55.088790+0000","last_active":"2024-09-12T00:22:55.088790+0000","last_peered":"2024-09-12T00:22:55.088790+0000","last_clean":"2024-09-12T00:22:55.088790+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:55.088790+0000","last_undegraded":"2024-09-12T00:22:55.088790+0000","last_fullsized":"2024-09-12T00:22:55.088790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.088613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:30.497345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271547+0000","last_change":"2024-09-12T00:18:48.208202+0000","last_active":"2024-09-12T00:19:24.271547+0000","last_peered":"2024-09-12T00:19:24.271547+0000","last_clean":"2024-09-12T00:19:24.271547+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:19:24.271547+0000","last_undegraded":"2024-09-12T00:19:24.271547+0000","last_fullsized":"2024-09-12T00:19:24.271547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.859052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'40","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.426637+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:22:33.426637+0000","last_peered":"2024-09-12T00:22:33.426637+0000","last_clean":"2024-09-12T00:22:33.426637+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:22:33.426637+0000","last_undegraded":"2024-09-12T00:22:33.426637+0000","last_fullsized":"2024-09-12T00:22:33.426637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.903921+0000","last_change":"2024-09-12T00:18:46.183379+0000","last_active":"2024-09-12T00:22:01.903921+0000","last_peered":"2024-09-12T00:22:01.903921+0000","last_clean":"2024-09-12T00:22:01.903921+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:22:01.903921+0000","last_undegraded":"2024-09-12T00:22:01.903921+0000","last_fullsized":"2024-09-12T00:22:01.903921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:35.985414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.782465+0000","last_change":"2024-09-12T00:22:40.782298+0000","last_active":"2024-09-12T00:22:40.782465+0000","last_peered":"2024-09-12T00:22:40.782465+0000","last_clean":"2024-09-12T00:22:40.782465+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:22:40.782465+0000","last_undegraded":"2024-09-12T00:22:40.782465+0000","last_fullsized":"2024-09-12T00:22:40.782465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.782108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.669423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.271418+0000","last_change":"2024-09-12T00:18:48.211981+0000","last_active":"2024-09-12T00:19:24.271418+0000","last_peered":"2024-09-12T00:19:24.271418+0000","last_clean":"2024-09-12T00:19:24.271418+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:19:24.271418+0000","last_undegraded":"2024-09-12T00:19:24.271418+0000","last_fullsized":"2024-09-12T00:19:24.271418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:50.283368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'35","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.360679+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:22:33.360679+0000","last_peered":"2024-09-12T00:22:33.360679+0000","last_clean":"2024-09-12T00:22:33.360679+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:22:33.360679+0000","last_undegraded":"2024-09-12T00:22:33.360679+0000","last_fullsized":"2024-09-12T00:22:33.360679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'3","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.703821+0000","last_change":"2024-09-12T00:18:46.183984+0000","last_active":"2024-09-12T00:22:01.703821+0000","last_peered":"2024-09-12T00:22:01.703821+0000","last_clean":"2024-09-12T00:22:01.703821+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:01.703821+0000","last_undegraded":"2024-09-12T00:22:01.703821+0000","last_fullsized":"2024-09-12T00:22:01.703821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:51.504748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.419905+0000","last_change":"2024-09-12T00:22:44.419775+0000","last_active":"2024-09-12T00:22:44.419905+0000","last_peered":"2024-09-12T00:22:44.419905+0000","last_clean":"2024-09-12T00:22:44.419905+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:22:44.419905+0000","last_undegraded":"2024-09-12T00:22:44.419905+0000","last_fullsized":"2024-09-12T00:22:44.419905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.419592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:33.207405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:56.491323+0000","last_change":"2024-09-12T00:18:48.204166+0000","last_active":"2024-09-12T00:20:56.491323+0000","last_peered":"2024-09-12T00:20:56.491323+0000","last_clean":"2024-09-12T00:20:56.491323+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:20:56.491323+0000","last_undegraded":"2024-09-12T00:20:56.491323+0000","last_fullsized":"2024-09-12T00:20:56.491323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:36.533140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'47","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.378393+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:33.378393+0000","last_peered":"2024-09-12T00:22:33.378393+0000","last_clean":"2024-09-12T00:22:33.378393+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:33.378393+0000","last_undegraded":"2024-09-12T00:22:33.378393+0000","last_fullsized":"2024-09-12T00:22:33.378393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.364160+0000","last_change":"2024-09-12T00:22:56.364160+0000","last_active":"2024-09-12T00:22:56.364160+0000","last_peered":"2024-09-12T00:22:56.364160+0000","last_clean":"2024-09-12T00:22:56.364160+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:22:56.364160+0000","last_undegraded":"2024-09-12T00:22:56.364160+0000","last_fullsized":"2024-09-12T00:22:56.364160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.363976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.256275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.797911+0000","last_change":"2024-09-12T00:22:45.797737+0000","last_active":"2024-09-12T00:22:45.797911+0000","last_peered":"2024-09-12T00:22:45.797911+0000","last_clean":"2024-09-12T00:22:45.797911+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:22:45.797911+0000","last_undegraded":"2024-09-12T00:22:45.797911+0000","last_fullsized":"2024-09-12T00:22:45.797911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.797484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:00.294956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521595+0000","last_change":"2024-09-12T00:18:46.199022+0000","last_active":"2024-09-12T00:22:01.521595+0000","last_peered":"2024-09-12T00:22:01.521595+0000","last_clean":"2024-09-12T00:22:01.521595+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:22:01.521595+0000","last_undegraded":"2024-09-12T00:22:01.521595+0000","last_fullsized":"2024-09-12T00:22:01.521595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:13.922738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.857883+0000","last_change":"2024-09-12T00:22:44.857717+0000","last_active":"2024-09-12T00:22:44.857883+0000","last_peered":"2024-09-12T00:22:44.857883+0000","last_clean":"2024-09-12T00:22:44.857883+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:22:44.857883+0000","last_undegraded":"2024-09-12T00:22:44.857883+0000","last_fullsized":"2024-09-12T00:22:44.857883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.857528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:34.268174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.780507+0000","last_change":"2024-09-12T00:18:46.188983+0000","last_active":"2024-09-12T00:21:00.780507+0000","last_peered":"2024-09-12T00:21:00.780507+0000","last_clean":"2024-09-12T00:21:00.780507+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:21:00.780507+0000","last_undegraded":"2024-09-12T00:21:00.780507+0000","last_fullsized":"2024-09-12T00:21:00.780507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.278021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.064313+0000","last_change":"2024-09-12T00:22:56.064142+0000","last_active":"2024-09-12T00:22:56.064313+0000","last_peered":"2024-09-12T00:22:56.064313+0000","last_clean":"2024-09-12T00:22:56.064313+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:22:56.064313+0000","last_undegraded":"2024-09-12T00:22:56.064313+0000","last_fullsized":"2024-09-12T00:22:56.064313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.063956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.325584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.020857+0000","last_change":"2024-09-12T00:18:46.199070+0000","last_active":"2024-09-12T00:22:02.020857+0000","last_peered":"2024-09-12T00:22:02.020857+0000","last_clean":"2024-09-12T00:22:02.020857+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:22:02.020857+0000","last_undegraded":"2024-09-12T00:22:02.020857+0000","last_fullsized":"2024-09-12T00:22:02.020857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:42.445286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.951519+0000","last_change":"2024-09-12T00:22:51.951351+0000","last_active":"2024-09-12T00:22:51.951519+0000","last_peered":"2024-09-12T00:22:51.951519+0000","last_clean":"2024-09-12T00:22:51.951519+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:22:51.951519+0000","last_undegraded":"2024-09-12T00:22:51.951519+0000","last_fullsized":"2024-09-12T00:22:51.951519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.951154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:49.515044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.111959+0000","last_change":"2024-09-12T00:18:46.195536+0000","last_active":"2024-09-12T00:22:02.111959+0000","last_peered":"2024-09-12T00:22:02.111959+0000","last_clean":"2024-09-12T00:22:02.111959+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:02.111959+0000","last_undegraded":"2024-09-12T00:22:02.111959+0000","last_fullsized":"2024-09-12T00:22:02.111959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.860535+0000","last_change":"2024-09-12T00:22:47.860535+0000","last_active":"2024-09-12T00:22:47.860535+0000","last_peered":"2024-09-12T00:22:47.860535+0000","last_clean":"2024-09-12T00:22:47.860535+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:22:47.860535+0000","last_undegraded":"2024-09-12T00:22:47.860535+0000","last_fullsized":"2024-09-12T00:22:47.860535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.860353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.356404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.351486+0000","last_change":"2024-09-12T00:22:57.351196+0000","last_active":"2024-09-12T00:22:57.351486+0000","last_peered":"2024-09-12T00:22:57.351486+0000","last_clean":"2024-09-12T00:22:57.351486+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:57.351486+0000","last_undegraded":"2024-09-12T00:22:57.351486+0000","last_fullsized":"2024-09-12T00:22:57.351486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.350978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:29.676609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.418904+0000","last_change":"2024-09-12T00:22:45.418904+0000","last_active":"2024-09-12T00:22:45.418904+0000","last_peered":"2024-09-12T00:22:45.418904+0000","last_clean":"2024-09-12T00:22:45.418904+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:22:45.418904+0000","last_undegraded":"2024-09-12T00:22:45.418904+0000","last_fullsized":"2024-09-12T00:22:45.418904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.418677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:28.543265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.035718+0000","last_change":"2024-09-12T00:18:46.210908+0000","last_active":"2024-09-12T00:22:02.035718+0000","last_peered":"2024-09-12T00:22:02.035718+0000","last_clean":"2024-09-12T00:22:02.035718+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:22:02.035718+0000","last_undegraded":"2024-09-12T00:22:02.035718+0000","last_fullsized":"2024-09-12T00:22:02.035718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.760728+0000","last_change":"2024-09-12T00:22:46.760728+0000","last_active":"2024-09-12T00:22:46.760728+0000","last_peered":"2024-09-12T00:22:46.760728+0000","last_clean":"2024-09-12T00:22:46.760728+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:22:46.760728+0000","last_undegraded":"2024-09-12T00:22:46.760728+0000","last_fullsized":"2024-09-12T00:22:46.760728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.760505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:03.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.411438+0000","last_change":"2024-09-12T00:22:55.411268+0000","last_active":"2024-09-12T00:22:55.411438+0000","last_peered":"2024-09-12T00:22:55.411438+0000","last_clean":"2024-09-12T00:22:55.411438+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:55.411438+0000","last_undegraded":"2024-09-12T00:22:55.411438+0000","last_fullsized":"2024-09-12T00:22:55.411438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.411085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.955659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.837801+0000","last_change":"2024-09-12T00:22:43.837801+0000","last_active":"2024-09-12T00:22:43.837801+0000","last_peered":"2024-09-12T00:22:43.837801+0000","last_clean":"2024-09-12T00:22:43.837801+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:22:43.837801+0000","last_undegraded":"2024-09-12T00:22:43.837801+0000","last_fullsized":"2024-09-12T00:22:43.837801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.837619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:26.962207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.018907+0000","last_change":"2024-09-12T00:18:46.201393+0000","last_active":"2024-09-12T00:22:02.018907+0000","last_peered":"2024-09-12T00:22:02.018907+0000","last_clean":"2024-09-12T00:22:02.018907+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:22:02.018907+0000","last_undegraded":"2024-09-12T00:22:02.018907+0000","last_fullsized":"2024-09-12T00:22:02.018907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:13.149208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277355+0000","last_change":"2024-09-12T00:18:44.216635+0000","last_active":"2024-09-12T00:19:24.277355+0000","last_peered":"2024-09-12T00:19:24.277355+0000","last_clean":"2024-09-12T00:19:24.277355+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:19:24.277355+0000","last_undegraded":"2024-09-12T00:19:24.277355+0000","last_fullsized":"2024-09-12T00:19:24.277355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:50.723598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.828950+0000","last_change":"2024-09-12T00:22:45.828950+0000","last_active":"2024-09-12T00:22:45.828950+0000","last_peered":"2024-09-12T00:22:45.828950+0000","last_clean":"2024-09-12T00:22:45.828950+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:22:45.828950+0000","last_undegraded":"2024-09-12T00:22:45.828950+0000","last_fullsized":"2024-09-12T00:22:45.828950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.828769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.446702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.548033+0000","last_change":"2024-09-12T00:18:46.198204+0000","last_active":"2024-09-12T00:19:24.548033+0000","last_peered":"2024-09-12T00:19:24.548033+0000","last_clean":"2024-09-12T00:19:24.548033+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:19:24.548033+0000","last_undegraded":"2024-09-12T00:19:24.548033+0000","last_fullsized":"2024-09-12T00:19:24.548033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.029182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.388768+0000","last_change":"2024-09-12T00:22:46.388768+0000","last_active":"2024-09-12T00:22:46.388768+0000","last_peered":"2024-09-12T00:22:46.388768+0000","last_clean":"2024-09-12T00:22:46.388768+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:22:46.388768+0000","last_undegraded":"2024-09-12T00:22:46.388768+0000","last_fullsized":"2024-09-12T00:22:46.388768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.388580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:18.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.800593+0000","last_change":"2024-09-12T00:18:46.206094+0000","last_active":"2024-09-12T00:21:00.800593+0000","last_peered":"2024-09-12T00:21:00.800593+0000","last_clean":"2024-09-12T00:21:00.800593+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:21:00.800593+0000","last_undegraded":"2024-09-12T00:21:00.800593+0000","last_fullsized":"2024-09-12T00:21:00.800593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:54.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.405301+0000","last_change":"2024-09-12T00:22:47.405301+0000","last_active":"2024-09-12T00:22:47.405301+0000","last_peered":"2024-09-12T00:22:47.405301+0000","last_clean":"2024-09-12T00:22:47.405301+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:22:47.405301+0000","last_undegraded":"2024-09-12T00:22:47.405301+0000","last_fullsized":"2024-09-12T00:22:47.405301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.405108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:56.440895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.521751+0000","last_change":"2024-09-12T00:19:24.549151+0000","last_active":"2024-09-12T00:22:01.521751+0000","last_peered":"2024-09-12T00:22:01.521751+0000","last_clean":"2024-09-12T00:22:01.521751+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:01.521751+0000","last_undegraded":"2024-09-12T00:22:01.521751+0000","last_fullsized":"2024-09-12T00:22:01.521751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:25.450062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.085427+0000","last_change":"2024-09-12T00:22:57.085427+0000","last_active":"2024-09-12T00:22:57.085427+0000","last_peered":"2024-09-12T00:22:57.085427+0000","last_clean":"2024-09-12T00:22:57.085427+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:22:57.085427+0000","last_undegraded":"2024-09-12T00:22:57.085427+0000","last_fullsized":"2024-09-12T00:22:57.085427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.085239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.771180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600242+0000","last_change":"2024-09-12T00:18:46.203607+0000","last_active":"2024-09-12T00:21:02.600242+0000","last_peered":"2024-09-12T00:21:02.600242+0000","last_clean":"2024-09-12T00:21:02.600242+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:21:02.600242+0000","last_undegraded":"2024-09-12T00:21:02.600242+0000","last_fullsized":"2024-09-12T00:21:02.600242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:01.158629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.255211+0000","last_change":"2024-09-12T00:18:44.205642+0000","last_active":"2024-09-12T00:20:15.255211+0000","last_peered":"2024-09-12T00:20:15.255211+0000","last_clean":"2024-09-12T00:20:15.255211+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:20:15.255211+0000","last_undegraded":"2024-09-12T00:20:15.255211+0000","last_fullsized":"2024-09-12T00:20:15.255211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.988420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:55.950179+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:20:55.950179+0000","last_peered":"2024-09-12T00:20:55.950179+0000","last_clean":"2024-09-12T00:20:55.950179+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:20:55.950179+0000","last_undegraded":"2024-09-12T00:20:55.950179+0000","last_fullsized":"2024-09-12T00:20:55.950179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.726847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.779560+0000","last_change":"2024-09-12T00:22:47.779560+0000","last_active":"2024-09-12T00:22:47.779560+0000","last_peered":"2024-09-12T00:22:47.779560+0000","last_clean":"2024-09-12T00:22:47.779560+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:22:47.779560+0000","last_undegraded":"2024-09-12T00:22:47.779560+0000","last_fullsized":"2024-09-12T00:22:47.779560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.779379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.921779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.270885+0000","last_change":"2024-09-12T00:18:46.210796+0000","last_active":"2024-09-12T00:19:24.270885+0000","last_peered":"2024-09-12T00:19:24.270885+0000","last_clean":"2024-09-12T00:19:24.270885+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:19:24.270885+0000","last_undegraded":"2024-09-12T00:19:24.270885+0000","last_fullsized":"2024-09-12T00:19:24.270885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.257930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.299482+0000","last_change":"2024-09-12T00:18:44.216498+0000","last_active":"2024-09-12T00:19:24.299482+0000","last_peered":"2024-09-12T00:19:24.299482+0000","last_clean":"2024-09-12T00:19:24.299482+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:19:24.299482+0000","last_undegraded":"2024-09-12T00:19:24.299482+0000","last_fullsized":"2024-09-12T00:19:24.299482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.498751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.215514+0000","last_change":"2024-09-12T00:18:44.216871+0000","last_active":"2024-09-12T00:19:30.215514+0000","last_peered":"2024-09-12T00:19:30.215514+0000","last_clean":"2024-09-12T00:19:30.215514+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:19:30.215514+0000","last_undegraded":"2024-09-12T00:19:30.215514+0000","last_fullsized":"2024-09-12T00:19:30.215514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:43.144790+0000","last_clean_scrub_stamp":"2024-09-12T00:18:43.144790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:27.835553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.093904+0000","last_change":"2024-09-12T00:18:46.211819+0000","last_active":"2024-09-12T00:22:02.093904+0000","last_peered":"2024-09-12T00:22:02.093904+0000","last_clean":"2024-09-12T00:22:02.093904+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:22:02.093904+0000","last_undegraded":"2024-09-12T00:22:02.093904+0000","last_fullsized":"2024-09-12T00:22:02.093904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.579328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.887896+0000","last_change":"2024-09-12T00:22:49.887896+0000","last_active":"2024-09-12T00:22:49.887896+0000","last_peered":"2024-09-12T00:22:49.887896+0000","last_clean":"2024-09-12T00:22:49.887896+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:22:49.887896+0000","last_undegraded":"2024-09-12T00:22:49.887896+0000","last_fullsized":"2024-09-12T00:22:49.887896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.887620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.787219+0000","last_change":"2024-09-12T00:18:46.217286+0000","last_active":"2024-09-12T00:19:31.787219+0000","last_peered":"2024-09-12T00:19:31.787219+0000","last_clean":"2024-09-12T00:19:31.787219+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:19:31.787219+0000","last_undegraded":"2024-09-12T00:19:31.787219+0000","last_fullsized":"2024-09-12T00:19:31.787219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.834988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1571,"ondisk_log_size":1571,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705721,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":150916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":737144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705722,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":737488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":149912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:22:58.939 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.940 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.941 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.942 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.943 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.944 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.945 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.946 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.947 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.948 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.949 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.950 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.951 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.952 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.953 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.954 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.955 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.956 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.957 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.958 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.959 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.960 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.961 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:18:43.144790+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.962 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.962 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:22:58.962 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:23:18.963 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:23:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f032a567640 1 Processor -- start 2024-09-12T00:23:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f032a567640 1 -- start start 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f032a567640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03241162e0 0x7f03241347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f032a567640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0324115530 con 0x7f032412f1a0 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f032a567640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0324116c40 con 0x7f03241162e0 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f03237fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03241162e0 0x7f03241347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f0323fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f032412f1a0 0x7f032412f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57176/0 (socket says 172.21.15.31:57176) 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f0323fff640 1 -- 172.21.15.31:0/1723655503 learned_addr learned my addr 172.21.15.31:0/1723655503 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f03237fe640 1 -- 172.21.15.31:0/1723655503 >> v1:172.21.15.31:6789/0 conn(0x7f032412f1a0 legacy=0x7f032412f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:19.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.095+0000 7f03237fe640 1 -- 172.21.15.31:0/1723655503 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0324073760 con 0x7f03241162e0 2024-09-12T00:23:19.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f03237fe640 1 --2- 172.21.15.31:0/1723655503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f03241347a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0318009740 tx=0x7f031801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fe3b8ffffba3a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:19.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0322ffd640 1 -- 172.21.15.31:0/1723655503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03180b0070 con 0x7f03241162e0 2024-09-12T00:23:19.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0322ffd640 1 -- 172.21.15.31:0/1723655503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03180ab530 con 0x7f03241162e0 2024-09-12T00:23:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0322ffd640 1 -- 172.21.15.31:0/1723655503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03180ab830 con 0x7f03241162e0 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/1723655503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 msgr2=0x7f03241347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 --2- 172.21.15.31:0/1723655503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f03241347a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0318009740 tx=0x7f031801c370 comp rx=0 tx=0).stop 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/1723655503 shutdown_connections 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 --2- 172.21.15.31:0/1723655503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f03241347a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/1723655503 >> 172.21.15.31:0/1723655503 conn(0x7f032406f380 msgr2=0x7f03240717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/1723655503 shutdown_connections 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/1723655503 wait complete. 2024-09-12T00:23:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 Processor -- start 2024-09-12T00:23:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- start start 2024-09-12T00:23:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f03241378c0 con 0x7f03241162e0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0323fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0323fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60774/0 (socket says 172.21.15.31:60774) 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0323fff640 1 -- 172.21.15.31:0/3981912062 learned_addr learned my addr 172.21.15.31:0/3981912062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0323fff640 1 -- 172.21.15.31:0/3981912062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0324132120 con 0x7f03241162e0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0323fff640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f031400c450 tx=0x7f031400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0314017070 con 0x7f03241162e0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314005c20 con 0x7f03241162e0 2024-09-12T00:23:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0324133490 con 0x7f03241162e0 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03140070d0 con 0x7f03241162e0 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.099+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03241311e0 con 0x7f03241162e0 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0324076880 con 0x7f03241162e0 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f031401a070 con 0x7f03241162e0 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f0320ff9640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 0x7f031003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:19.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f031404efe0 con 0x7f03241162e0 2024-09-12T00:23:19.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f03237fe640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 0x7f031003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:19.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.103+0000 7f03237fe640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 0x7f031003d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f03180ad000 tx=0x7f03180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.107+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0324115530 con 0x7f03241162e0 2024-09-12T00:23:19.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.275+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0324131470 con 0x7f031003b1d0 2024-09-12T00:23:19.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.307+0000 7f0320ff9640 1 -- 172.21.15.31:0/3981912062 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664460 (secure 0 0 0) 0x7f0324131470 con 0x7f031003b1d0 2024-09-12T00:23:19.314 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:23:19.322 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 msgr2=0x7f031003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 0x7f031003d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f03180ad000 tx=0x7f03180a6000 comp rx=0 tx=0).stop 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 msgr2=0x7f0324130ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f031400c450 tx=0x7f031400c910 comp rx=0 tx=0).stop 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 shutdown_connections 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f031003b1d0 0x7f031003d690 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 --2- 172.21.15.31:0/3981912062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03241162e0 0x7f0324130ad0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:19.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 >> 172.21.15.31:0/3981912062 conn(0x7f032406f380 msgr2=0x7f0324071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:23:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 shutdown_connections 2024-09-12T00:23:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:19.315+0000 7f032a567640 1 -- 172.21.15.31:0/3981912062 wait complete. 2024-09-12T00:23:19.336 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-12T00:23:18.639781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5401,"num_read_kb":4955,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4849,"ondisk_log_size":4849,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160896,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326464,"statfs":{"total":386547056640,"available":386382299136,"internally_reserved":0,"allocated":2949120,"data_stored":1775460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":161736473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005866"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.776360+0000","last_change":"2024-09-12T00:22:51.776190+0000","last_active":"2024-09-12T00:22:51.776360+0000","last_peered":"2024-09-12T00:22:51.776360+0000","last_clean":"2024-09-12T00:22:51.776360+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:22:51.776360+0000","last_undegraded":"2024-09-12T00:22:51.776360+0000","last_fullsized":"2024-09-12T00:22:51.776360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.776007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.205681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.318599+0000","last_change":"2024-09-12T00:23:08.318599+0000","last_active":"2024-09-12T00:23:08.318599+0000","last_peered":"2024-09-12T00:23:08.318599+0000","last_clean":"2024-09-12T00:23:08.318599+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:23:08.318599+0000","last_undegraded":"2024-09-12T00:23:08.318599+0000","last_fullsized":"2024-09-12T00:23:08.318599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.318428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:11.398771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.963190+0000","last_change":"2024-09-12T00:22:53.963022+0000","last_active":"2024-09-12T00:22:53.963190+0000","last_peered":"2024-09-12T00:22:53.963190+0000","last_clean":"2024-09-12T00:22:53.963190+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:22:53.963190+0000","last_undegraded":"2024-09-12T00:22:53.963190+0000","last_fullsized":"2024-09-12T00:22:53.963190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.962810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:20.507384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.017600+0000","last_change":"2024-09-12T00:18:46.196463+0000","last_active":"2024-09-12T00:22:02.017600+0000","last_peered":"2024-09-12T00:22:02.017600+0000","last_clean":"2024-09-12T00:22:02.017600+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:22:02.017600+0000","last_undegraded":"2024-09-12T00:22:02.017600+0000","last_fullsized":"2024-09-12T00:22:02.017600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:48.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.128441+0000","last_change":"2024-09-12T00:23:06.128441+0000","last_active":"2024-09-12T00:23:06.128441+0000","last_peered":"2024-09-12T00:23:06.128441+0000","last_clean":"2024-09-12T00:23:06.128441+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:23:06.128441+0000","last_undegraded":"2024-09-12T00:23:06.128441+0000","last_fullsized":"2024-09-12T00:23:06.128441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.128258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.765425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.288005+0000","last_change":"2024-09-12T00:18:46.183842+0000","last_active":"2024-09-12T00:19:24.288005+0000","last_peered":"2024-09-12T00:19:24.288005+0000","last_clean":"2024-09-12T00:19:24.288005+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:19:24.288005+0000","last_undegraded":"2024-09-12T00:19:24.288005+0000","last_fullsized":"2024-09-12T00:19:24.288005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:45.045001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.765815+0000","last_change":"2024-09-12T00:22:50.765815+0000","last_active":"2024-09-12T00:22:50.765815+0000","last_peered":"2024-09-12T00:22:50.765815+0000","last_clean":"2024-09-12T00:22:50.765815+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:50.765815+0000","last_undegraded":"2024-09-12T00:22:50.765815+0000","last_fullsized":"2024-09-12T00:22:50.765815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.765631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:43.898814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.996245+0000","last_change":"2024-09-12T00:18:46.183722+0000","last_active":"2024-09-12T00:19:30.996245+0000","last_peered":"2024-09-12T00:19:30.996245+0000","last_clean":"2024-09-12T00:19:30.996245+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:19:30.996245+0000","last_undegraded":"2024-09-12T00:19:30.996245+0000","last_fullsized":"2024-09-12T00:19:30.996245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:05.293132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.117840+0000","last_change":"2024-09-12T00:23:04.117840+0000","last_active":"2024-09-12T00:23:04.117840+0000","last_peered":"2024-09-12T00:23:04.117840+0000","last_clean":"2024-09-12T00:23:04.117840+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:23:04.117840+0000","last_undegraded":"2024-09-12T00:23:04.117840+0000","last_fullsized":"2024-09-12T00:23:04.117840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.117631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.338073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.365803+0000","last_change":"2024-09-12T00:23:09.365803+0000","last_active":"2024-09-12T00:23:09.365803+0000","last_peered":"2024-09-12T00:23:09.365803+0000","last_clean":"2024-09-12T00:23:09.365803+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:23:09.365803+0000","last_undegraded":"2024-09-12T00:23:09.365803+0000","last_fullsized":"2024-09-12T00:23:09.365803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.365625+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:02.383992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.751719+0000","last_change":"2024-09-12T00:22:49.751719+0000","last_active":"2024-09-12T00:22:49.751719+0000","last_peered":"2024-09-12T00:22:49.751719+0000","last_clean":"2024-09-12T00:22:49.751719+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:22:49.751719+0000","last_undegraded":"2024-09-12T00:22:49.751719+0000","last_fullsized":"2024-09-12T00:22:49.751719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.751527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.037605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.923597+0000","last_change":"2024-09-12T00:18:46.209321+0000","last_active":"2024-09-12T00:22:01.923597+0000","last_peered":"2024-09-12T00:22:01.923597+0000","last_clean":"2024-09-12T00:22:01.923597+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:22:01.923597+0000","last_undegraded":"2024-09-12T00:22:01.923597+0000","last_fullsized":"2024-09-12T00:22:01.923597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.155399+0000","last_change":"2024-09-12T00:23:03.155399+0000","last_active":"2024-09-12T00:23:03.155399+0000","last_peered":"2024-09-12T00:23:03.155399+0000","last_clean":"2024-09-12T00:23:03.155399+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:23:03.155399+0000","last_undegraded":"2024-09-12T00:23:03.155399+0000","last_fullsized":"2024-09-12T00:23:03.155399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.155222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:47.560452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.684984+0000","last_change":"2024-09-12T00:23:03.684984+0000","last_active":"2024-09-12T00:23:03.684984+0000","last_peered":"2024-09-12T00:23:03.684984+0000","last_clean":"2024-09-12T00:23:03.684984+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:23:03.684984+0000","last_undegraded":"2024-09-12T00:23:03.684984+0000","last_fullsized":"2024-09-12T00:23:03.684984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.684709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.095355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.893869+0000","last_change":"2024-09-12T00:22:48.893869+0000","last_active":"2024-09-12T00:22:48.893869+0000","last_peered":"2024-09-12T00:22:48.893869+0000","last_clean":"2024-09-12T00:22:48.893869+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:22:48.893869+0000","last_undegraded":"2024-09-12T00:22:48.893869+0000","last_fullsized":"2024-09-12T00:22:48.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.893683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:04.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.700907+0000","last_change":"2024-09-12T00:23:04.700907+0000","last_active":"2024-09-12T00:23:04.700907+0000","last_peered":"2024-09-12T00:23:04.700907+0000","last_clean":"2024-09-12T00:23:04.700907+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:23:04.700907+0000","last_undegraded":"2024-09-12T00:23:04.700907+0000","last_fullsized":"2024-09-12T00:23:04.700907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.700730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:30.318663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.522649+0000","last_change":"2024-09-12T00:18:46.196888+0000","last_active":"2024-09-12T00:22:01.522649+0000","last_peered":"2024-09-12T00:22:01.522649+0000","last_clean":"2024-09-12T00:22:01.522649+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:22:01.522649+0000","last_undegraded":"2024-09-12T00:22:01.522649+0000","last_fullsized":"2024-09-12T00:22:01.522649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:56.741575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.381220+0000","last_change":"2024-09-12T00:22:50.381220+0000","last_active":"2024-09-12T00:22:50.381220+0000","last_peered":"2024-09-12T00:22:50.381220+0000","last_clean":"2024-09-12T00:22:50.381220+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:22:50.381220+0000","last_undegraded":"2024-09-12T00:22:50.381220+0000","last_fullsized":"2024-09-12T00:22:50.381220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:05.740216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.395067+0000","last_change":"2024-09-12T00:23:03.395067+0000","last_active":"2024-09-12T00:23:03.395067+0000","last_peered":"2024-09-12T00:23:03.395067+0000","last_clean":"2024-09-12T00:23:03.395067+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:23:03.395067+0000","last_undegraded":"2024-09-12T00:23:03.395067+0000","last_fullsized":"2024-09-12T00:23:03.395067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.394885+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:09.804874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.797589+0000","last_change":"2024-09-12T00:22:48.797589+0000","last_active":"2024-09-12T00:22:48.797589+0000","last_peered":"2024-09-12T00:22:48.797589+0000","last_clean":"2024-09-12T00:22:48.797589+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:22:48.797589+0000","last_undegraded":"2024-09-12T00:22:48.797589+0000","last_fullsized":"2024-09-12T00:22:48.797589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.797378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:43.134132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.439096+0000","last_change":"2024-09-12T00:23:05.439096+0000","last_active":"2024-09-12T00:23:05.439096+0000","last_peered":"2024-09-12T00:23:05.439096+0000","last_clean":"2024-09-12T00:23:05.439096+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:23:05.439096+0000","last_undegraded":"2024-09-12T00:23:05.439096+0000","last_fullsized":"2024-09-12T00:23:05.439096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.438924+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:26.775381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.390120+0000","last_change":"2024-09-12T00:22:48.390120+0000","last_active":"2024-09-12T00:22:48.390120+0000","last_peered":"2024-09-12T00:22:48.390120+0000","last_clean":"2024-09-12T00:22:48.390120+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:22:48.390120+0000","last_undegraded":"2024-09-12T00:22:48.390120+0000","last_fullsized":"2024-09-12T00:22:48.390120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.389942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.548963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.829700+0000","last_change":"2024-09-12T00:23:06.829700+0000","last_active":"2024-09-12T00:23:06.829700+0000","last_peered":"2024-09-12T00:23:06.829700+0000","last_clean":"2024-09-12T00:23:06.829700+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:23:06.829700+0000","last_undegraded":"2024-09-12T00:23:06.829700+0000","last_fullsized":"2024-09-12T00:23:06.829700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.829458+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:09.909801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.393858+0000","last_change":"2024-09-12T00:22:49.393858+0000","last_active":"2024-09-12T00:22:49.393858+0000","last_peered":"2024-09-12T00:22:49.393858+0000","last_clean":"2024-09-12T00:22:49.393858+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:22:49.393858+0000","last_undegraded":"2024-09-12T00:22:49.393858+0000","last_fullsized":"2024-09-12T00:22:49.393858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.393664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.905345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.724818+0000","last_change":"2024-09-12T00:23:02.724818+0000","last_active":"2024-09-12T00:23:02.724818+0000","last_peered":"2024-09-12T00:23:02.724818+0000","last_clean":"2024-09-12T00:23:02.724818+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:23:02.724818+0000","last_undegraded":"2024-09-12T00:23:02.724818+0000","last_fullsized":"2024-09-12T00:23:02.724818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.724643+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:13.949257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.985430+0000","last_change":"2024-09-12T00:22:52.985430+0000","last_active":"2024-09-12T00:22:52.985430+0000","last_peered":"2024-09-12T00:22:52.985430+0000","last_clean":"2024-09-12T00:22:52.985430+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:22:52.985430+0000","last_undegraded":"2024-09-12T00:22:52.985430+0000","last_fullsized":"2024-09-12T00:22:52.985430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:11.458618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.399553+0000","last_change":"2024-09-12T00:23:06.399553+0000","last_active":"2024-09-12T00:23:06.399553+0000","last_peered":"2024-09-12T00:23:06.399553+0000","last_clean":"2024-09-12T00:23:06.399553+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:23:06.399553+0000","last_undegraded":"2024-09-12T00:23:06.399553+0000","last_fullsized":"2024-09-12T00:23:06.399553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.399335+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:58.180682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.128899+0000","last_change":"2024-09-12T00:23:02.128899+0000","last_active":"2024-09-12T00:23:02.128899+0000","last_peered":"2024-09-12T00:23:02.128899+0000","last_clean":"2024-09-12T00:23:02.128899+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:23:02.128899+0000","last_undegraded":"2024-09-12T00:23:02.128899+0000","last_fullsized":"2024-09-12T00:23:02.128899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.128715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:26.580947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.968184+0000","last_change":"2024-09-12T00:18:54.265807+0000","last_active":"2024-09-12T00:22:01.968184+0000","last_peered":"2024-09-12T00:22:01.968184+0000","last_clean":"2024-09-12T00:22:01.968184+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:22:01.968184+0000","last_undegraded":"2024-09-12T00:22:01.968184+0000","last_fullsized":"2024-09-12T00:22:01.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:49.438511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.016573+0000","last_change":"2024-09-12T00:23:09.016573+0000","last_active":"2024-09-12T00:23:09.016573+0000","last_peered":"2024-09-12T00:23:09.016573+0000","last_clean":"2024-09-12T00:23:09.016573+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:23:09.016573+0000","last_undegraded":"2024-09-12T00:23:09.016573+0000","last_fullsized":"2024-09-12T00:23:09.016573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.016364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:43.015238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.016861+0000","last_change":"2024-09-12T00:22:51.016861+0000","last_active":"2024-09-12T00:22:51.016861+0000","last_peered":"2024-09-12T00:22:51.016861+0000","last_clean":"2024-09-12T00:22:51.016861+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:22:51.016861+0000","last_undegraded":"2024-09-12T00:22:51.016861+0000","last_fullsized":"2024-09-12T00:22:51.016861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.016681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.292241+0000","last_change":"2024-09-12T00:18:48.223718+0000","last_active":"2024-09-12T00:19:24.292241+0000","last_peered":"2024-09-12T00:19:24.292241+0000","last_clean":"2024-09-12T00:19:24.292241+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:19:24.292241+0000","last_undegraded":"2024-09-12T00:19:24.292241+0000","last_fullsized":"2024-09-12T00:19:24.292241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:43.110893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'45","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.541669+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:22:33.541669+0000","last_peered":"2024-09-12T00:22:33.541669+0000","last_clean":"2024-09-12T00:22:33.541669+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:22:33.541669+0000","last_undegraded":"2024-09-12T00:22:33.541669+0000","last_fullsized":"2024-09-12T00:22:33.541669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290724+0000","last_change":"2024-09-12T00:18:52.240902+0000","last_active":"2024-09-12T00:19:24.290724+0000","last_peered":"2024-09-12T00:19:24.290724+0000","last_clean":"2024-09-12T00:19:24.290724+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:19:24.290724+0000","last_undegraded":"2024-09-12T00:19:24.290724+0000","last_fullsized":"2024-09-12T00:19:24.290724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:56.679580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.961891+0000","last_change":"2024-09-12T00:23:13.961891+0000","last_active":"2024-09-12T00:23:13.961891+0000","last_peered":"2024-09-12T00:23:13.961891+0000","last_clean":"2024-09-12T00:23:13.961891+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:23:13.961891+0000","last_undegraded":"2024-09-12T00:23:13.961891+0000","last_fullsized":"2024-09-12T00:23:13.961891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.961704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:07.483381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.797026+0000","last_change":"2024-09-12T00:22:43.797026+0000","last_active":"2024-09-12T00:22:43.797026+0000","last_peered":"2024-09-12T00:22:43.797026+0000","last_clean":"2024-09-12T00:22:43.797026+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:22:43.797026+0000","last_undegraded":"2024-09-12T00:22:43.797026+0000","last_fullsized":"2024-09-12T00:22:43.797026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.796840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:32.300041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.369745+0000","last_change":"2024-09-12T00:23:14.369745+0000","last_active":"2024-09-12T00:23:14.369745+0000","last_peered":"2024-09-12T00:23:14.369745+0000","last_clean":"2024-09-12T00:23:14.369745+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:23:14.369745+0000","last_undegraded":"2024-09-12T00:23:14.369745+0000","last_fullsized":"2024-09-12T00:23:14.369745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.369579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.600971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:15.274057+0000","last_change":"2024-09-12T00:18:50.235041+0000","last_active":"2024-09-12T00:20:15.274057+0000","last_peered":"2024-09-12T00:20:15.274057+0000","last_clean":"2024-09-12T00:20:15.274057+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:20:15.274057+0000","last_undegraded":"2024-09-12T00:20:15.274057+0000","last_fullsized":"2024-09-12T00:20:15.274057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.500154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283040+0000","last_change":"2024-09-12T00:18:52.237450+0000","last_active":"2024-09-12T00:19:24.283040+0000","last_peered":"2024-09-12T00:19:24.283040+0000","last_clean":"2024-09-12T00:19:24.283040+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:19:24.283040+0000","last_undegraded":"2024-09-12T00:19:24.283040+0000","last_fullsized":"2024-09-12T00:19:24.283040+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543683+0000","last_change":"2024-09-12T00:18:54.258876+0000","last_active":"2024-09-12T00:19:24.543683+0000","last_peered":"2024-09-12T00:19:24.543683+0000","last_clean":"2024-09-12T00:19:24.543683+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:19:24.543683+0000","last_undegraded":"2024-09-12T00:19:24.543683+0000","last_fullsized":"2024-09-12T00:19:24.543683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:49.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.939642+0000","last_change":"2024-09-12T00:23:12.939642+0000","last_active":"2024-09-12T00:23:12.939642+0000","last_peered":"2024-09-12T00:23:12.939642+0000","last_clean":"2024-09-12T00:23:12.939642+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:23:12.939642+0000","last_undegraded":"2024-09-12T00:23:12.939642+0000","last_fullsized":"2024-09-12T00:23:12.939642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.939457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.805086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.061542+0000","last_change":"2024-09-12T00:22:50.061542+0000","last_active":"2024-09-12T00:22:50.061542+0000","last_peered":"2024-09-12T00:22:50.061542+0000","last_clean":"2024-09-12T00:22:50.061542+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:22:50.061542+0000","last_undegraded":"2024-09-12T00:22:50.061542+0000","last_fullsized":"2024-09-12T00:22:50.061542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.061348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:59.156666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.840652+0000","last_change":"2024-09-12T00:23:09.840652+0000","last_active":"2024-09-12T00:23:09.840652+0000","last_peered":"2024-09-12T00:23:09.840652+0000","last_clean":"2024-09-12T00:23:09.840652+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:23:09.840652+0000","last_undegraded":"2024-09-12T00:23:09.840652+0000","last_fullsized":"2024-09-12T00:23:09.840652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.840470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:18.847901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.806940+0000","last_change":"2024-09-12T00:18:50.216569+0000","last_active":"2024-09-12T00:21:00.806940+0000","last_peered":"2024-09-12T00:21:00.806940+0000","last_clean":"2024-09-12T00:21:00.806940+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:21:00.806940+0000","last_undegraded":"2024-09-12T00:21:00.806940+0000","last_fullsized":"2024-09-12T00:21:00.806940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:40.853734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.251962+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:22:33.251962+0000","last_peered":"2024-09-12T00:22:33.251962+0000","last_clean":"2024-09-12T00:22:33.251962+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:22:33.251962+0000","last_undegraded":"2024-09-12T00:22:33.251962+0000","last_fullsized":"2024-09-12T00:22:33.251962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.267725+0000","last_change":"2024-09-12T00:18:54.260650+0000","last_active":"2024-09-12T00:19:24.267725+0000","last_peered":"2024-09-12T00:19:24.267725+0000","last_clean":"2024-09-12T00:19:24.267725+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:19:24.267725+0000","last_undegraded":"2024-09-12T00:19:24.267725+0000","last_fullsized":"2024-09-12T00:19:24.267725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:57.299642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.837098+0000","last_change":"2024-09-12T00:22:59.837098+0000","last_active":"2024-09-12T00:22:59.837098+0000","last_peered":"2024-09-12T00:22:59.837098+0000","last_clean":"2024-09-12T00:22:59.837098+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:59.837098+0000","last_undegraded":"2024-09-12T00:22:59.837098+0000","last_fullsized":"2024-09-12T00:22:59.837098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.836918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.309884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.345748+0000","last_change":"2024-09-12T00:22:41.345748+0000","last_active":"2024-09-12T00:22:41.345748+0000","last_peered":"2024-09-12T00:22:41.345748+0000","last_clean":"2024-09-12T00:22:41.345748+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:22:41.345748+0000","last_undegraded":"2024-09-12T00:22:41.345748+0000","last_fullsized":"2024-09-12T00:22:41.345748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.345566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:36.735410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"24'1","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.211285+0000","last_change":"2024-09-12T00:18:48.223603+0000","last_active":"2024-09-12T00:22:33.211285+0000","last_peered":"2024-09-12T00:22:33.211285+0000","last_clean":"2024-09-12T00:22:33.211285+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:22:33.211285+0000","last_undegraded":"2024-09-12T00:22:33.211285+0000","last_fullsized":"2024-09-12T00:22:33.211285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:14.726700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'39","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.502600+0000","last_change":"2024-09-12T00:18:50.214851+0000","last_active":"2024-09-12T00:22:33.502600+0000","last_peered":"2024-09-12T00:22:33.502600+0000","last_clean":"2024-09-12T00:22:33.502600+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:22:33.502600+0000","last_undegraded":"2024-09-12T00:22:33.502600+0000","last_fullsized":"2024-09-12T00:22:33.502600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:33.189473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":446,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.262847+0000","last_change":"2024-09-12T00:18:52.240158+0000","last_active":"2024-09-12T00:22:33.262847+0000","last_peered":"2024-09-12T00:22:33.262847+0000","last_clean":"2024-09-12T00:22:33.262847+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:22:33.262847+0000","last_undegraded":"2024-09-12T00:22:33.262847+0000","last_fullsized":"2024-09-12T00:22:33.262847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:30.101795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.085218+0000","last_change":"2024-09-12T00:23:07.084961+0000","last_active":"2024-09-12T00:23:07.085218+0000","last_peered":"2024-09-12T00:23:07.085218+0000","last_clean":"2024-09-12T00:23:07.085218+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:23:07.085218+0000","last_undegraded":"2024-09-12T00:23:07.085218+0000","last_fullsized":"2024-09-12T00:23:07.085218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.084724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.811716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.772738+0000","last_change":"2024-09-12T00:22:41.772590+0000","last_active":"2024-09-12T00:22:41.772738+0000","last_peered":"2024-09-12T00:22:41.772738+0000","last_clean":"2024-09-12T00:22:41.772738+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:41.772738+0000","last_undegraded":"2024-09-12T00:22:41.772738+0000","last_fullsized":"2024-09-12T00:22:41.772738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.772363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.380735+0000","last_change":"2024-09-12T00:23:11.380735+0000","last_active":"2024-09-12T00:23:11.380735+0000","last_peered":"2024-09-12T00:23:11.380735+0000","last_clean":"2024-09-12T00:23:11.380735+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:23:11.380735+0000","last_undegraded":"2024-09-12T00:23:11.380735+0000","last_fullsized":"2024-09-12T00:23:11.380735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.380468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:20.387899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'62","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.763583+0000","last_change":"2024-09-12T00:23:14.763583+0000","last_active":"2024-09-12T00:23:14.763583+0000","last_peered":"2024-09-12T00:23:14.763583+0000","last_clean":"2024-09-12T00:23:14.763583+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:23:14.763583+0000","last_undegraded":"2024-09-12T00:23:14.763583+0000","last_fullsized":"2024-09-12T00:23:14.763583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'62","last_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_deep_scrub":"33'62","last_deep_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.763365+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:39.983068+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.550758+0000","last_change":"2024-09-12T00:18:52.239436+0000","last_active":"2024-09-12T00:19:24.550758+0000","last_peered":"2024-09-12T00:19:24.550758+0000","last_clean":"2024-09-12T00:19:24.550758+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:19:24.550758+0000","last_undegraded":"2024-09-12T00:19:24.550758+0000","last_fullsized":"2024-09-12T00:19:24.550758+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:52.761510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.037395+0000","last_change":"2024-09-12T00:18:54.279698+0000","last_active":"2024-09-12T00:22:02.037395+0000","last_peered":"2024-09-12T00:22:02.037395+0000","last_clean":"2024-09-12T00:22:02.037395+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:22:02.037395+0000","last_undegraded":"2024-09-12T00:22:02.037395+0000","last_fullsized":"2024-09-12T00:22:02.037395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.432243+0000","last_change":"2024-09-12T00:22:52.432048+0000","last_active":"2024-09-12T00:22:52.432243+0000","last_peered":"2024-09-12T00:22:52.432243+0000","last_clean":"2024-09-12T00:22:52.432243+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:22:52.432243+0000","last_undegraded":"2024-09-12T00:22:52.432243+0000","last_fullsized":"2024-09-12T00:22:52.432243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.431871+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.876093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.795646+0000","last_change":"2024-09-12T00:22:40.795499+0000","last_active":"2024-09-12T00:22:40.795646+0000","last_peered":"2024-09-12T00:22:40.795646+0000","last_clean":"2024-09-12T00:22:40.795646+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:22:40.795646+0000","last_undegraded":"2024-09-12T00:22:40.795646+0000","last_fullsized":"2024-09-12T00:22:40.795646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.795325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:29.485413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.766513+0000","last_change":"2024-09-12T00:23:14.766513+0000","last_active":"2024-09-12T00:23:14.766513+0000","last_peered":"2024-09-12T00:23:14.766513+0000","last_clean":"2024-09-12T00:23:14.766513+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:23:14.766513+0000","last_undegraded":"2024-09-12T00:23:14.766513+0000","last_fullsized":"2024-09-12T00:23:14.766513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.766308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.849877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'39","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.431049+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:22:33.431049+0000","last_peered":"2024-09-12T00:22:33.431049+0000","last_clean":"2024-09-12T00:22:33.431049+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:22:33.431049+0000","last_undegraded":"2024-09-12T00:22:33.431049+0000","last_fullsized":"2024-09-12T00:22:33.431049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:33.060351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600228+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:21:02.600228+0000","last_peered":"2024-09-12T00:21:02.600228+0000","last_clean":"2024-09-12T00:21:02.600228+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:21:02.600228+0000","last_undegraded":"2024-09-12T00:21:02.600228+0000","last_fullsized":"2024-09-12T00:21:02.600228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'5","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600408+0000","last_change":"2024-09-12T00:18:54.258485+0000","last_active":"2024-09-12T00:21:02.600408+0000","last_peered":"2024-09-12T00:21:02.600408+0000","last_clean":"2024-09-12T00:21:02.600408+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:21:02.600408+0000","last_undegraded":"2024-09-12T00:21:02.600408+0000","last_fullsized":"2024-09-12T00:21:02.600408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.652375+0000","last_change":"2024-09-12T00:22:56.652212+0000","last_active":"2024-09-12T00:22:56.652375+0000","last_peered":"2024-09-12T00:22:56.652375+0000","last_clean":"2024-09-12T00:22:56.652375+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:56.652375+0000","last_undegraded":"2024-09-12T00:22:56.652375+0000","last_fullsized":"2024-09-12T00:22:56.652375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.652038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.998075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.097480+0000","last_change":"2024-09-12T00:22:49.097322+0000","last_active":"2024-09-12T00:22:49.097480+0000","last_peered":"2024-09-12T00:22:49.097480+0000","last_clean":"2024-09-12T00:22:49.097480+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:22:49.097480+0000","last_undegraded":"2024-09-12T00:22:49.097480+0000","last_fullsized":"2024-09-12T00:22:49.097480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.097141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:19.046570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.793060+0000","last_change":"2024-09-12T00:23:08.792927+0000","last_active":"2024-09-12T00:23:08.793060+0000","last_peered":"2024-09-12T00:23:08.793060+0000","last_clean":"2024-09-12T00:23:08.793060+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:23:08.793060+0000","last_undegraded":"2024-09-12T00:23:08.793060+0000","last_fullsized":"2024-09-12T00:23:08.793060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.792752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:34.705253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'52","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.357903+0000","last_change":"2024-09-12T00:18:50.219536+0000","last_active":"2024-09-12T00:22:33.357903+0000","last_peered":"2024-09-12T00:22:33.357903+0000","last_clean":"2024-09-12T00:22:33.357903+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:22:33.357903+0000","last_undegraded":"2024-09-12T00:22:33.357903+0000","last_fullsized":"2024-09-12T00:22:33.357903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":354,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.586231+0000","last_change":"2024-09-12T00:18:52.243608+0000","last_active":"2024-09-12T00:22:33.586231+0000","last_peered":"2024-09-12T00:22:33.586231+0000","last_clean":"2024-09-12T00:22:33.586231+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:22:33.586231+0000","last_undegraded":"2024-09-12T00:22:33.586231+0000","last_fullsized":"2024-09-12T00:22:33.586231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601715+0000","last_change":"2024-09-12T00:18:54.267943+0000","last_active":"2024-09-12T00:21:07.601715+0000","last_peered":"2024-09-12T00:21:07.601715+0000","last_clean":"2024-09-12T00:21:07.601715+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:21:07.601715+0000","last_undegraded":"2024-09-12T00:21:07.601715+0000","last_fullsized":"2024-09-12T00:21:07.601715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.683417+0000","last_change":"2024-09-12T00:22:55.683235+0000","last_active":"2024-09-12T00:22:55.683417+0000","last_peered":"2024-09-12T00:22:55.683417+0000","last_clean":"2024-09-12T00:22:55.683417+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:55.683417+0000","last_undegraded":"2024-09-12T00:22:55.683417+0000","last_fullsized":"2024-09-12T00:22:55.683417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.683049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:38.119930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.023749+0000","last_change":"2024-09-12T00:22:47.023618+0000","last_active":"2024-09-12T00:22:47.023749+0000","last_peered":"2024-09-12T00:22:47.023749+0000","last_clean":"2024-09-12T00:22:47.023749+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:22:47.023749+0000","last_undegraded":"2024-09-12T00:22:47.023749+0000","last_fullsized":"2024-09-12T00:22:47.023749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.023424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:59.258309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.726024+0000","last_change":"2024-09-12T00:23:05.726024+0000","last_active":"2024-09-12T00:23:05.726024+0000","last_peered":"2024-09-12T00:23:05.726024+0000","last_clean":"2024-09-12T00:23:05.726024+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:23:05.726024+0000","last_undegraded":"2024-09-12T00:23:05.726024+0000","last_fullsized":"2024-09-12T00:23:05.726024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.725828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:35.191271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.451684+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:22:33.451684+0000","last_peered":"2024-09-12T00:22:33.451684+0000","last_clean":"2024-09-12T00:22:33.451684+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:22:33.451684+0000","last_undegraded":"2024-09-12T00:22:33.451684+0000","last_fullsized":"2024-09-12T00:22:33.451684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600001+0000","last_change":"2024-09-12T00:18:52.233070+0000","last_active":"2024-09-12T00:21:02.600001+0000","last_peered":"2024-09-12T00:21:02.600001+0000","last_clean":"2024-09-12T00:21:02.600001+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:21:02.600001+0000","last_undegraded":"2024-09-12T00:21:02.600001+0000","last_fullsized":"2024-09-12T00:21:02.600001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'22","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.424966+0000","last_change":"2024-09-12T00:18:54.269534+0000","last_active":"2024-09-12T00:22:02.424966+0000","last_peered":"2024-09-12T00:22:02.424966+0000","last_clean":"2024-09-12T00:22:02.424966+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:22:02.424966+0000","last_undegraded":"2024-09-12T00:22:02.424966+0000","last_fullsized":"2024-09-12T00:22:02.424966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.393141+0000","last_change":"2024-09-12T00:22:54.392952+0000","last_active":"2024-09-12T00:22:54.393141+0000","last_peered":"2024-09-12T00:22:54.393141+0000","last_clean":"2024-09-12T00:22:54.393141+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:54.393141+0000","last_undegraded":"2024-09-12T00:22:54.393141+0000","last_fullsized":"2024-09-12T00:22:54.393141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.392767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:12.866147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.874156+0000","last_change":"2024-09-12T00:22:46.874023+0000","last_active":"2024-09-12T00:22:46.874156+0000","last_peered":"2024-09-12T00:22:46.874156+0000","last_clean":"2024-09-12T00:22:46.874156+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:22:46.874156+0000","last_undegraded":"2024-09-12T00:22:46.874156+0000","last_fullsized":"2024-09-12T00:22:46.874156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.873837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:16.339279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.705078+0000","last_change":"2024-09-12T00:23:07.704869+0000","last_active":"2024-09-12T00:23:07.705078+0000","last_peered":"2024-09-12T00:23:07.705078+0000","last_clean":"2024-09-12T00:23:07.705078+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:23:07.705078+0000","last_undegraded":"2024-09-12T00:23:07.705078+0000","last_fullsized":"2024-09-12T00:23:07.705078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.704656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:23.063840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'42","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.456226+0000","last_change":"2024-09-12T00:18:50.216809+0000","last_active":"2024-09-12T00:22:33.456226+0000","last_peered":"2024-09-12T00:22:33.456226+0000","last_clean":"2024-09-12T00:22:33.456226+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:22:33.456226+0000","last_undegraded":"2024-09-12T00:22:33.456226+0000","last_fullsized":"2024-09-12T00:22:33.456226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:03.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298577+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:19:24.298577+0000","last_peered":"2024-09-12T00:19:24.298577+0000","last_clean":"2024-09-12T00:19:24.298577+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:19:24.298577+0000","last_undegraded":"2024-09-12T00:19:24.298577+0000","last_fullsized":"2024-09-12T00:19:24.298577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:49.010895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.260350+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:22:02.260350+0000","last_peered":"2024-09-12T00:22:02.260350+0000","last_clean":"2024-09-12T00:22:02.260350+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:22:02.260350+0000","last_undegraded":"2024-09-12T00:22:02.260350+0000","last_fullsized":"2024-09-12T00:22:02.260350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.003649+0000","last_change":"2024-09-12T00:23:10.003493+0000","last_active":"2024-09-12T00:23:10.003649+0000","last_peered":"2024-09-12T00:23:10.003649+0000","last_clean":"2024-09-12T00:23:10.003649+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:23:10.003649+0000","last_undegraded":"2024-09-12T00:23:10.003649+0000","last_fullsized":"2024-09-12T00:23:10.003649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.003307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:46.132710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.991804+0000","last_change":"2024-09-12T00:22:45.991549+0000","last_active":"2024-09-12T00:22:45.991804+0000","last_peered":"2024-09-12T00:22:45.991804+0000","last_clean":"2024-09-12T00:22:45.991804+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:22:45.991804+0000","last_undegraded":"2024-09-12T00:22:45.991804+0000","last_fullsized":"2024-09-12T00:22:45.991804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.991336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:42.782875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.823994+0000","last_change":"2024-09-12T00:23:10.823854+0000","last_active":"2024-09-12T00:23:10.823994+0000","last_peered":"2024-09-12T00:23:10.823994+0000","last_clean":"2024-09-12T00:23:10.823994+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:23:10.823994+0000","last_undegraded":"2024-09-12T00:23:10.823994+0000","last_fullsized":"2024-09-12T00:23:10.823994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.823673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:48.346256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'47","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.712629+0000","last_change":"2024-09-12T00:23:15.712629+0000","last_active":"2024-09-12T00:23:15.712629+0000","last_peered":"2024-09-12T00:23:15.712629+0000","last_clean":"2024-09-12T00:23:15.712629+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:23:15.712629+0000","last_undegraded":"2024-09-12T00:23:15.712629+0000","last_fullsized":"2024-09-12T00:23:15.712629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.712426+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:44.227558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":436,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.252716+0000","last_change":"2024-09-12T00:18:52.246715+0000","last_active":"2024-09-12T00:22:33.252716+0000","last_peered":"2024-09-12T00:22:33.252716+0000","last_clean":"2024-09-12T00:22:33.252716+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:22:33.252716+0000","last_undegraded":"2024-09-12T00:22:33.252716+0000","last_fullsized":"2024-09-12T00:22:33.252716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:16.178548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'14","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.267118+0000","last_change":"2024-09-12T00:18:54.261532+0000","last_active":"2024-09-12T00:22:02.267118+0000","last_peered":"2024-09-12T00:22:02.267118+0000","last_clean":"2024-09-12T00:22:02.267118+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:22:02.267118+0000","last_undegraded":"2024-09-12T00:22:02.267118+0000","last_fullsized":"2024-09-12T00:22:02.267118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.687472+0000","last_change":"2024-09-12T00:22:57.687239+0000","last_active":"2024-09-12T00:22:57.687472+0000","last_peered":"2024-09-12T00:22:57.687472+0000","last_clean":"2024-09-12T00:22:57.687472+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:22:57.687472+0000","last_undegraded":"2024-09-12T00:22:57.687472+0000","last_fullsized":"2024-09-12T00:22:57.687472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.687015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:52.889888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.055380+0000","last_change":"2024-09-12T00:22:48.055242+0000","last_active":"2024-09-12T00:22:48.055380+0000","last_peered":"2024-09-12T00:22:48.055380+0000","last_clean":"2024-09-12T00:22:48.055380+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:22:48.055380+0000","last_undegraded":"2024-09-12T00:22:48.055380+0000","last_fullsized":"2024-09-12T00:22:48.055380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.055065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:08.979877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.389518+0000","last_change":"2024-09-12T00:23:12.389268+0000","last_active":"2024-09-12T00:23:12.389518+0000","last_peered":"2024-09-12T00:23:12.389518+0000","last_clean":"2024-09-12T00:23:12.389518+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:23:12.389518+0000","last_undegraded":"2024-09-12T00:23:12.389518+0000","last_fullsized":"2024-09-12T00:23:12.389518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.389028+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.911611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.293417+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:19:24.293417+0000","last_peered":"2024-09-12T00:19:24.293417+0000","last_clean":"2024-09-12T00:19:24.293417+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:19:24.293417+0000","last_undegraded":"2024-09-12T00:19:24.293417+0000","last_fullsized":"2024-09-12T00:19:24.293417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:06.024532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":473,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.255674+0000","last_change":"2024-09-12T00:18:52.239069+0000","last_active":"2024-09-12T00:22:33.255674+0000","last_peered":"2024-09-12T00:22:33.255674+0000","last_clean":"2024-09-12T00:22:33.255674+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:22:33.255674+0000","last_undegraded":"2024-09-12T00:22:33.255674+0000","last_fullsized":"2024-09-12T00:22:33.255674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:13.480077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.596107+0000","last_change":"2024-09-12T00:18:54.253516+0000","last_active":"2024-09-12T00:21:02.596107+0000","last_peered":"2024-09-12T00:21:02.596107+0000","last_clean":"2024-09-12T00:21:02.596107+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:21:02.596107+0000","last_undegraded":"2024-09-12T00:21:02.596107+0000","last_fullsized":"2024-09-12T00:21:02.596107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.426031+0000","last_change":"2024-09-12T00:22:53.425858+0000","last_active":"2024-09-12T00:22:53.426031+0000","last_peered":"2024-09-12T00:22:53.426031+0000","last_clean":"2024-09-12T00:22:53.426031+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:53.426031+0000","last_undegraded":"2024-09-12T00:22:53.426031+0000","last_fullsized":"2024-09-12T00:22:53.426031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.425681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:50.989571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.037177+0000","last_change":"2024-09-12T00:22:45.037018+0000","last_active":"2024-09-12T00:22:45.037177+0000","last_peered":"2024-09-12T00:22:45.037177+0000","last_clean":"2024-09-12T00:22:45.037177+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:22:45.037177+0000","last_undegraded":"2024-09-12T00:22:45.037177+0000","last_fullsized":"2024-09-12T00:22:45.037177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.036831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:05.107642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.607788+0000","last_change":"2024-09-12T00:18:48.224047+0000","last_active":"2024-09-12T00:21:02.607788+0000","last_peered":"2024-09-12T00:21:02.607788+0000","last_clean":"2024-09-12T00:21:02.607788+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:21:02.607788+0000","last_undegraded":"2024-09-12T00:21:02.607788+0000","last_fullsized":"2024-09-12T00:21:02.607788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'41","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.548141+0000","last_change":"2024-09-12T00:18:50.229147+0000","last_active":"2024-09-12T00:22:33.548141+0000","last_peered":"2024-09-12T00:22:33.548141+0000","last_clean":"2024-09-12T00:22:33.548141+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:22:33.548141+0000","last_undegraded":"2024-09-12T00:22:33.548141+0000","last_fullsized":"2024-09-12T00:22:33.548141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:59.800058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265456+0000","last_change":"2024-09-12T00:18:52.264199+0000","last_active":"2024-09-12T00:19:24.265456+0000","last_peered":"2024-09-12T00:19:24.265456+0000","last_clean":"2024-09-12T00:19:24.265456+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:19:24.265456+0000","last_undegraded":"2024-09-12T00:19:24.265456+0000","last_fullsized":"2024-09-12T00:19:24.265456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:46.475453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.387544+0000","last_change":"2024-09-12T00:18:54.249963+0000","last_active":"2024-09-12T00:22:02.387544+0000","last_peered":"2024-09-12T00:22:02.387544+0000","last_clean":"2024-09-12T00:22:02.387544+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:22:02.387544+0000","last_undegraded":"2024-09-12T00:22:02.387544+0000","last_fullsized":"2024-09-12T00:22:02.387544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.741667+0000","last_change":"2024-09-12T00:22:53.741667+0000","last_active":"2024-09-12T00:22:53.741667+0000","last_peered":"2024-09-12T00:22:53.741667+0000","last_clean":"2024-09-12T00:22:53.741667+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:22:53.741667+0000","last_undegraded":"2024-09-12T00:22:53.741667+0000","last_fullsized":"2024-09-12T00:22:53.741667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.741481+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:54.588986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.330431+0000","last_change":"2024-09-12T00:22:38.330431+0000","last_active":"2024-09-12T00:22:38.330431+0000","last_peered":"2024-09-12T00:22:38.330431+0000","last_clean":"2024-09-12T00:22:38.330431+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:22:38.330431+0000","last_undegraded":"2024-09-12T00:22:38.330431+0000","last_fullsized":"2024-09-12T00:22:38.330431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.330231+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:47.818803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.088492+0000","last_change":"2024-09-12T00:22:40.088223+0000","last_active":"2024-09-12T00:22:40.088492+0000","last_peered":"2024-09-12T00:22:40.088492+0000","last_clean":"2024-09-12T00:22:40.088492+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:22:40.088492+0000","last_undegraded":"2024-09-12T00:22:40.088492+0000","last_fullsized":"2024-09-12T00:22:40.088492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.087970+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.489548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.015916+0000","last_change":"2024-09-12T00:22:43.015652+0000","last_active":"2024-09-12T00:22:43.015916+0000","last_peered":"2024-09-12T00:22:43.015916+0000","last_clean":"2024-09-12T00:22:43.015916+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:43.015916+0000","last_undegraded":"2024-09-12T00:22:43.015916+0000","last_fullsized":"2024-09-12T00:22:43.015916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.015422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:23.844048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.395580+0000","last_change":"2024-09-12T00:23:10.395580+0000","last_active":"2024-09-12T00:23:10.395580+0000","last_peered":"2024-09-12T00:23:10.395580+0000","last_clean":"2024-09-12T00:23:10.395580+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:23:10.395580+0000","last_undegraded":"2024-09-12T00:23:10.395580+0000","last_fullsized":"2024-09-12T00:23:10.395580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.395395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'91","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.530032+0000","last_change":"2024-09-12T00:18:50.244837+0000","last_active":"2024-09-12T00:22:33.530032+0000","last_peered":"2024-09-12T00:22:33.530032+0000","last_clean":"2024-09-12T00:22:33.530032+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:22:33.530032+0000","last_undegraded":"2024-09-12T00:22:33.530032+0000","last_fullsized":"2024-09-12T00:22:33.530032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.785001+0000","last_change":"2024-09-12T00:23:15.785001+0000","last_active":"2024-09-12T00:23:15.785001+0000","last_peered":"2024-09-12T00:23:15.785001+0000","last_clean":"2024-09-12T00:23:15.785001+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:23:15.785001+0000","last_undegraded":"2024-09-12T00:23:15.785001+0000","last_fullsized":"2024-09-12T00:23:15.785001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.784792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:05.198107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.131683+0000","last_change":"2024-09-12T00:18:54.252672+0000","last_active":"2024-09-12T00:22:02.131683+0000","last_peered":"2024-09-12T00:22:02.131683+0000","last_clean":"2024-09-12T00:22:02.131683+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:22:02.131683+0000","last_undegraded":"2024-09-12T00:22:02.131683+0000","last_fullsized":"2024-09-12T00:22:02.131683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.038978+0000","last_change":"2024-09-12T00:23:08.038978+0000","last_active":"2024-09-12T00:23:08.038978+0000","last_peered":"2024-09-12T00:23:08.038978+0000","last_clean":"2024-09-12T00:23:08.038978+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:23:08.038978+0000","last_undegraded":"2024-09-12T00:23:08.038978+0000","last_fullsized":"2024-09-12T00:23:08.038978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.038792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:47.713400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.101143+0000","last_change":"2024-09-12T00:22:38.101143+0000","last_active":"2024-09-12T00:22:38.101143+0000","last_peered":"2024-09-12T00:22:38.101143+0000","last_clean":"2024-09-12T00:22:38.101143+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:22:38.101143+0000","last_undegraded":"2024-09-12T00:22:38.101143+0000","last_fullsized":"2024-09-12T00:22:38.101143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.100967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:57.104038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.819521+0000","last_change":"2024-09-12T00:22:41.819357+0000","last_active":"2024-09-12T00:22:41.819521+0000","last_peered":"2024-09-12T00:22:41.819521+0000","last_clean":"2024-09-12T00:22:41.819521+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:22:41.819521+0000","last_undegraded":"2024-09-12T00:22:41.819521+0000","last_fullsized":"2024-09-12T00:22:41.819521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.819171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.252502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.606536+0000","last_change":"2024-09-12T00:18:48.222483+0000","last_active":"2024-09-12T00:20:57.606536+0000","last_peered":"2024-09-12T00:20:57.606536+0000","last_clean":"2024-09-12T00:20:57.606536+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:20:57.606536+0000","last_undegraded":"2024-09-12T00:20:57.606536+0000","last_fullsized":"2024-09-12T00:20:57.606536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":515,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.563016+0000","last_change":"2024-09-12T00:18:50.228160+0000","last_active":"2024-09-12T00:22:33.563016+0000","last_peered":"2024-09-12T00:22:33.563016+0000","last_clean":"2024-09-12T00:22:33.563016+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:22:33.563016+0000","last_undegraded":"2024-09-12T00:22:33.563016+0000","last_fullsized":"2024-09-12T00:22:33.563016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.606444+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:20:57.606444+0000","last_peered":"2024-09-12T00:20:57.606444+0000","last_clean":"2024-09-12T00:20:57.606444+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:20:57.606444+0000","last_undegraded":"2024-09-12T00:20:57.606444+0000","last_fullsized":"2024-09-12T00:20:57.606444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601482+0000","last_change":"2024-09-12T00:18:54.258208+0000","last_active":"2024-09-12T00:21:07.601482+0000","last_peered":"2024-09-12T00:21:07.601482+0000","last_clean":"2024-09-12T00:21:07.601482+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:21:07.601482+0000","last_undegraded":"2024-09-12T00:21:07.601482+0000","last_fullsized":"2024-09-12T00:21:07.601482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.892856+0000","last_change":"2024-09-12T00:22:56.892682+0000","last_active":"2024-09-12T00:22:56.892856+0000","last_peered":"2024-09-12T00:22:56.892856+0000","last_clean":"2024-09-12T00:22:56.892856+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:56.892856+0000","last_undegraded":"2024-09-12T00:22:56.892856+0000","last_fullsized":"2024-09-12T00:22:56.892856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.892476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:41.105061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.794403+0000","last_change":"2024-09-12T00:22:38.794195+0000","last_active":"2024-09-12T00:22:38.794403+0000","last_peered":"2024-09-12T00:22:38.794403+0000","last_clean":"2024-09-12T00:22:38.794403+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:22:38.794403+0000","last_undegraded":"2024-09-12T00:22:38.794403+0000","last_fullsized":"2024-09-12T00:22:38.794403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.794009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:39.382664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.745657+0000","last_change":"2024-09-12T00:22:39.745499+0000","last_active":"2024-09-12T00:22:39.745657+0000","last_peered":"2024-09-12T00:22:39.745657+0000","last_clean":"2024-09-12T00:22:39.745657+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:22:39.745657+0000","last_undegraded":"2024-09-12T00:22:39.745657+0000","last_fullsized":"2024-09-12T00:22:39.745657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.745298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.209943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.757419+0000","last_change":"2024-09-12T00:23:06.757280+0000","last_active":"2024-09-12T00:23:06.757419+0000","last_peered":"2024-09-12T00:23:06.757419+0000","last_clean":"2024-09-12T00:23:06.757419+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:23:06.757419+0000","last_undegraded":"2024-09-12T00:23:06.757419+0000","last_fullsized":"2024-09-12T00:23:06.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.757101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:36.253152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.804413+0000","last_change":"2024-09-12T00:23:13.804413+0000","last_active":"2024-09-12T00:23:13.804413+0000","last_peered":"2024-09-12T00:23:13.804413+0000","last_clean":"2024-09-12T00:23:13.804413+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:23:13.804413+0000","last_undegraded":"2024-09-12T00:23:13.804413+0000","last_fullsized":"2024-09-12T00:23:13.804413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.804104+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.235994+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.598633+0000","last_change":"2024-09-12T00:18:52.245313+0000","last_active":"2024-09-12T00:20:57.598633+0000","last_peered":"2024-09-12T00:20:57.598633+0000","last_clean":"2024-09-12T00:20:57.598633+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:20:57.598633+0000","last_undegraded":"2024-09-12T00:20:57.598633+0000","last_fullsized":"2024-09-12T00:20:57.598633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.568920+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.568920+0000","last_peered":"2024-09-12T00:22:01.568920+0000","last_clean":"2024-09-12T00:22:01.568920+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.568920+0000","last_undegraded":"2024-09-12T00:22:01.568920+0000","last_fullsized":"2024-09-12T00:22:01.568920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:07.728209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.935849+0000","last_change":"2024-09-12T00:22:50.935612+0000","last_active":"2024-09-12T00:22:50.935849+0000","last_peered":"2024-09-12T00:22:50.935849+0000","last_clean":"2024-09-12T00:22:50.935849+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:22:50.935849+0000","last_undegraded":"2024-09-12T00:22:50.935849+0000","last_fullsized":"2024-09-12T00:22:50.935849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.935377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:27.379599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.123005+0000","last_change":"2024-09-12T00:22:39.122842+0000","last_active":"2024-09-12T00:22:39.123005+0000","last_peered":"2024-09-12T00:22:39.123005+0000","last_clean":"2024-09-12T00:22:39.123005+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:22:39.123005+0000","last_undegraded":"2024-09-12T00:22:39.123005+0000","last_fullsized":"2024-09-12T00:22:39.123005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.122671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.081831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.755968+0000","last_change":"2024-09-12T00:22:37.755805+0000","last_active":"2024-09-12T00:22:37.755968+0000","last_peered":"2024-09-12T00:22:37.755968+0000","last_clean":"2024-09-12T00:22:37.755968+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:22:37.755968+0000","last_undegraded":"2024-09-12T00:22:37.755968+0000","last_fullsized":"2024-09-12T00:22:37.755968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.755556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:00.374036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.892359+0000","last_change":"2024-09-12T00:23:04.892359+0000","last_active":"2024-09-12T00:23:04.892359+0000","last_peered":"2024-09-12T00:23:04.892359+0000","last_clean":"2024-09-12T00:23:04.892359+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:23:04.892359+0000","last_undegraded":"2024-09-12T00:23:04.892359+0000","last_fullsized":"2024-09-12T00:23:04.892359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.892143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.673491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.872852+0000","last_change":"2024-09-12T00:18:50.244439+0000","last_active":"2024-09-12T00:22:00.872852+0000","last_peered":"2024-09-12T00:22:00.872852+0000","last_clean":"2024-09-12T00:22:00.872852+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:22:00.872852+0000","last_undegraded":"2024-09-12T00:22:00.872852+0000","last_fullsized":"2024-09-12T00:22:00.872852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.607824+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:21:02.607824+0000","last_peered":"2024-09-12T00:21:02.607824+0000","last_clean":"2024-09-12T00:21:02.607824+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:21:02.607824+0000","last_undegraded":"2024-09-12T00:21:02.607824+0000","last_fullsized":"2024-09-12T00:21:02.607824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.601372+0000","last_change":"2024-09-12T00:18:54.266515+0000","last_active":"2024-09-12T00:21:07.601372+0000","last_peered":"2024-09-12T00:21:07.601372+0000","last_clean":"2024-09-12T00:21:07.601372+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:21:07.601372+0000","last_undegraded":"2024-09-12T00:21:07.601372+0000","last_fullsized":"2024-09-12T00:21:07.601372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.391150+0000","last_change":"2024-09-12T00:22:51.390965+0000","last_active":"2024-09-12T00:22:51.391150+0000","last_peered":"2024-09-12T00:22:51.391150+0000","last_clean":"2024-09-12T00:22:51.391150+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:51.391150+0000","last_undegraded":"2024-09-12T00:22:51.391150+0000","last_fullsized":"2024-09-12T00:22:51.391150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.390779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:45.398139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.771257+0000","last_change":"2024-09-12T00:22:39.771132+0000","last_active":"2024-09-12T00:22:39.771257+0000","last_peered":"2024-09-12T00:22:39.771257+0000","last_clean":"2024-09-12T00:22:39.771257+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:22:39.771257+0000","last_undegraded":"2024-09-12T00:22:39.771257+0000","last_fullsized":"2024-09-12T00:22:39.771257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.770939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.724696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.712557+0000","last_change":"2024-09-12T00:22:38.712422+0000","last_active":"2024-09-12T00:22:38.712557+0000","last_peered":"2024-09-12T00:22:38.712557+0000","last_clean":"2024-09-12T00:22:38.712557+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:22:38.712557+0000","last_undegraded":"2024-09-12T00:22:38.712557+0000","last_fullsized":"2024-09-12T00:22:38.712557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.712222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:33.915095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.877769+0000","last_change":"2024-09-12T00:23:05.877769+0000","last_active":"2024-09-12T00:23:05.877769+0000","last_peered":"2024-09-12T00:23:05.877769+0000","last_clean":"2024-09-12T00:23:05.877769+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:23:05.877769+0000","last_undegraded":"2024-09-12T00:23:05.877769+0000","last_fullsized":"2024-09-12T00:23:05.877769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.877586+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.254000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'92","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.753759+0000","last_change":"2024-09-12T00:23:16.753759+0000","last_active":"2024-09-12T00:23:16.753759+0000","last_peered":"2024-09-12T00:23:16.753759+0000","last_clean":"2024-09-12T00:23:16.753759+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:23:16.753759+0000","last_undegraded":"2024-09-12T00:23:16.753759+0000","last_fullsized":"2024-09-12T00:23:16.753759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.753506+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.903478+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.594682+0000","last_change":"2024-09-12T00:18:52.246637+0000","last_active":"2024-09-12T00:20:57.594682+0000","last_peered":"2024-09-12T00:20:57.594682+0000","last_clean":"2024-09-12T00:20:57.594682+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:20:57.594682+0000","last_undegraded":"2024-09-12T00:20:57.594682+0000","last_fullsized":"2024-09-12T00:20:57.594682+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.796560+0000","last_change":"2024-09-12T00:18:54.256774+0000","last_active":"2024-09-12T00:21:00.796560+0000","last_peered":"2024-09-12T00:21:00.796560+0000","last_clean":"2024-09-12T00:21:00.796560+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:21:00.796560+0000","last_undegraded":"2024-09-12T00:21:00.796560+0000","last_fullsized":"2024-09-12T00:21:00.796560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:10.342888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.726884+0000","last_change":"2024-09-12T00:22:54.726884+0000","last_active":"2024-09-12T00:22:54.726884+0000","last_peered":"2024-09-12T00:22:54.726884+0000","last_clean":"2024-09-12T00:22:54.726884+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:22:54.726884+0000","last_undegraded":"2024-09-12T00:22:54.726884+0000","last_fullsized":"2024-09-12T00:22:54.726884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.726712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:01.342735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.855296+0000","last_change":"2024-09-12T00:22:42.855131+0000","last_active":"2024-09-12T00:22:42.855296+0000","last_peered":"2024-09-12T00:22:42.855296+0000","last_clean":"2024-09-12T00:22:42.855296+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:22:42.855296+0000","last_undegraded":"2024-09-12T00:22:42.855296+0000","last_fullsized":"2024-09-12T00:22:42.855296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.854911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.063391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.050175+0000","last_change":"2024-09-12T00:22:41.050057+0000","last_active":"2024-09-12T00:22:41.050175+0000","last_peered":"2024-09-12T00:22:41.050175+0000","last_clean":"2024-09-12T00:22:41.050175+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:22:41.050175+0000","last_undegraded":"2024-09-12T00:22:41.050175+0000","last_fullsized":"2024-09-12T00:22:41.050175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.049881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:33.601411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605429+0000","last_change":"2024-09-12T00:19:24.302239+0000","last_active":"2024-09-12T00:20:52.605429+0000","last_peered":"2024-09-12T00:20:52.605429+0000","last_clean":"2024-09-12T00:20:52.605429+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:20:52.605429+0000","last_undegraded":"2024-09-12T00:20:52.605429+0000","last_fullsized":"2024-09-12T00:20:52.605429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'20","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.599264+0000","last_change":"2024-09-12T00:18:50.230051+0000","last_active":"2024-09-12T00:20:57.599264+0000","last_peered":"2024-09-12T00:20:57.599264+0000","last_clean":"2024-09-12T00:20:57.599264+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:20:57.599264+0000","last_undegraded":"2024-09-12T00:20:57.599264+0000","last_fullsized":"2024-09-12T00:20:57.599264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":375,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.567592+0000","last_change":"2024-09-12T00:18:52.231955+0000","last_active":"2024-09-12T00:22:33.567592+0000","last_peered":"2024-09-12T00:22:33.567592+0000","last_clean":"2024-09-12T00:22:33.567592+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:22:33.567592+0000","last_undegraded":"2024-09-12T00:22:33.567592+0000","last_fullsized":"2024-09-12T00:22:33.567592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.298199+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:19:24.298199+0000","last_peered":"2024-09-12T00:19:24.298199+0000","last_clean":"2024-09-12T00:19:24.298199+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:19:24.298199+0000","last_undegraded":"2024-09-12T00:19:24.298199+0000","last_fullsized":"2024-09-12T00:19:24.298199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:29.660750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.162564+0000","last_change":"2024-09-12T00:23:05.162564+0000","last_active":"2024-09-12T00:23:05.162564+0000","last_peered":"2024-09-12T00:23:05.162564+0000","last_clean":"2024-09-12T00:23:05.162564+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:23:05.162564+0000","last_undegraded":"2024-09-12T00:23:05.162564+0000","last_fullsized":"2024-09-12T00:23:05.162564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.162392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:00.470991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.058734+0000","last_change":"2024-09-12T00:22:44.058569+0000","last_active":"2024-09-12T00:22:44.058734+0000","last_peered":"2024-09-12T00:22:44.058734+0000","last_clean":"2024-09-12T00:22:44.058734+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:44.058734+0000","last_undegraded":"2024-09-12T00:22:44.058734+0000","last_fullsized":"2024-09-12T00:22:44.058734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.058384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.669388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.675883+0000","last_change":"2024-09-12T00:22:37.675755+0000","last_active":"2024-09-12T00:22:37.675883+0000","last_peered":"2024-09-12T00:22:37.675883+0000","last_clean":"2024-09-12T00:22:37.675883+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:22:37.675883+0000","last_undegraded":"2024-09-12T00:22:37.675883+0000","last_fullsized":"2024-09-12T00:22:37.675883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.675639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:18.021676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605385+0000","last_change":"2024-09-12T00:18:48.214425+0000","last_active":"2024-09-12T00:20:52.605385+0000","last_peered":"2024-09-12T00:20:52.605385+0000","last_clean":"2024-09-12T00:20:52.605385+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:20:52.605385+0000","last_undegraded":"2024-09-12T00:20:52.605385+0000","last_fullsized":"2024-09-12T00:20:52.605385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.606387+0000","last_change":"2024-09-12T00:18:50.234909+0000","last_active":"2024-09-12T00:20:57.606387+0000","last_peered":"2024-09-12T00:20:57.606387+0000","last_clean":"2024-09-12T00:20:57.606387+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:20:57.606387+0000","last_undegraded":"2024-09-12T00:20:57.606387+0000","last_fullsized":"2024-09-12T00:20:57.606387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":405,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.579933+0000","last_change":"2024-09-12T00:18:52.239830+0000","last_active":"2024-09-12T00:22:33.579933+0000","last_peered":"2024-09-12T00:22:33.579933+0000","last_clean":"2024-09-12T00:22:33.579933+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:22:33.579933+0000","last_undegraded":"2024-09-12T00:22:33.579933+0000","last_fullsized":"2024-09-12T00:22:33.579933+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.280527+0000","last_change":"2024-09-12T00:18:54.265500+0000","last_active":"2024-09-12T00:19:24.280527+0000","last_peered":"2024-09-12T00:19:24.280527+0000","last_clean":"2024-09-12T00:19:24.280527+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:19:24.280527+0000","last_undegraded":"2024-09-12T00:19:24.280527+0000","last_fullsized":"2024-09-12T00:19:24.280527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.628935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.751001+0000","last_change":"2024-09-12T00:22:52.750826+0000","last_active":"2024-09-12T00:22:52.751001+0000","last_peered":"2024-09-12T00:22:52.751001+0000","last_clean":"2024-09-12T00:22:52.751001+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:52.751001+0000","last_undegraded":"2024-09-12T00:22:52.751001+0000","last_fullsized":"2024-09-12T00:22:52.751001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.750640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:43.087670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.284791+0000","last_change":"2024-09-12T00:22:37.284618+0000","last_active":"2024-09-12T00:22:37.284791+0000","last_peered":"2024-09-12T00:22:37.284791+0000","last_clean":"2024-09-12T00:22:37.284791+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:22:37.284791+0000","last_undegraded":"2024-09-12T00:22:37.284791+0000","last_fullsized":"2024-09-12T00:22:37.284791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.284374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:35.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.021196+0000","last_change":"2024-09-12T00:22:42.021039+0000","last_active":"2024-09-12T00:22:42.021196+0000","last_peered":"2024-09-12T00:22:42.021196+0000","last_clean":"2024-09-12T00:22:42.021196+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:22:42.021196+0000","last_undegraded":"2024-09-12T00:22:42.021196+0000","last_fullsized":"2024-09-12T00:22:42.021196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.020861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:34.147473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'4","reported_seq":230,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.225156+0000","last_change":"2024-09-12T00:18:48.213300+0000","last_active":"2024-09-12T00:22:33.225156+0000","last_peered":"2024-09-12T00:22:33.225156+0000","last_clean":"2024-09-12T00:22:33.225156+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:22:33.225156+0000","last_undegraded":"2024-09-12T00:22:33.225156+0000","last_fullsized":"2024-09-12T00:22:33.225156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'107","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.815851+0000","last_change":"2024-09-12T00:23:12.815851+0000","last_active":"2024-09-12T00:23:12.815851+0000","last_peered":"2024-09-12T00:23:12.815851+0000","last_clean":"2024-09-12T00:23:12.815851+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:23:12.815851+0000","last_undegraded":"2024-09-12T00:23:12.815851+0000","last_fullsized":"2024-09-12T00:23:12.815851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'107","last_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_deep_scrub":"33'107","last_deep_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.815651+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:02.753655+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.598457+0000","last_change":"2024-09-12T00:18:52.239142+0000","last_active":"2024-09-12T00:20:57.598457+0000","last_peered":"2024-09-12T00:20:57.598457+0000","last_clean":"2024-09-12T00:20:57.598457+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:20:57.598457+0000","last_undegraded":"2024-09-12T00:20:57.598457+0000","last_fullsized":"2024-09-12T00:20:57.598457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274807+0000","last_change":"2024-09-12T00:18:54.259093+0000","last_active":"2024-09-12T00:19:24.274807+0000","last_peered":"2024-09-12T00:19:24.274807+0000","last_clean":"2024-09-12T00:19:24.274807+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:19:24.274807+0000","last_undegraded":"2024-09-12T00:19:24.274807+0000","last_fullsized":"2024-09-12T00:19:24.274807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:27.477620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.104096+0000","last_change":"2024-09-12T00:18:54.274591+0000","last_active":"2024-09-12T00:22:02.104096+0000","last_peered":"2024-09-12T00:22:02.104096+0000","last_clean":"2024-09-12T00:22:02.104096+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:22:02.104096+0000","last_undegraded":"2024-09-12T00:22:02.104096+0000","last_fullsized":"2024-09-12T00:22:02.104096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.736086+0000","last_change":"2024-09-12T00:22:58.736086+0000","last_active":"2024-09-12T00:22:58.736086+0000","last_peered":"2024-09-12T00:22:58.736086+0000","last_clean":"2024-09-12T00:22:58.736086+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:58.736086+0000","last_undegraded":"2024-09-12T00:22:58.736086+0000","last_fullsized":"2024-09-12T00:22:58.736086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.735904+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.200548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.009865+0000","last_change":"2024-09-12T00:22:52.009865+0000","last_active":"2024-09-12T00:22:52.009865+0000","last_peered":"2024-09-12T00:22:52.009865+0000","last_clean":"2024-09-12T00:22:52.009865+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:22:52.009865+0000","last_undegraded":"2024-09-12T00:22:52.009865+0000","last_fullsized":"2024-09-12T00:22:52.009865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.009684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.867922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.391496+0000","last_change":"2024-09-12T00:23:13.391496+0000","last_active":"2024-09-12T00:23:13.391496+0000","last_peered":"2024-09-12T00:23:13.391496+0000","last_clean":"2024-09-12T00:23:13.391496+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:23:13.391496+0000","last_undegraded":"2024-09-12T00:23:13.391496+0000","last_fullsized":"2024-09-12T00:23:13.391496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.391315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:03.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.352149+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:22:33.352149+0000","last_peered":"2024-09-12T00:22:33.352149+0000","last_clean":"2024-09-12T00:22:33.352149+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:22:33.352149+0000","last_undegraded":"2024-09-12T00:22:33.352149+0000","last_fullsized":"2024-09-12T00:22:33.352149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:37.592326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.278930+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:19:24.278930+0000","last_peered":"2024-09-12T00:19:24.278930+0000","last_clean":"2024-09-12T00:19:24.278930+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:19:24.278930+0000","last_undegraded":"2024-09-12T00:19:24.278930+0000","last_fullsized":"2024-09-12T00:19:24.278930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:40.093449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.849090+0000","last_change":"2024-09-12T00:18:54.269732+0000","last_active":"2024-09-12T00:20:57.849090+0000","last_peered":"2024-09-12T00:20:57.849090+0000","last_clean":"2024-09-12T00:20:57.849090+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:20:57.849090+0000","last_undegraded":"2024-09-12T00:20:57.849090+0000","last_fullsized":"2024-09-12T00:20:57.849090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.391625+0000","last_change":"2024-09-12T00:22:58.391625+0000","last_active":"2024-09-12T00:22:58.391625+0000","last_peered":"2024-09-12T00:22:58.391625+0000","last_clean":"2024-09-12T00:22:58.391625+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:58.391625+0000","last_undegraded":"2024-09-12T00:22:58.391625+0000","last_fullsized":"2024-09-12T00:22:58.391625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.391445+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.604030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.779281+0000","last_change":"2024-09-12T00:22:42.779281+0000","last_active":"2024-09-12T00:22:42.779281+0000","last_peered":"2024-09-12T00:22:42.779281+0000","last_clean":"2024-09-12T00:22:42.779281+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:22:42.779281+0000","last_undegraded":"2024-09-12T00:22:42.779281+0000","last_fullsized":"2024-09-12T00:22:42.779281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.779092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.713311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.287698+0000","last_change":"2024-09-12T00:18:48.220803+0000","last_active":"2024-09-12T00:19:24.287698+0000","last_peered":"2024-09-12T00:19:24.287698+0000","last_clean":"2024-09-12T00:19:24.287698+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:19:24.287698+0000","last_undegraded":"2024-09-12T00:19:24.287698+0000","last_fullsized":"2024-09-12T00:19:24.287698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:37.810616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:00.845521+0000","last_change":"2024-09-12T00:18:50.215122+0000","last_active":"2024-09-12T00:22:00.845521+0000","last_peered":"2024-09-12T00:22:00.845521+0000","last_clean":"2024-09-12T00:22:00.845521+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:22:00.845521+0000","last_undegraded":"2024-09-12T00:22:00.845521+0000","last_fullsized":"2024-09-12T00:22:00.845521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:02.950831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.265613+0000","last_change":"2024-09-12T00:18:52.264452+0000","last_active":"2024-09-12T00:19:24.265613+0000","last_peered":"2024-09-12T00:19:24.265613+0000","last_clean":"2024-09-12T00:19:24.265613+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:19:24.265613+0000","last_undegraded":"2024-09-12T00:19:24.265613+0000","last_fullsized":"2024-09-12T00:19:24.265613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.335924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.942747+0000","last_change":"2024-09-12T00:22:54.942747+0000","last_active":"2024-09-12T00:22:54.942747+0000","last_peered":"2024-09-12T00:22:54.942747+0000","last_clean":"2024-09-12T00:22:54.942747+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:54.942747+0000","last_undegraded":"2024-09-12T00:22:54.942747+0000","last_fullsized":"2024-09-12T00:22:54.942747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.942553+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:15.834853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.806286+0000","last_change":"2024-09-12T00:22:44.806286+0000","last_active":"2024-09-12T00:22:44.806286+0000","last_peered":"2024-09-12T00:22:44.806286+0000","last_clean":"2024-09-12T00:22:44.806286+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:22:44.806286+0000","last_undegraded":"2024-09-12T00:22:44.806286+0000","last_fullsized":"2024-09-12T00:22:44.806286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.806101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.067872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.696289+0000","last_change":"2024-09-12T00:23:08.696289+0000","last_active":"2024-09-12T00:23:08.696289+0000","last_peered":"2024-09-12T00:23:08.696289+0000","last_clean":"2024-09-12T00:23:08.696289+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:23:08.696289+0000","last_undegraded":"2024-09-12T00:23:08.696289+0000","last_fullsized":"2024-09-12T00:23:08.696289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.696055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'51","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.851378+0000","last_change":"2024-09-12T00:23:12.851378+0000","last_active":"2024-09-12T00:23:12.851378+0000","last_peered":"2024-09-12T00:23:12.851378+0000","last_clean":"2024-09-12T00:23:12.851378+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:23:12.851378+0000","last_undegraded":"2024-09-12T00:23:12.851378+0000","last_fullsized":"2024-09-12T00:23:12.851378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.851186+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:10.082578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272132+0000","last_change":"2024-09-12T00:18:52.237721+0000","last_active":"2024-09-12T00:19:24.272132+0000","last_peered":"2024-09-12T00:19:24.272132+0000","last_clean":"2024-09-12T00:19:24.272132+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:19:24.272132+0000","last_undegraded":"2024-09-12T00:19:24.272132+0000","last_fullsized":"2024-09-12T00:19:24.272132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:59.421893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.990006+0000","last_change":"2024-09-12T00:23:10.990006+0000","last_active":"2024-09-12T00:23:10.990006+0000","last_peered":"2024-09-12T00:23:10.990006+0000","last_clean":"2024-09-12T00:23:10.990006+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:23:10.990006+0000","last_undegraded":"2024-09-12T00:23:10.990006+0000","last_fullsized":"2024-09-12T00:23:10.990006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.989822+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:55.630091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.300694+0000","last_change":"2024-09-12T00:22:39.300694+0000","last_active":"2024-09-12T00:22:39.300694+0000","last_peered":"2024-09-12T00:22:39.300694+0000","last_clean":"2024-09-12T00:22:39.300694+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:39.300694+0000","last_undegraded":"2024-09-12T00:22:39.300694+0000","last_fullsized":"2024-09-12T00:22:39.300694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.300502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:21.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.277305+0000","last_change":"2024-09-12T00:18:48.216699+0000","last_active":"2024-09-12T00:19:24.277305+0000","last_peered":"2024-09-12T00:19:24.277305+0000","last_clean":"2024-09-12T00:19:24.277305+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:19:24.277305+0000","last_undegraded":"2024-09-12T00:19:24.277305+0000","last_fullsized":"2024-09-12T00:19:24.277305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:00.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'37","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.718828+0000","last_change":"2024-09-12T00:23:16.718828+0000","last_active":"2024-09-12T00:23:16.718828+0000","last_peered":"2024-09-12T00:23:16.718828+0000","last_clean":"2024-09-12T00:23:16.718828+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:23:16.718828+0000","last_undegraded":"2024-09-12T00:23:16.718828+0000","last_fullsized":"2024-09-12T00:23:16.718828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.718625+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.155804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.268222+0000","last_change":"2024-09-12T00:18:52.251949+0000","last_active":"2024-09-12T00:19:24.268222+0000","last_peered":"2024-09-12T00:19:24.268222+0000","last_clean":"2024-09-12T00:19:24.268222+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:19:24.268222+0000","last_undegraded":"2024-09-12T00:19:24.268222+0000","last_fullsized":"2024-09-12T00:19:24.268222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:41.746353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.925830+0000","last_change":"2024-09-12T00:23:15.925830+0000","last_active":"2024-09-12T00:23:15.925830+0000","last_peered":"2024-09-12T00:23:15.925830+0000","last_clean":"2024-09-12T00:23:15.925830+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:23:15.925830+0000","last_undegraded":"2024-09-12T00:23:15.925830+0000","last_fullsized":"2024-09-12T00:23:15.925830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.925622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.066023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.034956+0000","last_change":"2024-09-12T00:22:53.034956+0000","last_active":"2024-09-12T00:22:53.034956+0000","last_peered":"2024-09-12T00:22:53.034956+0000","last_clean":"2024-09-12T00:22:53.034956+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:22:53.034956+0000","last_undegraded":"2024-09-12T00:22:53.034956+0000","last_fullsized":"2024-09-12T00:22:53.034956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.034651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:57.265344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:47.595959+0000","last_change":"2024-09-12T00:18:48.208866+0000","last_active":"2024-09-12T00:20:47.595959+0000","last_peered":"2024-09-12T00:20:47.595959+0000","last_clean":"2024-09-12T00:20:47.595959+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:20:47.595959+0000","last_undegraded":"2024-09-12T00:20:47.595959+0000","last_fullsized":"2024-09-12T00:20:47.595959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'72","reported_seq":151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.815989+0000","last_change":"2024-09-12T00:23:13.815989+0000","last_active":"2024-09-12T00:23:13.815989+0000","last_peered":"2024-09-12T00:23:13.815989+0000","last_clean":"2024-09-12T00:23:13.815989+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:23:13.815989+0000","last_undegraded":"2024-09-12T00:23:13.815989+0000","last_fullsized":"2024-09-12T00:23:13.815989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.815744+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:18.956083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.275640+0000","last_change":"2024-09-12T00:18:52.252092+0000","last_active":"2024-09-12T00:19:24.275640+0000","last_peered":"2024-09-12T00:19:24.275640+0000","last_clean":"2024-09-12T00:19:24.275640+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:19:24.275640+0000","last_undegraded":"2024-09-12T00:19:24.275640+0000","last_fullsized":"2024-09-12T00:19:24.275640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:48.320813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.694080+0000","last_change":"2024-09-12T00:18:54.257409+0000","last_active":"2024-09-12T00:22:01.694080+0000","last_peered":"2024-09-12T00:22:01.694080+0000","last_clean":"2024-09-12T00:22:01.694080+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:22:01.694080+0000","last_undegraded":"2024-09-12T00:22:01.694080+0000","last_fullsized":"2024-09-12T00:22:01.694080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:18.515365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'16","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.878714+0000","last_change":"2024-09-12T00:23:03.878714+0000","last_active":"2024-09-12T00:23:03.878714+0000","last_peered":"2024-09-12T00:23:03.878714+0000","last_clean":"2024-09-12T00:23:03.878714+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:23:03.878714+0000","last_undegraded":"2024-09-12T00:23:03.878714+0000","last_fullsized":"2024-09-12T00:23:03.878714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.878512+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:25.214968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.306113+0000","last_change":"2024-09-12T00:22:40.306113+0000","last_active":"2024-09-12T00:22:40.306113+0000","last_peered":"2024-09-12T00:22:40.306113+0000","last_clean":"2024-09-12T00:22:40.306113+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:22:40.306113+0000","last_undegraded":"2024-09-12T00:22:40.306113+0000","last_fullsized":"2024-09-12T00:22:40.306113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.305907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.508780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.794996+0000","last_change":"2024-09-12T00:23:11.794996+0000","last_active":"2024-09-12T00:23:11.794996+0000","last_peered":"2024-09-12T00:23:11.794996+0000","last_clean":"2024-09-12T00:23:11.794996+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:23:11.794996+0000","last_undegraded":"2024-09-12T00:23:11.794996+0000","last_fullsized":"2024-09-12T00:23:11.794996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.794802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.268181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'40","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.479270+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:22:33.479270+0000","last_peered":"2024-09-12T00:22:33.479270+0000","last_clean":"2024-09-12T00:22:33.479270+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:22:33.479270+0000","last_undegraded":"2024-09-12T00:22:33.479270+0000","last_fullsized":"2024-09-12T00:22:33.479270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.283292+0000","last_change":"2024-09-12T00:18:52.244450+0000","last_active":"2024-09-12T00:19:24.283292+0000","last_peered":"2024-09-12T00:19:24.283292+0000","last_clean":"2024-09-12T00:19:24.283292+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:19:24.283292+0000","last_undegraded":"2024-09-12T00:19:24.283292+0000","last_fullsized":"2024-09-12T00:19:24.283292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:45.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.276722+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:19:24.276722+0000","last_peered":"2024-09-12T00:19:24.276722+0000","last_clean":"2024-09-12T00:19:24.276722+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:19:24.276722+0000","last_undegraded":"2024-09-12T00:19:24.276722+0000","last_fullsized":"2024-09-12T00:19:24.276722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:32.375550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.922836+0000","last_change":"2024-09-12T00:23:14.922836+0000","last_active":"2024-09-12T00:23:14.922836+0000","last_peered":"2024-09-12T00:23:14.922836+0000","last_clean":"2024-09-12T00:23:14.922836+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:23:14.922836+0000","last_undegraded":"2024-09-12T00:23:14.922836+0000","last_fullsized":"2024-09-12T00:23:14.922836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.922649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:06.834122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.385967+0000","last_change":"2024-09-12T00:22:42.385967+0000","last_active":"2024-09-12T00:22:42.385967+0000","last_peered":"2024-09-12T00:22:42.385967+0000","last_clean":"2024-09-12T00:22:42.385967+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:22:42.385967+0000","last_undegraded":"2024-09-12T00:22:42.385967+0000","last_fullsized":"2024-09-12T00:22:42.385967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.385774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:36.864966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.762434+0000","last_change":"2024-09-12T00:23:10.762434+0000","last_active":"2024-09-12T00:23:10.762434+0000","last_peered":"2024-09-12T00:23:10.762434+0000","last_clean":"2024-09-12T00:23:10.762434+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:23:10.762434+0000","last_undegraded":"2024-09-12T00:23:10.762434+0000","last_fullsized":"2024-09-12T00:23:10.762434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.762259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:08.326149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.850131+0000","last_change":"2024-09-12T00:23:11.850131+0000","last_active":"2024-09-12T00:23:11.850131+0000","last_peered":"2024-09-12T00:23:11.850131+0000","last_clean":"2024-09-12T00:23:11.850131+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:23:11.850131+0000","last_undegraded":"2024-09-12T00:23:11.850131+0000","last_fullsized":"2024-09-12T00:23:11.850131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.849946+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.522162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.597248+0000","last_change":"2024-09-12T00:18:52.239182+0000","last_active":"2024-09-12T00:20:52.597248+0000","last_peered":"2024-09-12T00:20:52.597248+0000","last_clean":"2024-09-12T00:20:52.597248+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:20:52.597248+0000","last_undegraded":"2024-09-12T00:20:52.597248+0000","last_fullsized":"2024-09-12T00:20:52.597248+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:00.789720+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:00.789720+0000","last_peered":"2024-09-12T00:21:00.789720+0000","last_clean":"2024-09-12T00:21:00.789720+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:00.789720+0000","last_undegraded":"2024-09-12T00:21:00.789720+0000","last_fullsized":"2024-09-12T00:21:00.789720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.401232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.936957+0000","last_change":"2024-09-12T00:22:55.936957+0000","last_active":"2024-09-12T00:22:55.936957+0000","last_peered":"2024-09-12T00:22:55.936957+0000","last_clean":"2024-09-12T00:22:55.936957+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:55.936957+0000","last_undegraded":"2024-09-12T00:22:55.936957+0000","last_fullsized":"2024-09-12T00:22:55.936957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.936751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.262382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.067458+0000","last_change":"2024-09-12T00:22:54.067458+0000","last_active":"2024-09-12T00:22:54.067458+0000","last_peered":"2024-09-12T00:22:54.067458+0000","last_clean":"2024-09-12T00:22:54.067458+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:22:54.067458+0000","last_undegraded":"2024-09-12T00:22:54.067458+0000","last_fullsized":"2024-09-12T00:22:54.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.067268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:29.961955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.286146+0000","last_change":"2024-09-12T00:18:48.215182+0000","last_active":"2024-09-12T00:19:24.286146+0000","last_peered":"2024-09-12T00:19:24.286146+0000","last_clean":"2024-09-12T00:19:24.286146+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:19:24.286146+0000","last_undegraded":"2024-09-12T00:19:24.286146+0000","last_fullsized":"2024-09-12T00:19:24.286146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:47.173968+0000","last_clean_scrub_stamp":"2024-09-12T00:18:47.173968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.583808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605672+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:20:52.605672+0000","last_peered":"2024-09-12T00:20:52.605672+0000","last_clean":"2024-09-12T00:20:52.605672+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:20:52.605672+0000","last_undegraded":"2024-09-12T00:20:52.605672+0000","last_fullsized":"2024-09-12T00:20:52.605672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.564932+0000","last_change":"2024-09-12T00:18:52.264342+0000","last_active":"2024-09-12T00:22:33.564932+0000","last_peered":"2024-09-12T00:22:33.564932+0000","last_clean":"2024-09-12T00:22:33.564932+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:22:33.564932+0000","last_undegraded":"2024-09-12T00:22:33.564932+0000","last_fullsized":"2024-09-12T00:22:33.564932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.272149+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:19:24.272149+0000","last_peered":"2024-09-12T00:19:24.272149+0000","last_clean":"2024-09-12T00:19:24.272149+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:19:24.272149+0000","last_undegraded":"2024-09-12T00:19:24.272149+0000","last_fullsized":"2024-09-12T00:19:24.272149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:25.701299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.691998+0000","last_change":"2024-09-12T00:23:01.691998+0000","last_active":"2024-09-12T00:23:01.691998+0000","last_peered":"2024-09-12T00:23:01.691998+0000","last_clean":"2024-09-12T00:23:01.691998+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:23:01.691998+0000","last_undegraded":"2024-09-12T00:23:01.691998+0000","last_fullsized":"2024-09-12T00:23:01.691998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.691825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.900305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.393154+0000","last_change":"2024-09-12T00:22:43.393154+0000","last_active":"2024-09-12T00:22:43.393154+0000","last_peered":"2024-09-12T00:22:43.393154+0000","last_clean":"2024-09-12T00:22:43.393154+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:22:43.393154+0000","last_undegraded":"2024-09-12T00:22:43.393154+0000","last_fullsized":"2024-09-12T00:22:43.393154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.392968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:10.459069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.294939+0000","last_change":"2024-09-12T00:23:17.294939+0000","last_active":"2024-09-12T00:23:17.294939+0000","last_peered":"2024-09-12T00:23:17.294939+0000","last_clean":"2024-09-12T00:23:17.294939+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:23:17.294939+0000","last_undegraded":"2024-09-12T00:23:17.294939+0000","last_fullsized":"2024-09-12T00:23:17.294939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.294701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.708016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'66","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.416826+0000","last_change":"2024-09-12T00:18:50.236795+0000","last_active":"2024-09-12T00:22:33.416826+0000","last_peered":"2024-09-12T00:22:33.416826+0000","last_clean":"2024-09-12T00:22:33.416826+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:22:33.416826+0000","last_undegraded":"2024-09-12T00:22:33.416826+0000","last_fullsized":"2024-09-12T00:22:33.416826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:37.205921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.543096+0000","last_change":"2024-09-12T00:18:52.245487+0000","last_active":"2024-09-12T00:19:24.543096+0000","last_peered":"2024-09-12T00:19:24.543096+0000","last_clean":"2024-09-12T00:19:24.543096+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:19:24.543096+0000","last_undegraded":"2024-09-12T00:19:24.543096+0000","last_fullsized":"2024-09-12T00:19:24.543096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.830664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:31.781688+0000","last_change":"2024-09-12T00:18:54.263306+0000","last_active":"2024-09-12T00:19:31.781688+0000","last_peered":"2024-09-12T00:19:31.781688+0000","last_clean":"2024-09-12T00:19:31.781688+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:19:31.781688+0000","last_undegraded":"2024-09-12T00:19:31.781688+0000","last_fullsized":"2024-09-12T00:19:31.781688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:23.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.686548+0000","last_change":"2024-09-12T00:23:00.686548+0000","last_active":"2024-09-12T00:23:00.686548+0000","last_peered":"2024-09-12T00:23:00.686548+0000","last_clean":"2024-09-12T00:23:00.686548+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:23:00.686548+0000","last_undegraded":"2024-09-12T00:23:00.686548+0000","last_fullsized":"2024-09-12T00:23:00.686548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.686366+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:12.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.088790+0000","last_change":"2024-09-12T00:22:55.088790+0000","last_active":"2024-09-12T00:22:55.088790+0000","last_peered":"2024-09-12T00:22:55.088790+0000","last_clean":"2024-09-12T00:22:55.088790+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:55.088790+0000","last_undegraded":"2024-09-12T00:22:55.088790+0000","last_fullsized":"2024-09-12T00:22:55.088790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.088613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:30.497345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.719313+0000","last_change":"2024-09-12T00:23:09.719313+0000","last_active":"2024-09-12T00:23:09.719313+0000","last_peered":"2024-09-12T00:23:09.719313+0000","last_clean":"2024-09-12T00:23:09.719313+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:23:09.719313+0000","last_undegraded":"2024-09-12T00:23:09.719313+0000","last_fullsized":"2024-09-12T00:23:09.719313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.719094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.163316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'40","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.426637+0000","last_change":"2024-09-12T00:18:50.224921+0000","last_active":"2024-09-12T00:22:33.426637+0000","last_peered":"2024-09-12T00:22:33.426637+0000","last_clean":"2024-09-12T00:22:33.426637+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:22:33.426637+0000","last_undegraded":"2024-09-12T00:22:33.426637+0000","last_fullsized":"2024-09-12T00:22:33.426637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:49.074708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.976316+0000","last_change":"2024-09-12T00:23:11.976316+0000","last_active":"2024-09-12T00:23:11.976316+0000","last_peered":"2024-09-12T00:23:11.976316+0000","last_clean":"2024-09-12T00:23:11.976316+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:23:11.976316+0000","last_undegraded":"2024-09-12T00:23:11.976316+0000","last_fullsized":"2024-09-12T00:23:11.976316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.976131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:32.650876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.782465+0000","last_change":"2024-09-12T00:22:40.782298+0000","last_active":"2024-09-12T00:22:40.782465+0000","last_peered":"2024-09-12T00:22:40.782465+0000","last_clean":"2024-09-12T00:22:40.782465+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:22:40.782465+0000","last_undegraded":"2024-09-12T00:22:40.782465+0000","last_fullsized":"2024-09-12T00:22:40.782465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.782108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.669423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.331937+0000","last_change":"2024-09-12T00:23:15.331937+0000","last_active":"2024-09-12T00:23:15.331937+0000","last_peered":"2024-09-12T00:23:15.331937+0000","last_clean":"2024-09-12T00:23:15.331937+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:23:15.331937+0000","last_undegraded":"2024-09-12T00:23:15.331937+0000","last_fullsized":"2024-09-12T00:23:15.331937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.331763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:20.472102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'35","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.360679+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:22:33.360679+0000","last_peered":"2024-09-12T00:22:33.360679+0000","last_clean":"2024-09-12T00:22:33.360679+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:22:33.360679+0000","last_undegraded":"2024-09-12T00:22:33.360679+0000","last_fullsized":"2024-09-12T00:22:33.360679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.718700+0000","last_change":"2024-09-12T00:22:59.718700+0000","last_active":"2024-09-12T00:22:59.718700+0000","last_peered":"2024-09-12T00:22:59.718700+0000","last_clean":"2024-09-12T00:22:59.718700+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:59.718700+0000","last_undegraded":"2024-09-12T00:22:59.718700+0000","last_fullsized":"2024-09-12T00:22:59.718700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.718519+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:09.605835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.419905+0000","last_change":"2024-09-12T00:22:44.419775+0000","last_active":"2024-09-12T00:22:44.419905+0000","last_peered":"2024-09-12T00:22:44.419905+0000","last_clean":"2024-09-12T00:22:44.419905+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:22:44.419905+0000","last_undegraded":"2024-09-12T00:22:44.419905+0000","last_fullsized":"2024-09-12T00:22:44.419905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.419592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:33.207405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.320735+0000","last_change":"2024-09-12T00:23:16.320735+0000","last_active":"2024-09-12T00:23:16.320735+0000","last_peered":"2024-09-12T00:23:16.320735+0000","last_clean":"2024-09-12T00:23:16.320735+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:23:16.320735+0000","last_undegraded":"2024-09-12T00:23:16.320735+0000","last_fullsized":"2024-09-12T00:23:16.320735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.320511+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:44.404081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'47","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.378393+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:33.378393+0000","last_peered":"2024-09-12T00:22:33.378393+0000","last_clean":"2024-09-12T00:22:33.378393+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:33.378393+0000","last_undegraded":"2024-09-12T00:22:33.378393+0000","last_fullsized":"2024-09-12T00:22:33.378393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.547191+0000","last_change":"2024-09-12T00:18:52.243498+0000","last_active":"2024-09-12T00:19:24.547191+0000","last_peered":"2024-09-12T00:19:24.547191+0000","last_clean":"2024-09-12T00:19:24.547191+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:19:24.547191+0000","last_undegraded":"2024-09-12T00:19:24.547191+0000","last_fullsized":"2024-09-12T00:19:24.547191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:36.372227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:58.284958+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:20:58.284958+0000","last_peered":"2024-09-12T00:20:58.284958+0000","last_clean":"2024-09-12T00:20:58.284958+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:20:58.284958+0000","last_undegraded":"2024-09-12T00:20:58.284958+0000","last_fullsized":"2024-09-12T00:20:58.284958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.364318+0000","last_change":"2024-09-12T00:22:56.364160+0000","last_active":"2024-09-12T00:22:56.364318+0000","last_peered":"2024-09-12T00:22:56.364318+0000","last_clean":"2024-09-12T00:22:56.364318+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:22:56.364318+0000","last_undegraded":"2024-09-12T00:22:56.364318+0000","last_fullsized":"2024-09-12T00:22:56.364318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.363976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.256275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.797911+0000","last_change":"2024-09-12T00:22:45.797737+0000","last_active":"2024-09-12T00:22:45.797911+0000","last_peered":"2024-09-12T00:22:45.797911+0000","last_clean":"2024-09-12T00:22:45.797911+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:22:45.797911+0000","last_undegraded":"2024-09-12T00:22:45.797911+0000","last_fullsized":"2024-09-12T00:22:45.797911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.797484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:00.294956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.808574+0000","last_change":"2024-09-12T00:23:07.808574+0000","last_active":"2024-09-12T00:23:07.808574+0000","last_peered":"2024-09-12T00:23:07.808574+0000","last_clean":"2024-09-12T00:23:07.808574+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:23:07.808574+0000","last_undegraded":"2024-09-12T00:23:07.808574+0000","last_fullsized":"2024-09-12T00:23:07.808574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.808393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.826760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.857883+0000","last_change":"2024-09-12T00:22:44.857717+0000","last_active":"2024-09-12T00:22:44.857883+0000","last_peered":"2024-09-12T00:22:44.857883+0000","last_clean":"2024-09-12T00:22:44.857883+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:22:44.857883+0000","last_undegraded":"2024-09-12T00:22:44.857883+0000","last_fullsized":"2024-09-12T00:22:44.857883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.857528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:34.268174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.885038+0000","last_change":"2024-09-12T00:23:16.885038+0000","last_active":"2024-09-12T00:23:16.885038+0000","last_peered":"2024-09-12T00:23:16.885038+0000","last_clean":"2024-09-12T00:23:16.885038+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:23:16.885038+0000","last_undegraded":"2024-09-12T00:23:16.885038+0000","last_fullsized":"2024-09-12T00:23:16.885038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.884827+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.406267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.064313+0000","last_change":"2024-09-12T00:22:56.064142+0000","last_active":"2024-09-12T00:22:56.064313+0000","last_peered":"2024-09-12T00:22:56.064313+0000","last_clean":"2024-09-12T00:22:56.064313+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:22:56.064313+0000","last_undegraded":"2024-09-12T00:22:56.064313+0000","last_fullsized":"2024-09-12T00:22:56.064313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.063956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.325584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.875973+0000","last_change":"2024-09-12T00:23:02.875774+0000","last_active":"2024-09-12T00:23:02.875973+0000","last_peered":"2024-09-12T00:23:02.875973+0000","last_clean":"2024-09-12T00:23:02.875973+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:23:02.875973+0000","last_undegraded":"2024-09-12T00:23:02.875973+0000","last_fullsized":"2024-09-12T00:23:02.875973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.875589+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.470261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.951519+0000","last_change":"2024-09-12T00:22:51.951351+0000","last_active":"2024-09-12T00:22:51.951519+0000","last_peered":"2024-09-12T00:22:51.951519+0000","last_clean":"2024-09-12T00:22:51.951519+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:22:51.951519+0000","last_undegraded":"2024-09-12T00:22:51.951519+0000","last_fullsized":"2024-09-12T00:22:51.951519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.951154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:49.515044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.882172+0000","last_change":"2024-09-12T00:22:58.882172+0000","last_active":"2024-09-12T00:22:58.882172+0000","last_peered":"2024-09-12T00:22:58.882172+0000","last_clean":"2024-09-12T00:22:58.882172+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:58.882172+0000","last_undegraded":"2024-09-12T00:22:58.882172+0000","last_fullsized":"2024-09-12T00:22:58.882172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.881909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:59.881831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.860676+0000","last_change":"2024-09-12T00:22:47.860535+0000","last_active":"2024-09-12T00:22:47.860676+0000","last_peered":"2024-09-12T00:22:47.860676+0000","last_clean":"2024-09-12T00:22:47.860676+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:22:47.860676+0000","last_undegraded":"2024-09-12T00:22:47.860676+0000","last_fullsized":"2024-09-12T00:22:47.860676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.860353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.356404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.351486+0000","last_change":"2024-09-12T00:22:57.351196+0000","last_active":"2024-09-12T00:22:57.351486+0000","last_peered":"2024-09-12T00:22:57.351486+0000","last_clean":"2024-09-12T00:22:57.351486+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:57.351486+0000","last_undegraded":"2024-09-12T00:22:57.351486+0000","last_fullsized":"2024-09-12T00:22:57.351486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.350978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:29.676609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.419200+0000","last_change":"2024-09-12T00:22:45.418904+0000","last_active":"2024-09-12T00:22:45.419200+0000","last_peered":"2024-09-12T00:22:45.419200+0000","last_clean":"2024-09-12T00:22:45.419200+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:22:45.419200+0000","last_undegraded":"2024-09-12T00:22:45.419200+0000","last_fullsized":"2024-09-12T00:22:45.419200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.418677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:28.543265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.889052+0000","last_change":"2024-09-12T00:23:01.889052+0000","last_active":"2024-09-12T00:23:01.889052+0000","last_peered":"2024-09-12T00:23:01.889052+0000","last_clean":"2024-09-12T00:23:01.889052+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:23:01.889052+0000","last_undegraded":"2024-09-12T00:23:01.889052+0000","last_fullsized":"2024-09-12T00:23:01.889052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.888826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:23.218572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.761030+0000","last_change":"2024-09-12T00:22:46.760728+0000","last_active":"2024-09-12T00:22:46.761030+0000","last_peered":"2024-09-12T00:22:46.761030+0000","last_clean":"2024-09-12T00:22:46.761030+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:22:46.761030+0000","last_undegraded":"2024-09-12T00:22:46.761030+0000","last_fullsized":"2024-09-12T00:22:46.761030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.760505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:03.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.411438+0000","last_change":"2024-09-12T00:22:55.411268+0000","last_active":"2024-09-12T00:22:55.411438+0000","last_peered":"2024-09-12T00:22:55.411438+0000","last_clean":"2024-09-12T00:22:55.411438+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:55.411438+0000","last_undegraded":"2024-09-12T00:22:55.411438+0000","last_fullsized":"2024-09-12T00:22:55.411438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.411085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.955659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.837988+0000","last_change":"2024-09-12T00:22:43.837801+0000","last_active":"2024-09-12T00:22:43.837988+0000","last_peered":"2024-09-12T00:22:43.837988+0000","last_clean":"2024-09-12T00:22:43.837988+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:22:43.837988+0000","last_undegraded":"2024-09-12T00:22:43.837988+0000","last_fullsized":"2024-09-12T00:22:43.837988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.837619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:26.962207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.433443+0000","last_change":"2024-09-12T00:23:04.433443+0000","last_active":"2024-09-12T00:23:04.433443+0000","last_peered":"2024-09-12T00:23:04.433443+0000","last_clean":"2024-09-12T00:23:04.433443+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:23:04.433443+0000","last_undegraded":"2024-09-12T00:23:04.433443+0000","last_fullsized":"2024-09-12T00:23:04.433443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.433267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:39.027939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.127791+0000","last_change":"2024-09-12T00:22:58.127664+0000","last_active":"2024-09-12T00:22:58.127791+0000","last_peered":"2024-09-12T00:22:58.127791+0000","last_clean":"2024-09-12T00:22:58.127791+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:22:58.127791+0000","last_undegraded":"2024-09-12T00:22:58.127791+0000","last_fullsized":"2024-09-12T00:22:58.127791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.127465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.328805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.904821+0000","last_change":"2024-09-12T00:18:46.197439+0000","last_active":"2024-09-12T00:22:01.904821+0000","last_peered":"2024-09-12T00:22:01.904821+0000","last_clean":"2024-09-12T00:22:01.904821+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:22:01.904821+0000","last_undegraded":"2024-09-12T00:22:01.904821+0000","last_fullsized":"2024-09-12T00:22:01.904821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:48.380544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.829130+0000","last_change":"2024-09-12T00:22:45.828950+0000","last_active":"2024-09-12T00:22:45.829130+0000","last_peered":"2024-09-12T00:22:45.829130+0000","last_clean":"2024-09-12T00:22:45.829130+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:22:45.829130+0000","last_undegraded":"2024-09-12T00:22:45.829130+0000","last_fullsized":"2024-09-12T00:22:45.829130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.828769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.446702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.843813+0000","last_change":"2024-09-12T00:22:57.843671+0000","last_active":"2024-09-12T00:22:57.843813+0000","last_peered":"2024-09-12T00:22:57.843813+0000","last_clean":"2024-09-12T00:22:57.843813+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:22:57.843813+0000","last_undegraded":"2024-09-12T00:22:57.843813+0000","last_fullsized":"2024-09-12T00:22:57.843813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.843490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:06.187761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.388924+0000","last_change":"2024-09-12T00:22:46.388768+0000","last_active":"2024-09-12T00:22:46.388924+0000","last_peered":"2024-09-12T00:22:46.388924+0000","last_clean":"2024-09-12T00:22:46.388924+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:22:46.388924+0000","last_undegraded":"2024-09-12T00:22:46.388924+0000","last_fullsized":"2024-09-12T00:22:46.388924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.388580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:18.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.374312+0000","last_change":"2024-09-12T00:23:01.374170+0000","last_active":"2024-09-12T00:23:01.374312+0000","last_peered":"2024-09-12T00:23:01.374312+0000","last_clean":"2024-09-12T00:23:01.374312+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:23:01.374312+0000","last_undegraded":"2024-09-12T00:23:01.374312+0000","last_fullsized":"2024-09-12T00:23:01.374312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.373987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:05.846953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.405470+0000","last_change":"2024-09-12T00:22:47.405301+0000","last_active":"2024-09-12T00:22:47.405470+0000","last_peered":"2024-09-12T00:22:47.405470+0000","last_clean":"2024-09-12T00:22:47.405470+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:22:47.405470+0000","last_undegraded":"2024-09-12T00:22:47.405470+0000","last_fullsized":"2024-09-12T00:22:47.405470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.405108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:56.440895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.408318+0000","last_change":"2024-09-12T00:22:59.408156+0000","last_active":"2024-09-12T00:22:59.408318+0000","last_peered":"2024-09-12T00:22:59.408318+0000","last_clean":"2024-09-12T00:22:59.408318+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:59.408318+0000","last_undegraded":"2024-09-12T00:22:59.408318+0000","last_fullsized":"2024-09-12T00:22:59.408318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.407970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.085566+0000","last_change":"2024-09-12T00:22:57.085427+0000","last_active":"2024-09-12T00:22:57.085566+0000","last_peered":"2024-09-12T00:22:57.085566+0000","last_clean":"2024-09-12T00:22:57.085566+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:22:57.085566+0000","last_undegraded":"2024-09-12T00:22:57.085566+0000","last_fullsized":"2024-09-12T00:22:57.085566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.085239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.771180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.421285+0000","last_change":"2024-09-12T00:23:02.421145+0000","last_active":"2024-09-12T00:23:02.421285+0000","last_peered":"2024-09-12T00:23:02.421285+0000","last_clean":"2024-09-12T00:23:02.421285+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:23:02.421285+0000","last_undegraded":"2024-09-12T00:23:02.421285+0000","last_fullsized":"2024-09-12T00:23:02.421285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.420954+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:36.359342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.165740+0000","last_change":"2024-09-12T00:22:59.165563+0000","last_active":"2024-09-12T00:22:59.165740+0000","last_peered":"2024-09-12T00:22:59.165740+0000","last_clean":"2024-09-12T00:22:59.165740+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:22:59.165740+0000","last_undegraded":"2024-09-12T00:22:59.165740+0000","last_fullsized":"2024-09-12T00:22:59.165740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.165334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:16.298385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.607485+0000","last_change":"2024-09-12T00:18:46.209457+0000","last_active":"2024-09-12T00:21:02.607485+0000","last_peered":"2024-09-12T00:21:02.607485+0000","last_clean":"2024-09-12T00:21:02.607485+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:21:02.607485+0000","last_undegraded":"2024-09-12T00:21:02.607485+0000","last_fullsized":"2024-09-12T00:21:02.607485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:45.156910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:45.156910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.779560+0000","last_change":"2024-09-12T00:22:47.779560+0000","last_active":"2024-09-12T00:22:47.779560+0000","last_peered":"2024-09-12T00:22:47.779560+0000","last_clean":"2024-09-12T00:22:47.779560+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:22:47.779560+0000","last_undegraded":"2024-09-12T00:22:47.779560+0000","last_fullsized":"2024-09-12T00:22:47.779560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.779379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.921779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.368579+0000","last_change":"2024-09-12T00:23:00.368297+0000","last_active":"2024-09-12T00:23:00.368579+0000","last_peered":"2024-09-12T00:23:00.368579+0000","last_clean":"2024-09-12T00:23:00.368579+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:23:00.368579+0000","last_undegraded":"2024-09-12T00:23:00.368579+0000","last_fullsized":"2024-09-12T00:23:00.368579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.368084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:01.368006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.123271+0000","last_change":"2024-09-12T00:23:00.123271+0000","last_active":"2024-09-12T00:23:00.123271+0000","last_peered":"2024-09-12T00:23:00.123271+0000","last_clean":"2024-09-12T00:23:00.123271+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:23:00.123271+0000","last_undegraded":"2024-09-12T00:23:00.123271+0000","last_fullsized":"2024-09-12T00:23:00.123271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.123089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:30.766748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.161909+0000","last_change":"2024-09-12T00:23:01.161909+0000","last_active":"2024-09-12T00:23:01.161909+0000","last_peered":"2024-09-12T00:23:01.161909+0000","last_clean":"2024-09-12T00:23:01.161909+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:23:01.161909+0000","last_undegraded":"2024-09-12T00:23:01.161909+0000","last_fullsized":"2024-09-12T00:23:01.161909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.161644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:33.787276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.851387+0000","last_change":"2024-09-12T00:23:00.851387+0000","last_active":"2024-09-12T00:23:00.851387+0000","last_peered":"2024-09-12T00:23:00.851387+0000","last_clean":"2024-09-12T00:23:00.851387+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:23:00.851387+0000","last_undegraded":"2024-09-12T00:23:00.851387+0000","last_fullsized":"2024-09-12T00:23:00.851387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.851152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:34.789540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.887896+0000","last_change":"2024-09-12T00:22:49.887896+0000","last_active":"2024-09-12T00:22:49.887896+0000","last_peered":"2024-09-12T00:22:49.887896+0000","last_clean":"2024-09-12T00:22:49.887896+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:22:49.887896+0000","last_undegraded":"2024-09-12T00:22:49.887896+0000","last_fullsized":"2024-09-12T00:22:49.887896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.887620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.361953+0000","last_change":"2024-09-12T00:23:07.361953+0000","last_active":"2024-09-12T00:23:07.361953+0000","last_peered":"2024-09-12T00:23:07.361953+0000","last_clean":"2024-09-12T00:23:07.361953+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:23:07.361953+0000","last_undegraded":"2024-09-12T00:23:07.361953+0000","last_fullsized":"2024-09-12T00:23:07.361953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.361766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:56.738180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1638,"ondisk_log_size":1638,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705725,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":150916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":737144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705726,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":737488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":450560,"data_stored":149912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:23:19.346 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.347 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.348 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.349 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.350 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.351 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.352 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.353 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.354 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.355 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.356 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.357 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:18:47.173968+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.358 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.359 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.360 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.360 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.360 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.360 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.360 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.361 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:18:45.156910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:19.361 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:23:39.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:23:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.495+0000 7fa143b14640 1 Processor -- start 2024-09-12T00:23:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.495+0000 7fa143b14640 1 -- start start 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa143b14640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa13c111890 0x7fa13c132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa143b14640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c073a90 con 0x7fa13c110da0 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa143b14640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c0696e0 con 0x7fa13c111890 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa13c111890 0x7fa13c132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa13c111890 0x7fa13c132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33972/0 (socket says 172.21.15.31:33972) 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 -- 172.21.15.31:0/819947192 learned_addr learned my addr 172.21.15.31:0/819947192 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 -- 172.21.15.31:0/819947192 >> v1:172.21.15.31:6789/0 conn(0x7fa13c110da0 legacy=0x7fa13c111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 -- 172.21.15.31:0/819947192 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c06dd50 con 0x7fa13c111890 2024-09-12T00:23:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1410af640 1 --2- 172.21.15.31:0/819947192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c111890 0x7fa13c132450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa138009e50 tx=0x7fa13801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6001aec09e6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1408ae640 1 -- 172.21.15.31:0/819947192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa138009200 con 0x7fa13c111890 2024-09-12T00:23:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1408ae640 1 -- 172.21.15.31:0/819947192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1380a56d0 con 0x7fa13c111890 2024-09-12T00:23:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa1408ae640 1 -- 172.21.15.31:0/819947192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1380a59d0 con 0x7fa13c111890 2024-09-12T00:23:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa143b14640 1 -- 172.21.15.31:0/819947192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c111890 msgr2=0x7fa13c132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.499+0000 7fa143b14640 1 --2- 172.21.15.31:0/819947192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c111890 0x7fa13c132450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa138009e50 tx=0x7fa13801c980 comp rx=0 tx=0).stop 2024-09-12T00:23:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/819947192 shutdown_connections 2024-09-12T00:23:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 --2- 172.21.15.31:0/819947192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c111890 0x7fa13c132450 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/819947192 >> 172.21.15.31:0/819947192 conn(0x7fa13c070900 msgr2=0x7fa13c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:23:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/819947192 shutdown_connections 2024-09-12T00:23:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/819947192 wait complete. 2024-09-12T00:23:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 Processor -- start 2024-09-12T00:23:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- start start 2024-09-12T00:23:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c135330 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa1418b0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa1418b0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33982/0 (socket says 172.21.15.31:33982) 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa1418b0640 1 -- 172.21.15.31:0/3089085330 learned_addr learned my addr 172.21.15.31:0/3089085330 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa1418b0640 1 -- 172.21.15.31:0/3089085330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c129c00 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa1418b0640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c430 tx=0x7fa13000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa130017070 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa130005200 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa130003600 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c1171d0 con 0x7fa13c110da0 2024-09-12T00:23:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c116c30 con 0x7fa13c110da0 2024-09-12T00:23:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c111180 con 0x7fa13c110da0 2024-09-12T00:23:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa13001a070 con 0x7fa13c110da0 2024-09-12T00:23:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 0x7fa12003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.503+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fa13004ebc0 con 0x7fa13c110da0 2024-09-12T00:23:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.507+0000 7fa1410af640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 0x7fa12003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:39.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.507+0000 7fa1410af640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 0x7fa12003d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1380ae000 tx=0x7fa1380a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.511+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa1300102e0 con 0x7fa13c110da0 2024-09-12T00:23:39.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.679+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa13c117570 con 0x7fa12003b200 2024-09-12T00:23:39.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.711+0000 7fa12e7fc640 1 -- 172.21.15.31:0/3089085330 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665533 (secure 0 0 0) 0x7fa1380091d0 con 0x7fa12003b200 2024-09-12T00:23:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:23:39.723 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 msgr2=0x7fa12003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 0x7fa12003d6c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1380ae000 tx=0x7fa1380a7070 comp rx=0 tx=0).stop 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 msgr2=0x7fa13c1c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c430 tx=0x7fa13000c8f0 comp rx=0 tx=0).stop 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 shutdown_connections 2024-09-12T00:23:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fa12003b200 0x7fa12003d6c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 --2- 172.21.15.31:0/3089085330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa13c110da0 0x7fa13c1c6740 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 >> 172.21.15.31:0/3089085330 conn(0x7fa13c070900 msgr2=0x7fa13c071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:23:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 shutdown_connections 2024-09-12T00:23:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:39.715+0000 7fa143b14640 1 -- 172.21.15.31:0/3089085330 wait complete. 2024-09-12T00:23:39.739 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-12T00:23:38.650826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5401,"num_read_kb":4955,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4962,"ondisk_log_size":4962,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165056,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322304,"statfs":{"total":386547056640,"available":386378039296,"internally_reserved":0,"allocated":2949120,"data_stored":1775460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":165996313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006189"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.776360+0000","last_change":"2024-09-12T00:22:51.776190+0000","last_active":"2024-09-12T00:22:51.776360+0000","last_peered":"2024-09-12T00:22:51.776360+0000","last_clean":"2024-09-12T00:22:51.776360+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:22:51.776360+0000","last_undegraded":"2024-09-12T00:22:51.776360+0000","last_fullsized":"2024-09-12T00:22:51.776360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.776007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.205681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.318599+0000","last_change":"2024-09-12T00:23:08.318599+0000","last_active":"2024-09-12T00:23:08.318599+0000","last_peered":"2024-09-12T00:23:08.318599+0000","last_clean":"2024-09-12T00:23:08.318599+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:23:08.318599+0000","last_undegraded":"2024-09-12T00:23:08.318599+0000","last_fullsized":"2024-09-12T00:23:08.318599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.318428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:11.398771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.963190+0000","last_change":"2024-09-12T00:22:53.963022+0000","last_active":"2024-09-12T00:22:53.963190+0000","last_peered":"2024-09-12T00:22:53.963190+0000","last_clean":"2024-09-12T00:22:53.963190+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:22:53.963190+0000","last_undegraded":"2024-09-12T00:22:53.963190+0000","last_fullsized":"2024-09-12T00:22:53.963190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.962810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:20.507384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.886670+0000","last_change":"2024-09-12T00:23:20.886670+0000","last_active":"2024-09-12T00:23:20.886670+0000","last_peered":"2024-09-12T00:23:20.886670+0000","last_clean":"2024-09-12T00:23:20.886670+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:23:20.886670+0000","last_undegraded":"2024-09-12T00:23:20.886670+0000","last_fullsized":"2024-09-12T00:23:20.886670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.886463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:38.609500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.128441+0000","last_change":"2024-09-12T00:23:06.128441+0000","last_active":"2024-09-12T00:23:06.128441+0000","last_peered":"2024-09-12T00:23:06.128441+0000","last_clean":"2024-09-12T00:23:06.128441+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:23:06.128441+0000","last_undegraded":"2024-09-12T00:23:06.128441+0000","last_fullsized":"2024-09-12T00:23:06.128441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.128258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.765425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.868830+0000","last_change":"2024-09-12T00:23:21.868830+0000","last_active":"2024-09-12T00:23:21.868830+0000","last_peered":"2024-09-12T00:23:21.868830+0000","last_clean":"2024-09-12T00:23:21.868830+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:23:21.868830+0000","last_undegraded":"2024-09-12T00:23:21.868830+0000","last_fullsized":"2024-09-12T00:23:21.868830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.868648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:48.574200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.765815+0000","last_change":"2024-09-12T00:22:50.765815+0000","last_active":"2024-09-12T00:22:50.765815+0000","last_peered":"2024-09-12T00:22:50.765815+0000","last_clean":"2024-09-12T00:22:50.765815+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:50.765815+0000","last_undegraded":"2024-09-12T00:22:50.765815+0000","last_fullsized":"2024-09-12T00:22:50.765815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.765631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:43.898814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.858938+0000","last_change":"2024-09-12T00:23:23.858938+0000","last_active":"2024-09-12T00:23:23.858938+0000","last_peered":"2024-09-12T00:23:23.858938+0000","last_clean":"2024-09-12T00:23:23.858938+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:23:23.858938+0000","last_undegraded":"2024-09-12T00:23:23.858938+0000","last_fullsized":"2024-09-12T00:23:23.858938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.858738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:32.992380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.117840+0000","last_change":"2024-09-12T00:23:04.117840+0000","last_active":"2024-09-12T00:23:04.117840+0000","last_peered":"2024-09-12T00:23:04.117840+0000","last_clean":"2024-09-12T00:23:04.117840+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:23:04.117840+0000","last_undegraded":"2024-09-12T00:23:04.117840+0000","last_fullsized":"2024-09-12T00:23:04.117840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.117631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.338073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.365803+0000","last_change":"2024-09-12T00:23:09.365803+0000","last_active":"2024-09-12T00:23:09.365803+0000","last_peered":"2024-09-12T00:23:09.365803+0000","last_clean":"2024-09-12T00:23:09.365803+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:23:09.365803+0000","last_undegraded":"2024-09-12T00:23:09.365803+0000","last_fullsized":"2024-09-12T00:23:09.365803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.365625+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:02.383992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.751719+0000","last_change":"2024-09-12T00:22:49.751719+0000","last_active":"2024-09-12T00:22:49.751719+0000","last_peered":"2024-09-12T00:22:49.751719+0000","last_clean":"2024-09-12T00:22:49.751719+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:22:49.751719+0000","last_undegraded":"2024-09-12T00:22:49.751719+0000","last_fullsized":"2024-09-12T00:22:49.751719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.751527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.037605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.837158+0000","last_change":"2024-09-12T00:23:22.837158+0000","last_active":"2024-09-12T00:23:22.837158+0000","last_peered":"2024-09-12T00:23:22.837158+0000","last_clean":"2024-09-12T00:23:22.837158+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:23:22.837158+0000","last_undegraded":"2024-09-12T00:23:22.837158+0000","last_fullsized":"2024-09-12T00:23:22.837158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.836976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:54.939860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.155399+0000","last_change":"2024-09-12T00:23:03.155399+0000","last_active":"2024-09-12T00:23:03.155399+0000","last_peered":"2024-09-12T00:23:03.155399+0000","last_clean":"2024-09-12T00:23:03.155399+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:23:03.155399+0000","last_undegraded":"2024-09-12T00:23:03.155399+0000","last_fullsized":"2024-09-12T00:23:03.155399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.155222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:47.560452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.684984+0000","last_change":"2024-09-12T00:23:03.684984+0000","last_active":"2024-09-12T00:23:03.684984+0000","last_peered":"2024-09-12T00:23:03.684984+0000","last_clean":"2024-09-12T00:23:03.684984+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:23:03.684984+0000","last_undegraded":"2024-09-12T00:23:03.684984+0000","last_fullsized":"2024-09-12T00:23:03.684984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.684709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.095355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.893869+0000","last_change":"2024-09-12T00:22:48.893869+0000","last_active":"2024-09-12T00:22:48.893869+0000","last_peered":"2024-09-12T00:22:48.893869+0000","last_clean":"2024-09-12T00:22:48.893869+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:22:48.893869+0000","last_undegraded":"2024-09-12T00:22:48.893869+0000","last_fullsized":"2024-09-12T00:22:48.893869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.893683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:04.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.700907+0000","last_change":"2024-09-12T00:23:04.700907+0000","last_active":"2024-09-12T00:23:04.700907+0000","last_peered":"2024-09-12T00:23:04.700907+0000","last_clean":"2024-09-12T00:23:04.700907+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:23:04.700907+0000","last_undegraded":"2024-09-12T00:23:04.700907+0000","last_fullsized":"2024-09-12T00:23:04.700907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.700730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:30.318663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.896857+0000","last_change":"2024-09-12T00:23:19.896568+0000","last_active":"2024-09-12T00:23:19.896857+0000","last_peered":"2024-09-12T00:23:19.896857+0000","last_clean":"2024-09-12T00:23:19.896857+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:23:19.896857+0000","last_undegraded":"2024-09-12T00:23:19.896857+0000","last_fullsized":"2024-09-12T00:23:19.896857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.896281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:30.170323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.381401+0000","last_change":"2024-09-12T00:22:50.381220+0000","last_active":"2024-09-12T00:22:50.381401+0000","last_peered":"2024-09-12T00:22:50.381401+0000","last_clean":"2024-09-12T00:22:50.381401+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:22:50.381401+0000","last_undegraded":"2024-09-12T00:22:50.381401+0000","last_fullsized":"2024-09-12T00:22:50.381401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:05.740216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.395208+0000","last_change":"2024-09-12T00:23:03.395067+0000","last_active":"2024-09-12T00:23:03.395208+0000","last_peered":"2024-09-12T00:23:03.395208+0000","last_clean":"2024-09-12T00:23:03.395208+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:23:03.395208+0000","last_undegraded":"2024-09-12T00:23:03.395208+0000","last_fullsized":"2024-09-12T00:23:03.395208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.394885+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:09.804874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.797760+0000","last_change":"2024-09-12T00:22:48.797589+0000","last_active":"2024-09-12T00:22:48.797760+0000","last_peered":"2024-09-12T00:22:48.797760+0000","last_clean":"2024-09-12T00:22:48.797760+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:22:48.797760+0000","last_undegraded":"2024-09-12T00:22:48.797760+0000","last_fullsized":"2024-09-12T00:22:48.797760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.797378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:43.134132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.439269+0000","last_change":"2024-09-12T00:23:05.439096+0000","last_active":"2024-09-12T00:23:05.439269+0000","last_peered":"2024-09-12T00:23:05.439269+0000","last_clean":"2024-09-12T00:23:05.439269+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:23:05.439269+0000","last_undegraded":"2024-09-12T00:23:05.439269+0000","last_fullsized":"2024-09-12T00:23:05.439269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.438924+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:26.775381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.390245+0000","last_change":"2024-09-12T00:22:48.390120+0000","last_active":"2024-09-12T00:22:48.390245+0000","last_peered":"2024-09-12T00:22:48.390245+0000","last_clean":"2024-09-12T00:22:48.390245+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:22:48.390245+0000","last_undegraded":"2024-09-12T00:22:48.390245+0000","last_fullsized":"2024-09-12T00:22:48.390245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.389942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.548963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.829942+0000","last_change":"2024-09-12T00:23:06.829700+0000","last_active":"2024-09-12T00:23:06.829942+0000","last_peered":"2024-09-12T00:23:06.829942+0000","last_clean":"2024-09-12T00:23:06.829942+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:23:06.829942+0000","last_undegraded":"2024-09-12T00:23:06.829942+0000","last_fullsized":"2024-09-12T00:23:06.829942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.829458+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:09.909801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.394001+0000","last_change":"2024-09-12T00:22:49.393858+0000","last_active":"2024-09-12T00:22:49.394001+0000","last_peered":"2024-09-12T00:22:49.394001+0000","last_clean":"2024-09-12T00:22:49.394001+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:22:49.394001+0000","last_undegraded":"2024-09-12T00:22:49.394001+0000","last_fullsized":"2024-09-12T00:22:49.394001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.393664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.905345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.724991+0000","last_change":"2024-09-12T00:23:02.724818+0000","last_active":"2024-09-12T00:23:02.724991+0000","last_peered":"2024-09-12T00:23:02.724991+0000","last_clean":"2024-09-12T00:23:02.724991+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:23:02.724991+0000","last_undegraded":"2024-09-12T00:23:02.724991+0000","last_fullsized":"2024-09-12T00:23:02.724991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.724643+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:13.949257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.985602+0000","last_change":"2024-09-12T00:22:52.985430+0000","last_active":"2024-09-12T00:22:52.985602+0000","last_peered":"2024-09-12T00:22:52.985602+0000","last_clean":"2024-09-12T00:22:52.985602+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:22:52.985602+0000","last_undegraded":"2024-09-12T00:22:52.985602+0000","last_fullsized":"2024-09-12T00:22:52.985602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:11.458618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'6","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.399827+0000","last_change":"2024-09-12T00:23:06.399553+0000","last_active":"2024-09-12T00:23:06.399827+0000","last_peered":"2024-09-12T00:23:06.399827+0000","last_clean":"2024-09-12T00:23:06.399827+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:23:06.399827+0000","last_undegraded":"2024-09-12T00:23:06.399827+0000","last_fullsized":"2024-09-12T00:23:06.399827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.399335+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:58.180682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.129041+0000","last_change":"2024-09-12T00:23:02.128899+0000","last_active":"2024-09-12T00:23:02.129041+0000","last_peered":"2024-09-12T00:23:02.129041+0000","last_clean":"2024-09-12T00:23:02.129041+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:23:02.129041+0000","last_undegraded":"2024-09-12T00:23:02.129041+0000","last_fullsized":"2024-09-12T00:23:02.129041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.128715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:26.580947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.269763+0000","last_change":"2024-09-12T00:23:37.269763+0000","last_active":"2024-09-12T00:23:37.269763+0000","last_peered":"2024-09-12T00:23:37.269763+0000","last_clean":"2024-09-12T00:23:37.269763+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:23:37.269763+0000","last_undegraded":"2024-09-12T00:23:37.269763+0000","last_fullsized":"2024-09-12T00:23:37.269763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.269540+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.878743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.016722+0000","last_change":"2024-09-12T00:23:09.016573+0000","last_active":"2024-09-12T00:23:09.016722+0000","last_peered":"2024-09-12T00:23:09.016722+0000","last_clean":"2024-09-12T00:23:09.016722+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:23:09.016722+0000","last_undegraded":"2024-09-12T00:23:09.016722+0000","last_fullsized":"2024-09-12T00:23:09.016722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.016364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:43.015238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.017023+0000","last_change":"2024-09-12T00:22:51.016861+0000","last_active":"2024-09-12T00:22:51.017023+0000","last_peered":"2024-09-12T00:22:51.017023+0000","last_clean":"2024-09-12T00:22:51.017023+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:22:51.017023+0000","last_undegraded":"2024-09-12T00:22:51.017023+0000","last_fullsized":"2024-09-12T00:22:51.017023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.016681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.962090+0000","last_change":"2024-09-12T00:23:31.961933+0000","last_active":"2024-09-12T00:23:31.962090+0000","last_peered":"2024-09-12T00:23:31.962090+0000","last_clean":"2024-09-12T00:23:31.962090+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:23:31.962090+0000","last_undegraded":"2024-09-12T00:23:31.962090+0000","last_fullsized":"2024-09-12T00:23:31.962090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.961757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:47.635223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'45","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.541669+0000","last_change":"2024-09-12T00:18:50.243600+0000","last_active":"2024-09-12T00:22:33.541669+0000","last_peered":"2024-09-12T00:22:33.541669+0000","last_clean":"2024-09-12T00:22:33.541669+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:22:33.541669+0000","last_undegraded":"2024-09-12T00:22:33.541669+0000","last_fullsized":"2024-09-12T00:22:33.541669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:11.805098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.202904+0000","last_change":"2024-09-12T00:23:29.202904+0000","last_active":"2024-09-12T00:23:29.202904+0000","last_peered":"2024-09-12T00:23:29.202904+0000","last_clean":"2024-09-12T00:23:29.202904+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:23:29.202904+0000","last_undegraded":"2024-09-12T00:23:29.202904+0000","last_fullsized":"2024-09-12T00:23:29.202904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.202735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:26.049014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:14.970936+0000","last_change":"2024-09-12T00:18:54.269378+0000","last_active":"2024-09-12T00:20:14.970936+0000","last_peered":"2024-09-12T00:20:14.970936+0000","last_clean":"2024-09-12T00:20:14.970936+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:20:14.970936+0000","last_undegraded":"2024-09-12T00:20:14.970936+0000","last_fullsized":"2024-09-12T00:20:14.970936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.852354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.962017+0000","last_change":"2024-09-12T00:23:13.961891+0000","last_active":"2024-09-12T00:23:13.962017+0000","last_peered":"2024-09-12T00:23:13.962017+0000","last_clean":"2024-09-12T00:23:13.962017+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:23:13.962017+0000","last_undegraded":"2024-09-12T00:23:13.962017+0000","last_fullsized":"2024-09-12T00:23:13.962017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.961704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:07.483381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.797176+0000","last_change":"2024-09-12T00:22:43.797026+0000","last_active":"2024-09-12T00:22:43.797176+0000","last_peered":"2024-09-12T00:22:43.797176+0000","last_clean":"2024-09-12T00:22:43.797176+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:22:43.797176+0000","last_undegraded":"2024-09-12T00:22:43.797176+0000","last_fullsized":"2024-09-12T00:22:43.797176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.796840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:32.300041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.369745+0000","last_change":"2024-09-12T00:23:14.369745+0000","last_active":"2024-09-12T00:23:14.369745+0000","last_peered":"2024-09-12T00:23:14.369745+0000","last_clean":"2024-09-12T00:23:14.369745+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:23:14.369745+0000","last_undegraded":"2024-09-12T00:23:14.369745+0000","last_fullsized":"2024-09-12T00:23:14.369745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.369579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.600971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'19","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.155034+0000","last_change":"2024-09-12T00:23:23.155034+0000","last_active":"2024-09-12T00:23:23.155034+0000","last_peered":"2024-09-12T00:23:23.155034+0000","last_clean":"2024-09-12T00:23:23.155034+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:23:23.155034+0000","last_undegraded":"2024-09-12T00:23:23.155034+0000","last_fullsized":"2024-09-12T00:23:23.155034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.154802+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:07.955527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.161930+0000","last_change":"2024-09-12T00:23:28.161930+0000","last_active":"2024-09-12T00:23:28.161930+0000","last_peered":"2024-09-12T00:23:28.161930+0000","last_clean":"2024-09-12T00:23:28.161930+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:23:28.161930+0000","last_undegraded":"2024-09-12T00:23:28.161930+0000","last_fullsized":"2024-09-12T00:23:28.161930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.161717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:01.037307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.708440+0000","last_change":"2024-09-12T00:23:33.708440+0000","last_active":"2024-09-12T00:23:33.708440+0000","last_peered":"2024-09-12T00:23:33.708440+0000","last_clean":"2024-09-12T00:23:33.708440+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:23:33.708440+0000","last_undegraded":"2024-09-12T00:23:33.708440+0000","last_fullsized":"2024-09-12T00:23:33.708440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.708253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.689561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.939814+0000","last_change":"2024-09-12T00:23:12.939642+0000","last_active":"2024-09-12T00:23:12.939814+0000","last_peered":"2024-09-12T00:23:12.939814+0000","last_clean":"2024-09-12T00:23:12.939814+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:23:12.939814+0000","last_undegraded":"2024-09-12T00:23:12.939814+0000","last_fullsized":"2024-09-12T00:23:12.939814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.939457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.805086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.061676+0000","last_change":"2024-09-12T00:22:50.061542+0000","last_active":"2024-09-12T00:22:50.061676+0000","last_peered":"2024-09-12T00:22:50.061676+0000","last_clean":"2024-09-12T00:22:50.061676+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:22:50.061676+0000","last_undegraded":"2024-09-12T00:22:50.061676+0000","last_fullsized":"2024-09-12T00:22:50.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.061348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:59.156666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.840770+0000","last_change":"2024-09-12T00:23:09.840652+0000","last_active":"2024-09-12T00:23:09.840770+0000","last_peered":"2024-09-12T00:23:09.840770+0000","last_clean":"2024-09-12T00:23:09.840770+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:23:09.840770+0000","last_undegraded":"2024-09-12T00:23:09.840770+0000","last_fullsized":"2024-09-12T00:23:09.840770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.840470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:18.847901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'31","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.759568+0000","last_change":"2024-09-12T00:23:17.759391+0000","last_active":"2024-09-12T00:23:17.759568+0000","last_peered":"2024-09-12T00:23:17.759568+0000","last_clean":"2024-09-12T00:23:17.759568+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:23:17.759568+0000","last_undegraded":"2024-09-12T00:23:17.759568+0000","last_fullsized":"2024-09-12T00:23:17.759568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.759194+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:15.514131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.251962+0000","last_change":"2024-09-12T00:18:52.256858+0000","last_active":"2024-09-12T00:22:33.251962+0000","last_peered":"2024-09-12T00:22:33.251962+0000","last_clean":"2024-09-12T00:22:33.251962+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:22:33.251962+0000","last_undegraded":"2024-09-12T00:22:33.251962+0000","last_fullsized":"2024-09-12T00:22:33.251962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:09.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.732233+0000","last_change":"2024-09-12T00:23:30.732233+0000","last_active":"2024-09-12T00:23:30.732233+0000","last_peered":"2024-09-12T00:23:30.732233+0000","last_clean":"2024-09-12T00:23:30.732233+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:23:30.732233+0000","last_undegraded":"2024-09-12T00:23:30.732233+0000","last_fullsized":"2024-09-12T00:23:30.732233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.732049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:20.404264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.837234+0000","last_change":"2024-09-12T00:22:59.837098+0000","last_active":"2024-09-12T00:22:59.837234+0000","last_peered":"2024-09-12T00:22:59.837234+0000","last_clean":"2024-09-12T00:22:59.837234+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:59.837234+0000","last_undegraded":"2024-09-12T00:22:59.837234+0000","last_fullsized":"2024-09-12T00:22:59.837234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.836918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.309884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.345876+0000","last_change":"2024-09-12T00:22:41.345748+0000","last_active":"2024-09-12T00:22:41.345876+0000","last_peered":"2024-09-12T00:22:41.345876+0000","last_clean":"2024-09-12T00:22:41.345876+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:22:41.345876+0000","last_undegraded":"2024-09-12T00:22:41.345876+0000","last_fullsized":"2024-09-12T00:22:41.345876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.345566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:36.735410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"33'2","reported_seq":231,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.000677+0000","last_change":"2024-09-12T00:23:33.000372+0000","last_active":"2024-09-12T00:23:33.000677+0000","last_peered":"2024-09-12T00:23:33.000677+0000","last_clean":"2024-09-12T00:23:33.000677+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:23:33.000677+0000","last_undegraded":"2024-09-12T00:23:33.000677+0000","last_fullsized":"2024-09-12T00:23:33.000677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.000090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:12.347397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'44","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.781836+0000","last_change":"2024-09-12T00:23:18.781836+0000","last_active":"2024-09-12T00:23:18.781836+0000","last_peered":"2024-09-12T00:23:18.781836+0000","last_clean":"2024-09-12T00:23:18.781836+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:23:18.781836+0000","last_undegraded":"2024-09-12T00:23:18.781836+0000","last_fullsized":"2024-09-12T00:23:18.781836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.781614+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:45.399468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'286","reported_seq":456,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.761859+0000","last_change":"2024-09-12T00:23:25.761580+0000","last_active":"2024-09-12T00:23:25.761859+0000","last_peered":"2024-09-12T00:23:25.761859+0000","last_clean":"2024-09-12T00:23:25.761859+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:23:25.761859+0000","last_undegraded":"2024-09-12T00:23:25.761859+0000","last_fullsized":"2024-09-12T00:23:25.761859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.761356+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:04.491765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.085218+0000","last_change":"2024-09-12T00:23:07.084961+0000","last_active":"2024-09-12T00:23:07.085218+0000","last_peered":"2024-09-12T00:23:07.085218+0000","last_clean":"2024-09-12T00:23:07.085218+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:23:07.085218+0000","last_undegraded":"2024-09-12T00:23:07.085218+0000","last_fullsized":"2024-09-12T00:23:07.085218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.084724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.811716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.772738+0000","last_change":"2024-09-12T00:22:41.772590+0000","last_active":"2024-09-12T00:22:41.772738+0000","last_peered":"2024-09-12T00:22:41.772738+0000","last_clean":"2024-09-12T00:22:41.772738+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:41.772738+0000","last_undegraded":"2024-09-12T00:22:41.772738+0000","last_fullsized":"2024-09-12T00:22:41.772738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.772363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.380735+0000","last_change":"2024-09-12T00:23:11.380735+0000","last_active":"2024-09-12T00:23:11.380735+0000","last_peered":"2024-09-12T00:23:11.380735+0000","last_clean":"2024-09-12T00:23:11.380735+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:23:11.380735+0000","last_undegraded":"2024-09-12T00:23:11.380735+0000","last_fullsized":"2024-09-12T00:23:11.380735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.380468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:20.387899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'62","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.763583+0000","last_change":"2024-09-12T00:23:14.763583+0000","last_active":"2024-09-12T00:23:14.763583+0000","last_peered":"2024-09-12T00:23:14.763583+0000","last_clean":"2024-09-12T00:23:14.763583+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:23:14.763583+0000","last_undegraded":"2024-09-12T00:23:14.763583+0000","last_fullsized":"2024-09-12T00:23:14.763583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'62","last_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_deep_scrub":"33'62","last_deep_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.763365+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:39.983068+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.755117+0000","last_change":"2024-09-12T00:23:24.755117+0000","last_active":"2024-09-12T00:23:24.755117+0000","last_peered":"2024-09-12T00:23:24.755117+0000","last_clean":"2024-09-12T00:23:24.755117+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:23:24.755117+0000","last_undegraded":"2024-09-12T00:23:24.755117+0000","last_fullsized":"2024-09-12T00:23:24.755117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.754908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:00.095135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.754381+0000","last_change":"2024-09-12T00:23:27.754381+0000","last_active":"2024-09-12T00:23:27.754381+0000","last_peered":"2024-09-12T00:23:27.754381+0000","last_clean":"2024-09-12T00:23:27.754381+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:23:27.754381+0000","last_undegraded":"2024-09-12T00:23:27.754381+0000","last_fullsized":"2024-09-12T00:23:27.754381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.754200+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:53.666701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.432243+0000","last_change":"2024-09-12T00:22:52.432048+0000","last_active":"2024-09-12T00:22:52.432243+0000","last_peered":"2024-09-12T00:22:52.432243+0000","last_clean":"2024-09-12T00:22:52.432243+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:22:52.432243+0000","last_undegraded":"2024-09-12T00:22:52.432243+0000","last_fullsized":"2024-09-12T00:22:52.432243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.431871+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.876093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.795646+0000","last_change":"2024-09-12T00:22:40.795499+0000","last_active":"2024-09-12T00:22:40.795646+0000","last_peered":"2024-09-12T00:22:40.795646+0000","last_clean":"2024-09-12T00:22:40.795646+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:22:40.795646+0000","last_undegraded":"2024-09-12T00:22:40.795646+0000","last_fullsized":"2024-09-12T00:22:40.795646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.795325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:29.485413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.766513+0000","last_change":"2024-09-12T00:23:14.766513+0000","last_active":"2024-09-12T00:23:14.766513+0000","last_peered":"2024-09-12T00:23:14.766513+0000","last_clean":"2024-09-12T00:23:14.766513+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:23:14.766513+0000","last_undegraded":"2024-09-12T00:23:14.766513+0000","last_fullsized":"2024-09-12T00:23:14.766513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.766308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.849877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'39","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.432388+0000","last_change":"2024-09-12T00:18:50.238900+0000","last_active":"2024-09-12T00:22:33.432388+0000","last_peered":"2024-09-12T00:22:33.432388+0000","last_clean":"2024-09-12T00:22:33.432388+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:22:33.432388+0000","last_undegraded":"2024-09-12T00:22:33.432388+0000","last_fullsized":"2024-09-12T00:22:33.432388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.600228+0000","last_change":"2024-09-12T00:18:52.243370+0000","last_active":"2024-09-12T00:21:02.600228+0000","last_peered":"2024-09-12T00:21:02.600228+0000","last_clean":"2024-09-12T00:21:02.600228+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:21:02.600228+0000","last_undegraded":"2024-09-12T00:21:02.600228+0000","last_fullsized":"2024-09-12T00:21:02.600228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.237461+0000","last_change":"2024-09-12T00:23:32.237461+0000","last_active":"2024-09-12T00:23:32.237461+0000","last_peered":"2024-09-12T00:23:32.237461+0000","last_clean":"2024-09-12T00:23:32.237461+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:23:32.237461+0000","last_undegraded":"2024-09-12T00:23:32.237461+0000","last_fullsized":"2024-09-12T00:23:32.237461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.237272+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:27.360129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.652375+0000","last_change":"2024-09-12T00:22:56.652212+0000","last_active":"2024-09-12T00:22:56.652375+0000","last_peered":"2024-09-12T00:22:56.652375+0000","last_clean":"2024-09-12T00:22:56.652375+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:56.652375+0000","last_undegraded":"2024-09-12T00:22:56.652375+0000","last_fullsized":"2024-09-12T00:22:56.652375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.652038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.998075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.097480+0000","last_change":"2024-09-12T00:22:49.097322+0000","last_active":"2024-09-12T00:22:49.097480+0000","last_peered":"2024-09-12T00:22:49.097480+0000","last_clean":"2024-09-12T00:22:49.097480+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:22:49.097480+0000","last_undegraded":"2024-09-12T00:22:49.097480+0000","last_fullsized":"2024-09-12T00:22:49.097480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.097141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:19.046570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.793060+0000","last_change":"2024-09-12T00:23:08.792927+0000","last_active":"2024-09-12T00:23:08.793060+0000","last_peered":"2024-09-12T00:23:08.793060+0000","last_clean":"2024-09-12T00:23:08.793060+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:23:08.793060+0000","last_undegraded":"2024-09-12T00:23:08.793060+0000","last_fullsized":"2024-09-12T00:23:08.793060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.792752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:34.705253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'61","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.965661+0000","last_change":"2024-09-12T00:23:36.965661+0000","last_active":"2024-09-12T00:23:36.965661+0000","last_peered":"2024-09-12T00:23:36.965661+0000","last_clean":"2024-09-12T00:23:36.965661+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:23:36.965661+0000","last_undegraded":"2024-09-12T00:23:36.965661+0000","last_fullsized":"2024-09-12T00:23:36.965661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.965454+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.860037+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'286","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.706053+0000","last_change":"2024-09-12T00:23:29.706053+0000","last_active":"2024-09-12T00:23:29.706053+0000","last_peered":"2024-09-12T00:23:29.706053+0000","last_clean":"2024-09-12T00:23:29.706053+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:23:29.706053+0000","last_undegraded":"2024-09-12T00:23:29.706053+0000","last_fullsized":"2024-09-12T00:23:29.706053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.705871+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:17.737412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.745194+0000","last_change":"2024-09-12T00:23:34.745194+0000","last_active":"2024-09-12T00:23:34.745194+0000","last_peered":"2024-09-12T00:23:34.745194+0000","last_clean":"2024-09-12T00:23:34.745194+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:23:34.745194+0000","last_undegraded":"2024-09-12T00:23:34.745194+0000","last_fullsized":"2024-09-12T00:23:34.745194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.745014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:31.536554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.683417+0000","last_change":"2024-09-12T00:22:55.683235+0000","last_active":"2024-09-12T00:22:55.683417+0000","last_peered":"2024-09-12T00:22:55.683417+0000","last_clean":"2024-09-12T00:22:55.683417+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:55.683417+0000","last_undegraded":"2024-09-12T00:22:55.683417+0000","last_fullsized":"2024-09-12T00:22:55.683417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.683049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:38.119930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.023749+0000","last_change":"2024-09-12T00:22:47.023618+0000","last_active":"2024-09-12T00:22:47.023749+0000","last_peered":"2024-09-12T00:22:47.023749+0000","last_clean":"2024-09-12T00:22:47.023749+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:22:47.023749+0000","last_undegraded":"2024-09-12T00:22:47.023749+0000","last_fullsized":"2024-09-12T00:22:47.023749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.023424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:59.258309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.726024+0000","last_change":"2024-09-12T00:23:05.726024+0000","last_active":"2024-09-12T00:23:05.726024+0000","last_peered":"2024-09-12T00:23:05.726024+0000","last_clean":"2024-09-12T00:23:05.726024+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:23:05.726024+0000","last_undegraded":"2024-09-12T00:23:05.726024+0000","last_fullsized":"2024-09-12T00:23:05.726024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.725828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:35.191271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'72","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.451684+0000","last_change":"2024-09-12T00:18:50.241570+0000","last_active":"2024-09-12T00:22:33.451684+0000","last_peered":"2024-09-12T00:22:33.451684+0000","last_clean":"2024-09-12T00:22:33.451684+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:22:33.451684+0000","last_undegraded":"2024-09-12T00:22:33.451684+0000","last_fullsized":"2024-09-12T00:22:33.451684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.721415+0000","last_change":"2024-09-12T00:23:23.721415+0000","last_active":"2024-09-12T00:23:23.721415+0000","last_peered":"2024-09-12T00:23:23.721415+0000","last_clean":"2024-09-12T00:23:23.721415+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:23:23.721415+0000","last_undegraded":"2024-09-12T00:23:23.721415+0000","last_fullsized":"2024-09-12T00:23:23.721415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.721237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.538900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'26","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.707322+0000","last_change":"2024-09-12T00:23:28.707322+0000","last_active":"2024-09-12T00:23:28.707322+0000","last_peered":"2024-09-12T00:23:28.707322+0000","last_clean":"2024-09-12T00:23:28.707322+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:23:28.707322+0000","last_undegraded":"2024-09-12T00:23:28.707322+0000","last_fullsized":"2024-09-12T00:23:28.707322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.707119+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:33.980065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.393141+0000","last_change":"2024-09-12T00:22:54.392952+0000","last_active":"2024-09-12T00:22:54.393141+0000","last_peered":"2024-09-12T00:22:54.393141+0000","last_clean":"2024-09-12T00:22:54.393141+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:54.393141+0000","last_undegraded":"2024-09-12T00:22:54.393141+0000","last_fullsized":"2024-09-12T00:22:54.393141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.392767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:12.866147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.874156+0000","last_change":"2024-09-12T00:22:46.874023+0000","last_active":"2024-09-12T00:22:46.874156+0000","last_peered":"2024-09-12T00:22:46.874156+0000","last_clean":"2024-09-12T00:22:46.874156+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:22:46.874156+0000","last_undegraded":"2024-09-12T00:22:46.874156+0000","last_fullsized":"2024-09-12T00:22:46.874156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.873837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:16.339279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.705078+0000","last_change":"2024-09-12T00:23:07.704869+0000","last_active":"2024-09-12T00:23:07.705078+0000","last_peered":"2024-09-12T00:23:07.705078+0000","last_clean":"2024-09-12T00:23:07.705078+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:23:07.705078+0000","last_undegraded":"2024-09-12T00:23:07.705078+0000","last_fullsized":"2024-09-12T00:23:07.705078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.704656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:23.063840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.176520+0000","last_change":"2024-09-12T00:23:22.176363+0000","last_active":"2024-09-12T00:23:22.176520+0000","last_peered":"2024-09-12T00:23:22.176520+0000","last_clean":"2024-09-12T00:23:22.176520+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:23:22.176520+0000","last_undegraded":"2024-09-12T00:23:22.176520+0000","last_fullsized":"2024-09-12T00:23:22.176520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.176164+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:34.304576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.609514+0000","last_change":"2024-09-12T00:18:52.256816+0000","last_active":"2024-09-12T00:21:07.609514+0000","last_peered":"2024-09-12T00:21:07.609514+0000","last_clean":"2024-09-12T00:21:07.609514+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:21:07.609514+0000","last_undegraded":"2024-09-12T00:21:07.609514+0000","last_fullsized":"2024-09-12T00:21:07.609514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:02.260350+0000","last_change":"2024-09-12T00:18:54.276660+0000","last_active":"2024-09-12T00:22:02.260350+0000","last_peered":"2024-09-12T00:22:02.260350+0000","last_clean":"2024-09-12T00:22:02.260350+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:22:02.260350+0000","last_undegraded":"2024-09-12T00:22:02.260350+0000","last_fullsized":"2024-09-12T00:22:02.260350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.003649+0000","last_change":"2024-09-12T00:23:10.003493+0000","last_active":"2024-09-12T00:23:10.003649+0000","last_peered":"2024-09-12T00:23:10.003649+0000","last_clean":"2024-09-12T00:23:10.003649+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:23:10.003649+0000","last_undegraded":"2024-09-12T00:23:10.003649+0000","last_fullsized":"2024-09-12T00:23:10.003649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.003307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:46.132710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.991804+0000","last_change":"2024-09-12T00:22:45.991549+0000","last_active":"2024-09-12T00:22:45.991804+0000","last_peered":"2024-09-12T00:22:45.991804+0000","last_clean":"2024-09-12T00:22:45.991804+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:22:45.991804+0000","last_undegraded":"2024-09-12T00:22:45.991804+0000","last_fullsized":"2024-09-12T00:22:45.991804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.991336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:42.782875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.823994+0000","last_change":"2024-09-12T00:23:10.823854+0000","last_active":"2024-09-12T00:23:10.823994+0000","last_peered":"2024-09-12T00:23:10.823994+0000","last_clean":"2024-09-12T00:23:10.823994+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:23:10.823994+0000","last_undegraded":"2024-09-12T00:23:10.823994+0000","last_fullsized":"2024-09-12T00:23:10.823994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.823673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:48.346256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.712773+0000","last_change":"2024-09-12T00:23:15.712629+0000","last_active":"2024-09-12T00:23:15.712773+0000","last_peered":"2024-09-12T00:23:15.712773+0000","last_clean":"2024-09-12T00:23:15.712773+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:23:15.712773+0000","last_undegraded":"2024-09-12T00:23:15.712773+0000","last_fullsized":"2024-09-12T00:23:15.712773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.712426+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:44.227558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'286","reported_seq":446,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.834812+0000","last_change":"2024-09-12T00:23:21.834664+0000","last_active":"2024-09-12T00:23:21.834812+0000","last_peered":"2024-09-12T00:23:21.834812+0000","last_clean":"2024-09-12T00:23:21.834812+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:23:21.834812+0000","last_undegraded":"2024-09-12T00:23:21.834812+0000","last_fullsized":"2024-09-12T00:23:21.834812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.834474+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.429146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.724078+0000","last_change":"2024-09-12T00:23:32.724078+0000","last_active":"2024-09-12T00:23:32.724078+0000","last_peered":"2024-09-12T00:23:32.724078+0000","last_clean":"2024-09-12T00:23:32.724078+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:23:32.724078+0000","last_undegraded":"2024-09-12T00:23:32.724078+0000","last_fullsized":"2024-09-12T00:23:32.724078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.723839+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.576755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.687472+0000","last_change":"2024-09-12T00:22:57.687239+0000","last_active":"2024-09-12T00:22:57.687472+0000","last_peered":"2024-09-12T00:22:57.687472+0000","last_clean":"2024-09-12T00:22:57.687472+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:22:57.687472+0000","last_undegraded":"2024-09-12T00:22:57.687472+0000","last_fullsized":"2024-09-12T00:22:57.687472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.687015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:52.889888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.055380+0000","last_change":"2024-09-12T00:22:48.055242+0000","last_active":"2024-09-12T00:22:48.055380+0000","last_peered":"2024-09-12T00:22:48.055380+0000","last_clean":"2024-09-12T00:22:48.055380+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:22:48.055380+0000","last_undegraded":"2024-09-12T00:22:48.055380+0000","last_fullsized":"2024-09-12T00:22:48.055380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.055065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:08.979877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.389518+0000","last_change":"2024-09-12T00:23:12.389268+0000","last_active":"2024-09-12T00:23:12.389518+0000","last_peered":"2024-09-12T00:23:12.389518+0000","last_clean":"2024-09-12T00:23:12.389518+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:23:12.389518+0000","last_undegraded":"2024-09-12T00:23:12.389518+0000","last_fullsized":"2024-09-12T00:23:12.389518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.389028+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.911611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:07.609334+0000","last_change":"2024-09-12T00:18:50.242538+0000","last_active":"2024-09-12T00:21:07.609334+0000","last_peered":"2024-09-12T00:21:07.609334+0000","last_clean":"2024-09-12T00:21:07.609334+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:21:07.609334+0000","last_undegraded":"2024-09-12T00:21:07.609334+0000","last_fullsized":"2024-09-12T00:21:07.609334+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'286","reported_seq":483,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.117161+0000","last_change":"2024-09-12T00:23:26.117161+0000","last_active":"2024-09-12T00:23:26.117161+0000","last_peered":"2024-09-12T00:23:26.117161+0000","last_clean":"2024-09-12T00:23:26.117161+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:23:26.117161+0000","last_undegraded":"2024-09-12T00:23:26.117161+0000","last_fullsized":"2024-09-12T00:23:26.117161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.116977+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:01.457204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.774401+0000","last_change":"2024-09-12T00:23:26.774401+0000","last_active":"2024-09-12T00:23:26.774401+0000","last_peered":"2024-09-12T00:23:26.774401+0000","last_clean":"2024-09-12T00:23:26.774401+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:23:26.774401+0000","last_undegraded":"2024-09-12T00:23:26.774401+0000","last_fullsized":"2024-09-12T00:23:26.774401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.774216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.792583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.426031+0000","last_change":"2024-09-12T00:22:53.425858+0000","last_active":"2024-09-12T00:22:53.426031+0000","last_peered":"2024-09-12T00:22:53.426031+0000","last_clean":"2024-09-12T00:22:53.426031+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:53.426031+0000","last_undegraded":"2024-09-12T00:22:53.426031+0000","last_fullsized":"2024-09-12T00:22:53.426031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.425681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:50.989571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.037177+0000","last_change":"2024-09-12T00:22:45.037018+0000","last_active":"2024-09-12T00:22:45.037177+0000","last_peered":"2024-09-12T00:22:45.037177+0000","last_clean":"2024-09-12T00:22:45.037177+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:22:45.037177+0000","last_undegraded":"2024-09-12T00:22:45.037177+0000","last_fullsized":"2024-09-12T00:22:45.037177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.036831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:05.107642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.973980+0000","last_change":"2024-09-12T00:23:29.973980+0000","last_active":"2024-09-12T00:23:29.973980+0000","last_peered":"2024-09-12T00:23:29.973980+0000","last_clean":"2024-09-12T00:23:29.973980+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:23:29.973980+0000","last_undegraded":"2024-09-12T00:23:29.973980+0000","last_fullsized":"2024-09-12T00:23:29.973980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.973764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:26.938202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.225959+0000","last_change":"2024-09-12T00:23:21.225814+0000","last_active":"2024-09-12T00:23:21.225959+0000","last_peered":"2024-09-12T00:23:21.225959+0000","last_clean":"2024-09-12T00:23:21.225959+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:23:21.225959+0000","last_undegraded":"2024-09-12T00:23:21.225959+0000","last_fullsized":"2024-09-12T00:23:21.225959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.225622+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.693429+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.787743+0000","last_change":"2024-09-12T00:23:22.787743+0000","last_active":"2024-09-12T00:23:22.787743+0000","last_peered":"2024-09-12T00:23:22.787743+0000","last_clean":"2024-09-12T00:23:22.787743+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:23:22.787743+0000","last_undegraded":"2024-09-12T00:23:22.787743+0000","last_fullsized":"2024-09-12T00:23:22.787743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.787566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:44.124023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.267444+0000","last_change":"2024-09-12T00:23:31.267444+0000","last_active":"2024-09-12T00:23:31.267444+0000","last_peered":"2024-09-12T00:23:31.267444+0000","last_clean":"2024-09-12T00:23:31.267444+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:23:31.267444+0000","last_undegraded":"2024-09-12T00:23:31.267444+0000","last_fullsized":"2024-09-12T00:23:31.267444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.267222+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:19.298763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.741818+0000","last_change":"2024-09-12T00:22:53.741667+0000","last_active":"2024-09-12T00:22:53.741818+0000","last_peered":"2024-09-12T00:22:53.741818+0000","last_clean":"2024-09-12T00:22:53.741818+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:22:53.741818+0000","last_undegraded":"2024-09-12T00:22:53.741818+0000","last_fullsized":"2024-09-12T00:22:53.741818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.741481+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:54.588986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.330431+0000","last_change":"2024-09-12T00:22:38.330431+0000","last_active":"2024-09-12T00:22:38.330431+0000","last_peered":"2024-09-12T00:22:38.330431+0000","last_clean":"2024-09-12T00:22:38.330431+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:22:38.330431+0000","last_undegraded":"2024-09-12T00:22:38.330431+0000","last_fullsized":"2024-09-12T00:22:38.330431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.330231+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:47.818803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.088492+0000","last_change":"2024-09-12T00:22:40.088223+0000","last_active":"2024-09-12T00:22:40.088492+0000","last_peered":"2024-09-12T00:22:40.088492+0000","last_clean":"2024-09-12T00:22:40.088492+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:22:40.088492+0000","last_undegraded":"2024-09-12T00:22:40.088492+0000","last_fullsized":"2024-09-12T00:22:40.088492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.087970+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.489548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.015916+0000","last_change":"2024-09-12T00:22:43.015652+0000","last_active":"2024-09-12T00:22:43.015916+0000","last_peered":"2024-09-12T00:22:43.015916+0000","last_clean":"2024-09-12T00:22:43.015916+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:43.015916+0000","last_undegraded":"2024-09-12T00:22:43.015916+0000","last_fullsized":"2024-09-12T00:22:43.015916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.015422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:23.844048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.395580+0000","last_change":"2024-09-12T00:23:10.395580+0000","last_active":"2024-09-12T00:23:10.395580+0000","last_peered":"2024-09-12T00:23:10.395580+0000","last_clean":"2024-09-12T00:23:10.395580+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:23:10.395580+0000","last_undegraded":"2024-09-12T00:23:10.395580+0000","last_fullsized":"2024-09-12T00:23:10.395580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.395395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'97","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.996724+0000","last_change":"2024-09-12T00:23:35.996724+0000","last_active":"2024-09-12T00:23:35.996724+0000","last_peered":"2024-09-12T00:23:35.996724+0000","last_clean":"2024-09-12T00:23:35.996724+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:23:35.996724+0000","last_undegraded":"2024-09-12T00:23:35.996724+0000","last_fullsized":"2024-09-12T00:23:35.996724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.996525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.788244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.785001+0000","last_change":"2024-09-12T00:23:15.785001+0000","last_active":"2024-09-12T00:23:15.785001+0000","last_peered":"2024-09-12T00:23:15.785001+0000","last_clean":"2024-09-12T00:23:15.785001+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:23:15.785001+0000","last_undegraded":"2024-09-12T00:23:15.785001+0000","last_fullsized":"2024-09-12T00:23:15.785001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.784792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:05.198107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.727983+0000","last_change":"2024-09-12T00:23:28.727983+0000","last_active":"2024-09-12T00:23:28.727983+0000","last_peered":"2024-09-12T00:23:28.727983+0000","last_clean":"2024-09-12T00:23:28.727983+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:23:28.727983+0000","last_undegraded":"2024-09-12T00:23:28.727983+0000","last_fullsized":"2024-09-12T00:23:28.727983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'82","last_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_deep_scrub":"33'82","last_deep_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.727807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:37.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.038978+0000","last_change":"2024-09-12T00:23:08.038978+0000","last_active":"2024-09-12T00:23:08.038978+0000","last_peered":"2024-09-12T00:23:08.038978+0000","last_clean":"2024-09-12T00:23:08.038978+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:23:08.038978+0000","last_undegraded":"2024-09-12T00:23:08.038978+0000","last_fullsized":"2024-09-12T00:23:08.038978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.038792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:47.713400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.101143+0000","last_change":"2024-09-12T00:22:38.101143+0000","last_active":"2024-09-12T00:22:38.101143+0000","last_peered":"2024-09-12T00:22:38.101143+0000","last_clean":"2024-09-12T00:22:38.101143+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:22:38.101143+0000","last_undegraded":"2024-09-12T00:22:38.101143+0000","last_fullsized":"2024-09-12T00:22:38.101143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.100967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:57.104038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.819521+0000","last_change":"2024-09-12T00:22:41.819357+0000","last_active":"2024-09-12T00:22:41.819521+0000","last_peered":"2024-09-12T00:22:41.819521+0000","last_clean":"2024-09-12T00:22:41.819521+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:22:41.819521+0000","last_undegraded":"2024-09-12T00:22:41.819521+0000","last_fullsized":"2024-09-12T00:22:41.819521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.819171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.252502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.975236+0000","last_change":"2024-09-12T00:23:27.975236+0000","last_active":"2024-09-12T00:23:27.975236+0000","last_peered":"2024-09-12T00:23:27.975236+0000","last_clean":"2024-09-12T00:23:27.975236+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:23:27.975236+0000","last_undegraded":"2024-09-12T00:23:27.975236+0000","last_fullsized":"2024-09-12T00:23:27.975236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.975054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.142602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'301","reported_seq":534,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.254372+0000","last_change":"2024-09-12T00:23:20.254372+0000","last_active":"2024-09-12T00:23:20.254372+0000","last_peered":"2024-09-12T00:23:20.254372+0000","last_clean":"2024-09-12T00:23:20.254372+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:23:20.254372+0000","last_undegraded":"2024-09-12T00:23:20.254372+0000","last_fullsized":"2024-09-12T00:23:20.254372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'301","last_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_deep_scrub":"33'301","last_deep_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.254181+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.785930+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:57.606444+0000","last_change":"2024-09-12T00:18:52.255448+0000","last_active":"2024-09-12T00:20:57.606444+0000","last_peered":"2024-09-12T00:20:57.606444+0000","last_clean":"2024-09-12T00:20:57.606444+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:20:57.606444+0000","last_undegraded":"2024-09-12T00:20:57.606444+0000","last_fullsized":"2024-09-12T00:20:57.606444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.274760+0000","last_change":"2024-09-12T00:23:34.274760+0000","last_active":"2024-09-12T00:23:34.274760+0000","last_peered":"2024-09-12T00:23:34.274760+0000","last_clean":"2024-09-12T00:23:34.274760+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:23:34.274760+0000","last_undegraded":"2024-09-12T00:23:34.274760+0000","last_fullsized":"2024-09-12T00:23:34.274760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.274531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.127447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.892856+0000","last_change":"2024-09-12T00:22:56.892682+0000","last_active":"2024-09-12T00:22:56.892856+0000","last_peered":"2024-09-12T00:22:56.892856+0000","last_clean":"2024-09-12T00:22:56.892856+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:56.892856+0000","last_undegraded":"2024-09-12T00:22:56.892856+0000","last_fullsized":"2024-09-12T00:22:56.892856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.892476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:41.105061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.794403+0000","last_change":"2024-09-12T00:22:38.794195+0000","last_active":"2024-09-12T00:22:38.794403+0000","last_peered":"2024-09-12T00:22:38.794403+0000","last_clean":"2024-09-12T00:22:38.794403+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:22:38.794403+0000","last_undegraded":"2024-09-12T00:22:38.794403+0000","last_fullsized":"2024-09-12T00:22:38.794403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.794009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:39.382664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.745657+0000","last_change":"2024-09-12T00:22:39.745499+0000","last_active":"2024-09-12T00:22:39.745657+0000","last_peered":"2024-09-12T00:22:39.745657+0000","last_clean":"2024-09-12T00:22:39.745657+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:22:39.745657+0000","last_undegraded":"2024-09-12T00:22:39.745657+0000","last_fullsized":"2024-09-12T00:22:39.745657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.745298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.209943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.757419+0000","last_change":"2024-09-12T00:23:06.757280+0000","last_active":"2024-09-12T00:23:06.757419+0000","last_peered":"2024-09-12T00:23:06.757419+0000","last_clean":"2024-09-12T00:23:06.757419+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:23:06.757419+0000","last_undegraded":"2024-09-12T00:23:06.757419+0000","last_fullsized":"2024-09-12T00:23:06.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.757101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:36.253152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.804413+0000","last_change":"2024-09-12T00:23:13.804413+0000","last_active":"2024-09-12T00:23:13.804413+0000","last_peered":"2024-09-12T00:23:13.804413+0000","last_clean":"2024-09-12T00:23:13.804413+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:23:13.804413+0000","last_undegraded":"2024-09-12T00:23:13.804413+0000","last_fullsized":"2024-09-12T00:23:13.804413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.804104+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.235994+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.731479+0000","last_change":"2024-09-12T00:23:21.731479+0000","last_active":"2024-09-12T00:23:21.731479+0000","last_peered":"2024-09-12T00:23:21.731479+0000","last_clean":"2024-09-12T00:23:21.731479+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:23:21.731479+0000","last_undegraded":"2024-09-12T00:23:21.731479+0000","last_fullsized":"2024-09-12T00:23:21.731479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.731300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.532025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.916522+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.916522+0000","last_peered":"2024-09-12T00:22:01.916522+0000","last_clean":"2024-09-12T00:22:01.916522+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.916522+0000","last_undegraded":"2024-09-12T00:22:01.916522+0000","last_fullsized":"2024-09-12T00:22:01.916522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.935849+0000","last_change":"2024-09-12T00:22:50.935612+0000","last_active":"2024-09-12T00:22:50.935849+0000","last_peered":"2024-09-12T00:22:50.935849+0000","last_clean":"2024-09-12T00:22:50.935849+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:22:50.935849+0000","last_undegraded":"2024-09-12T00:22:50.935849+0000","last_fullsized":"2024-09-12T00:22:50.935849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.935377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:27.379599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.123005+0000","last_change":"2024-09-12T00:22:39.122842+0000","last_active":"2024-09-12T00:22:39.123005+0000","last_peered":"2024-09-12T00:22:39.123005+0000","last_clean":"2024-09-12T00:22:39.123005+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:22:39.123005+0000","last_undegraded":"2024-09-12T00:22:39.123005+0000","last_fullsized":"2024-09-12T00:22:39.123005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.122671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.081831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.755968+0000","last_change":"2024-09-12T00:22:37.755805+0000","last_active":"2024-09-12T00:22:37.755968+0000","last_peered":"2024-09-12T00:22:37.755968+0000","last_clean":"2024-09-12T00:22:37.755968+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:22:37.755968+0000","last_undegraded":"2024-09-12T00:22:37.755968+0000","last_fullsized":"2024-09-12T00:22:37.755968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.755556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:00.374036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.892359+0000","last_change":"2024-09-12T00:23:04.892359+0000","last_active":"2024-09-12T00:23:04.892359+0000","last_peered":"2024-09-12T00:23:04.892359+0000","last_clean":"2024-09-12T00:23:04.892359+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:23:04.892359+0000","last_undegraded":"2024-09-12T00:23:04.892359+0000","last_fullsized":"2024-09-12T00:23:04.892359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.892143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.673491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.012551+0000","last_change":"2024-09-12T00:23:35.012551+0000","last_active":"2024-09-12T00:23:35.012551+0000","last_peered":"2024-09-12T00:23:35.012551+0000","last_clean":"2024-09-12T00:23:35.012551+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:23:35.012551+0000","last_undegraded":"2024-09-12T00:23:35.012551+0000","last_fullsized":"2024-09-12T00:23:35.012551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.012329+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.415526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:02.607824+0000","last_change":"2024-09-12T00:18:52.260850+0000","last_active":"2024-09-12T00:21:02.607824+0000","last_peered":"2024-09-12T00:21:02.607824+0000","last_clean":"2024-09-12T00:21:02.607824+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:21:02.607824+0000","last_undegraded":"2024-09-12T00:21:02.607824+0000","last_fullsized":"2024-09-12T00:21:02.607824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.235128+0000","last_change":"2024-09-12T00:23:33.235128+0000","last_active":"2024-09-12T00:23:33.235128+0000","last_peered":"2024-09-12T00:23:33.235128+0000","last_clean":"2024-09-12T00:23:33.235128+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:23:33.235128+0000","last_undegraded":"2024-09-12T00:23:33.235128+0000","last_fullsized":"2024-09-12T00:23:33.235128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.234948+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:32.748974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.391150+0000","last_change":"2024-09-12T00:22:51.390965+0000","last_active":"2024-09-12T00:22:51.391150+0000","last_peered":"2024-09-12T00:22:51.391150+0000","last_clean":"2024-09-12T00:22:51.391150+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:51.391150+0000","last_undegraded":"2024-09-12T00:22:51.391150+0000","last_fullsized":"2024-09-12T00:22:51.391150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.390779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:45.398139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.771257+0000","last_change":"2024-09-12T00:22:39.771132+0000","last_active":"2024-09-12T00:22:39.771257+0000","last_peered":"2024-09-12T00:22:39.771257+0000","last_clean":"2024-09-12T00:22:39.771257+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:22:39.771257+0000","last_undegraded":"2024-09-12T00:22:39.771257+0000","last_fullsized":"2024-09-12T00:22:39.771257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.770939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.724696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.712557+0000","last_change":"2024-09-12T00:22:38.712422+0000","last_active":"2024-09-12T00:22:38.712557+0000","last_peered":"2024-09-12T00:22:38.712557+0000","last_clean":"2024-09-12T00:22:38.712557+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:22:38.712557+0000","last_undegraded":"2024-09-12T00:22:38.712557+0000","last_fullsized":"2024-09-12T00:22:38.712557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.712222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:33.915095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.877769+0000","last_change":"2024-09-12T00:23:05.877769+0000","last_active":"2024-09-12T00:23:05.877769+0000","last_peered":"2024-09-12T00:23:05.877769+0000","last_clean":"2024-09-12T00:23:05.877769+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:23:05.877769+0000","last_undegraded":"2024-09-12T00:23:05.877769+0000","last_fullsized":"2024-09-12T00:23:05.877769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.877586+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.254000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'92","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.753759+0000","last_change":"2024-09-12T00:23:16.753759+0000","last_active":"2024-09-12T00:23:16.753759+0000","last_peered":"2024-09-12T00:23:16.753759+0000","last_clean":"2024-09-12T00:23:16.753759+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:23:16.753759+0000","last_undegraded":"2024-09-12T00:23:16.753759+0000","last_fullsized":"2024-09-12T00:23:16.753759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.753506+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.903478+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.804833+0000","last_change":"2024-09-12T00:23:19.804833+0000","last_active":"2024-09-12T00:23:19.804833+0000","last_peered":"2024-09-12T00:23:19.804833+0000","last_clean":"2024-09-12T00:23:19.804833+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:23:19.804833+0000","last_undegraded":"2024-09-12T00:23:19.804833+0000","last_fullsized":"2024-09-12T00:23:19.804833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.804652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:53.743040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.739376+0000","last_change":"2024-09-12T00:23:35.739376+0000","last_active":"2024-09-12T00:23:35.739376+0000","last_peered":"2024-09-12T00:23:35.739376+0000","last_clean":"2024-09-12T00:23:35.739376+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:23:35.739376+0000","last_undegraded":"2024-09-12T00:23:35.739376+0000","last_fullsized":"2024-09-12T00:23:35.739376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.739191+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:30.348394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.727046+0000","last_change":"2024-09-12T00:22:54.726884+0000","last_active":"2024-09-12T00:22:54.727046+0000","last_peered":"2024-09-12T00:22:54.727046+0000","last_clean":"2024-09-12T00:22:54.727046+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:22:54.727046+0000","last_undegraded":"2024-09-12T00:22:54.727046+0000","last_fullsized":"2024-09-12T00:22:54.727046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.726712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:01.342735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.855296+0000","last_change":"2024-09-12T00:22:42.855131+0000","last_active":"2024-09-12T00:22:42.855296+0000","last_peered":"2024-09-12T00:22:42.855296+0000","last_clean":"2024-09-12T00:22:42.855296+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:22:42.855296+0000","last_undegraded":"2024-09-12T00:22:42.855296+0000","last_fullsized":"2024-09-12T00:22:42.855296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.854911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.063391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.050175+0000","last_change":"2024-09-12T00:22:41.050057+0000","last_active":"2024-09-12T00:22:41.050175+0000","last_peered":"2024-09-12T00:22:41.050175+0000","last_clean":"2024-09-12T00:22:41.050175+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:22:41.050175+0000","last_undegraded":"2024-09-12T00:22:41.050175+0000","last_fullsized":"2024-09-12T00:22:41.050175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.049881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:33.601411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.928997+0000","last_change":"2024-09-12T00:23:26.928997+0000","last_active":"2024-09-12T00:23:26.928997+0000","last_peered":"2024-09-12T00:23:26.928997+0000","last_clean":"2024-09-12T00:23:26.928997+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:23:26.928997+0000","last_undegraded":"2024-09-12T00:23:26.928997+0000","last_fullsized":"2024-09-12T00:23:26.928997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.928808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:06.461175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.296031+0000","last_change":"2024-09-12T00:23:19.296031+0000","last_active":"2024-09-12T00:23:19.296031+0000","last_peered":"2024-09-12T00:23:19.296031+0000","last_clean":"2024-09-12T00:23:19.296031+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:23:19.296031+0000","last_undegraded":"2024-09-12T00:23:19.296031+0000","last_fullsized":"2024-09-12T00:23:19.296031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.295840+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.390911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'286","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.131018+0000","last_change":"2024-09-12T00:23:25.131018+0000","last_active":"2024-09-12T00:23:25.131018+0000","last_peered":"2024-09-12T00:23:25.131018+0000","last_clean":"2024-09-12T00:23:25.131018+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:23:25.131018+0000","last_undegraded":"2024-09-12T00:23:25.131018+0000","last_fullsized":"2024-09-12T00:23:25.131018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.130835+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:22.948498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.610911+0000","last_change":"2024-09-12T00:18:54.267890+0000","last_active":"2024-09-12T00:21:12.610911+0000","last_peered":"2024-09-12T00:21:12.610911+0000","last_clean":"2024-09-12T00:21:12.610911+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:21:12.610911+0000","last_undegraded":"2024-09-12T00:21:12.610911+0000","last_fullsized":"2024-09-12T00:21:12.610911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.162564+0000","last_change":"2024-09-12T00:23:05.162564+0000","last_active":"2024-09-12T00:23:05.162564+0000","last_peered":"2024-09-12T00:23:05.162564+0000","last_clean":"2024-09-12T00:23:05.162564+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:23:05.162564+0000","last_undegraded":"2024-09-12T00:23:05.162564+0000","last_fullsized":"2024-09-12T00:23:05.162564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.162392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:00.470991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.058734+0000","last_change":"2024-09-12T00:22:44.058569+0000","last_active":"2024-09-12T00:22:44.058734+0000","last_peered":"2024-09-12T00:22:44.058734+0000","last_clean":"2024-09-12T00:22:44.058734+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:44.058734+0000","last_undegraded":"2024-09-12T00:22:44.058734+0000","last_fullsized":"2024-09-12T00:22:44.058734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.058384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.669388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.675883+0000","last_change":"2024-09-12T00:22:37.675755+0000","last_active":"2024-09-12T00:22:37.675883+0000","last_peered":"2024-09-12T00:22:37.675883+0000","last_clean":"2024-09-12T00:22:37.675883+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:22:37.675883+0000","last_undegraded":"2024-09-12T00:22:37.675883+0000","last_fullsized":"2024-09-12T00:22:37.675883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.675639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:18.021676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.900291+0000","last_change":"2024-09-12T00:23:25.900291+0000","last_active":"2024-09-12T00:23:25.900291+0000","last_peered":"2024-09-12T00:23:25.900291+0000","last_clean":"2024-09-12T00:23:25.900291+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:23:25.900291+0000","last_undegraded":"2024-09-12T00:23:25.900291+0000","last_fullsized":"2024-09-12T00:23:25.900291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.900079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.980753+0000","last_change":"2024-09-12T00:23:33.980753+0000","last_active":"2024-09-12T00:23:33.980753+0000","last_peered":"2024-09-12T00:23:33.980753+0000","last_clean":"2024-09-12T00:23:33.980753+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:23:33.980753+0000","last_undegraded":"2024-09-12T00:23:33.980753+0000","last_fullsized":"2024-09-12T00:23:33.980753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.980516+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:23.601865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'286","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.693953+0000","last_change":"2024-09-12T00:23:19.693953+0000","last_active":"2024-09-12T00:23:19.693953+0000","last_peered":"2024-09-12T00:23:19.693953+0000","last_clean":"2024-09-12T00:23:19.693953+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:23:19.693953+0000","last_undegraded":"2024-09-12T00:23:19.693953+0000","last_fullsized":"2024-09-12T00:23:19.693953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.693733+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.161540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.250239+0000","last_change":"2024-09-12T00:23:35.250239+0000","last_active":"2024-09-12T00:23:35.250239+0000","last_peered":"2024-09-12T00:23:35.250239+0000","last_clean":"2024-09-12T00:23:35.250239+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:23:35.250239+0000","last_undegraded":"2024-09-12T00:23:35.250239+0000","last_fullsized":"2024-09-12T00:23:35.250239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.249999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:43.231307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.751001+0000","last_change":"2024-09-12T00:22:52.750826+0000","last_active":"2024-09-12T00:22:52.751001+0000","last_peered":"2024-09-12T00:22:52.751001+0000","last_clean":"2024-09-12T00:22:52.751001+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:52.751001+0000","last_undegraded":"2024-09-12T00:22:52.751001+0000","last_fullsized":"2024-09-12T00:22:52.751001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.750640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:43.087670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.284791+0000","last_change":"2024-09-12T00:22:37.284618+0000","last_active":"2024-09-12T00:22:37.284791+0000","last_peered":"2024-09-12T00:22:37.284791+0000","last_clean":"2024-09-12T00:22:37.284791+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:22:37.284791+0000","last_undegraded":"2024-09-12T00:22:37.284791+0000","last_fullsized":"2024-09-12T00:22:37.284791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.284374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:35.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.021196+0000","last_change":"2024-09-12T00:22:42.021039+0000","last_active":"2024-09-12T00:22:42.021196+0000","last_peered":"2024-09-12T00:22:42.021196+0000","last_clean":"2024-09-12T00:22:42.021196+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:22:42.021196+0000","last_undegraded":"2024-09-12T00:22:42.021196+0000","last_fullsized":"2024-09-12T00:22:42.021196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.020861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:34.147473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'5","reported_seq":239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.878785+0000","last_change":"2024-09-12T00:23:24.878785+0000","last_active":"2024-09-12T00:23:24.878785+0000","last_peered":"2024-09-12T00:23:24.878785+0000","last_clean":"2024-09-12T00:23:24.878785+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:23:24.878785+0000","last_undegraded":"2024-09-12T00:23:24.878785+0000","last_fullsized":"2024-09-12T00:23:24.878785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.878599+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:51.060676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'107","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.815851+0000","last_change":"2024-09-12T00:23:12.815851+0000","last_active":"2024-09-12T00:23:12.815851+0000","last_peered":"2024-09-12T00:23:12.815851+0000","last_clean":"2024-09-12T00:23:12.815851+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:23:12.815851+0000","last_undegraded":"2024-09-12T00:23:12.815851+0000","last_fullsized":"2024-09-12T00:23:12.815851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'107","last_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_deep_scrub":"33'107","last_deep_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.815651+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:02.753655+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.715268+0000","last_change":"2024-09-12T00:23:17.715268+0000","last_active":"2024-09-12T00:23:17.715268+0000","last_peered":"2024-09-12T00:23:17.715268+0000","last_clean":"2024-09-12T00:23:17.715268+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:23:17.715268+0000","last_undegraded":"2024-09-12T00:23:17.715268+0000","last_fullsized":"2024-09-12T00:23:17.715268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.715091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:21.810163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.762359+0000","last_change":"2024-09-12T00:23:29.762359+0000","last_active":"2024-09-12T00:23:29.762359+0000","last_peered":"2024-09-12T00:23:29.762359+0000","last_clean":"2024-09-12T00:23:29.762359+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:23:29.762359+0000","last_undegraded":"2024-09-12T00:23:29.762359+0000","last_fullsized":"2024-09-12T00:23:29.762359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.762179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:07.284762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.727111+0000","last_change":"2024-09-12T00:23:31.727111+0000","last_active":"2024-09-12T00:23:31.727111+0000","last_peered":"2024-09-12T00:23:31.727111+0000","last_clean":"2024-09-12T00:23:31.727111+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:23:31.727111+0000","last_undegraded":"2024-09-12T00:23:31.727111+0000","last_fullsized":"2024-09-12T00:23:31.727111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.726920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:28.958312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.736232+0000","last_change":"2024-09-12T00:22:58.736086+0000","last_active":"2024-09-12T00:22:58.736232+0000","last_peered":"2024-09-12T00:22:58.736232+0000","last_clean":"2024-09-12T00:22:58.736232+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:58.736232+0000","last_undegraded":"2024-09-12T00:22:58.736232+0000","last_fullsized":"2024-09-12T00:22:58.736232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.735904+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.200548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.010021+0000","last_change":"2024-09-12T00:22:52.009865+0000","last_active":"2024-09-12T00:22:52.010021+0000","last_peered":"2024-09-12T00:22:52.010021+0000","last_clean":"2024-09-12T00:22:52.010021+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:22:52.010021+0000","last_undegraded":"2024-09-12T00:22:52.010021+0000","last_fullsized":"2024-09-12T00:22:52.010021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.009684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.867922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.391648+0000","last_change":"2024-09-12T00:23:13.391496+0000","last_active":"2024-09-12T00:23:13.391648+0000","last_peered":"2024-09-12T00:23:13.391648+0000","last_clean":"2024-09-12T00:23:13.391648+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:23:13.391648+0000","last_undegraded":"2024-09-12T00:23:13.391648+0000","last_fullsized":"2024-09-12T00:23:13.391648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.391315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:03.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'41","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.353557+0000","last_change":"2024-09-12T00:18:50.239343+0000","last_active":"2024-09-12T00:22:33.353557+0000","last_peered":"2024-09-12T00:22:33.353557+0000","last_clean":"2024-09-12T00:22:33.353557+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:22:33.353557+0000","last_undegraded":"2024-09-12T00:22:33.353557+0000","last_fullsized":"2024-09-12T00:22:33.353557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:12.610552+0000","last_change":"2024-09-12T00:18:52.266166+0000","last_active":"2024-09-12T00:21:12.610552+0000","last_peered":"2024-09-12T00:21:12.610552+0000","last_clean":"2024-09-12T00:21:12.610552+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:21:12.610552+0000","last_undegraded":"2024-09-12T00:21:12.610552+0000","last_fullsized":"2024-09-12T00:21:12.610552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.781322+0000","last_change":"2024-09-12T00:23:36.781322+0000","last_active":"2024-09-12T00:23:36.781322+0000","last_peered":"2024-09-12T00:23:36.781322+0000","last_clean":"2024-09-12T00:23:36.781322+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:23:36.781322+0000","last_undegraded":"2024-09-12T00:23:36.781322+0000","last_fullsized":"2024-09-12T00:23:36.781322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.781142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:38.074240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.391756+0000","last_change":"2024-09-12T00:22:58.391625+0000","last_active":"2024-09-12T00:22:58.391756+0000","last_peered":"2024-09-12T00:22:58.391756+0000","last_clean":"2024-09-12T00:22:58.391756+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:58.391756+0000","last_undegraded":"2024-09-12T00:22:58.391756+0000","last_fullsized":"2024-09-12T00:22:58.391756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.391445+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.604030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.779442+0000","last_change":"2024-09-12T00:22:42.779281+0000","last_active":"2024-09-12T00:22:42.779442+0000","last_peered":"2024-09-12T00:22:42.779442+0000","last_clean":"2024-09-12T00:22:42.779442+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:22:42.779442+0000","last_undegraded":"2024-09-12T00:22:42.779442+0000","last_fullsized":"2024-09-12T00:22:42.779442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.779092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.713311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.990753+0000","last_change":"2024-09-12T00:23:30.990753+0000","last_active":"2024-09-12T00:23:30.990753+0000","last_peered":"2024-09-12T00:23:30.990753+0000","last_clean":"2024-09-12T00:23:30.990753+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:23:30.990753+0000","last_undegraded":"2024-09-12T00:23:30.990753+0000","last_fullsized":"2024-09-12T00:23:30.990753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.990569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.843256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.690110+0000","last_change":"2024-09-12T00:23:20.689939+0000","last_active":"2024-09-12T00:23:20.690110+0000","last_peered":"2024-09-12T00:23:20.690110+0000","last_clean":"2024-09-12T00:23:20.690110+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:23:20.690110+0000","last_undegraded":"2024-09-12T00:23:20.690110+0000","last_fullsized":"2024-09-12T00:23:20.690110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.689752+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:32.818163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.846425+0000","last_change":"2024-09-12T00:23:20.846280+0000","last_active":"2024-09-12T00:23:20.846425+0000","last_peered":"2024-09-12T00:23:20.846425+0000","last_clean":"2024-09-12T00:23:20.846425+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:23:20.846425+0000","last_undegraded":"2024-09-12T00:23:20.846425+0000","last_fullsized":"2024-09-12T00:23:20.846425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.846099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:42.175845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.544632+0000","last_change":"2024-09-12T00:18:54.267752+0000","last_active":"2024-09-12T00:19:24.544632+0000","last_peered":"2024-09-12T00:19:24.544632+0000","last_clean":"2024-09-12T00:19:24.544632+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:19:24.544632+0000","last_undegraded":"2024-09-12T00:19:24.544632+0000","last_fullsized":"2024-09-12T00:19:24.544632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:02.039949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.942888+0000","last_change":"2024-09-12T00:22:54.942747+0000","last_active":"2024-09-12T00:22:54.942888+0000","last_peered":"2024-09-12T00:22:54.942888+0000","last_clean":"2024-09-12T00:22:54.942888+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:54.942888+0000","last_undegraded":"2024-09-12T00:22:54.942888+0000","last_fullsized":"2024-09-12T00:22:54.942888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.942553+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:15.834853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.806447+0000","last_change":"2024-09-12T00:22:44.806286+0000","last_active":"2024-09-12T00:22:44.806447+0000","last_peered":"2024-09-12T00:22:44.806447+0000","last_clean":"2024-09-12T00:22:44.806447+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:22:44.806447+0000","last_undegraded":"2024-09-12T00:22:44.806447+0000","last_fullsized":"2024-09-12T00:22:44.806447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.806101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.067872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.696548+0000","last_change":"2024-09-12T00:23:08.696289+0000","last_active":"2024-09-12T00:23:08.696548+0000","last_peered":"2024-09-12T00:23:08.696548+0000","last_clean":"2024-09-12T00:23:08.696548+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:23:08.696548+0000","last_undegraded":"2024-09-12T00:23:08.696548+0000","last_fullsized":"2024-09-12T00:23:08.696548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.696055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'51","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.851527+0000","last_change":"2024-09-12T00:23:12.851378+0000","last_active":"2024-09-12T00:23:12.851527+0000","last_peered":"2024-09-12T00:23:12.851527+0000","last_clean":"2024-09-12T00:23:12.851527+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:23:12.851527+0000","last_undegraded":"2024-09-12T00:23:12.851527+0000","last_fullsized":"2024-09-12T00:23:12.851527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.851186+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:10.082578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.120229+0000","last_change":"2024-09-12T00:23:27.120097+0000","last_active":"2024-09-12T00:23:27.120229+0000","last_peered":"2024-09-12T00:23:27.120229+0000","last_clean":"2024-09-12T00:23:27.120229+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:23:27.120229+0000","last_undegraded":"2024-09-12T00:23:27.120229+0000","last_fullsized":"2024-09-12T00:23:27.120229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.119923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.850332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.294087+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:19:24.294087+0000","last_peered":"2024-09-12T00:19:24.294087+0000","last_clean":"2024-09-12T00:19:24.294087+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:19:24.294087+0000","last_undegraded":"2024-09-12T00:19:24.294087+0000","last_fullsized":"2024-09-12T00:19:24.294087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:11.689909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.990198+0000","last_change":"2024-09-12T00:23:10.990006+0000","last_active":"2024-09-12T00:23:10.990198+0000","last_peered":"2024-09-12T00:23:10.990198+0000","last_clean":"2024-09-12T00:23:10.990198+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:23:10.990198+0000","last_undegraded":"2024-09-12T00:23:10.990198+0000","last_fullsized":"2024-09-12T00:23:10.990198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.989822+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:55.630091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.300825+0000","last_change":"2024-09-12T00:22:39.300694+0000","last_active":"2024-09-12T00:22:39.300825+0000","last_peered":"2024-09-12T00:22:39.300825+0000","last_clean":"2024-09-12T00:22:39.300825+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:39.300825+0000","last_undegraded":"2024-09-12T00:22:39.300825+0000","last_fullsized":"2024-09-12T00:22:39.300825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.300502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:21.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.987296+0000","last_change":"2024-09-12T00:23:28.987296+0000","last_active":"2024-09-12T00:23:28.987296+0000","last_peered":"2024-09-12T00:23:28.987296+0000","last_clean":"2024-09-12T00:23:28.987296+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:23:28.987296+0000","last_undegraded":"2024-09-12T00:23:28.987296+0000","last_fullsized":"2024-09-12T00:23:28.987296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.987116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.128553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.718980+0000","last_change":"2024-09-12T00:23:16.718828+0000","last_active":"2024-09-12T00:23:16.718980+0000","last_peered":"2024-09-12T00:23:16.718980+0000","last_clean":"2024-09-12T00:23:16.718980+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:23:16.718980+0000","last_undegraded":"2024-09-12T00:23:16.718980+0000","last_fullsized":"2024-09-12T00:23:16.718980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.718625+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.155804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.756383+0000","last_change":"2024-09-12T00:23:23.756222+0000","last_active":"2024-09-12T00:23:23.756383+0000","last_peered":"2024-09-12T00:23:23.756383+0000","last_clean":"2024-09-12T00:23:23.756383+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:23:23.756383+0000","last_undegraded":"2024-09-12T00:23:23.756383+0000","last_fullsized":"2024-09-12T00:23:23.756383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.756031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.537379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.925830+0000","last_change":"2024-09-12T00:23:15.925830+0000","last_active":"2024-09-12T00:23:15.925830+0000","last_peered":"2024-09-12T00:23:15.925830+0000","last_clean":"2024-09-12T00:23:15.925830+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:23:15.925830+0000","last_undegraded":"2024-09-12T00:23:15.925830+0000","last_fullsized":"2024-09-12T00:23:15.925830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.925622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.066023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.035250+0000","last_change":"2024-09-12T00:22:53.034956+0000","last_active":"2024-09-12T00:22:53.035250+0000","last_peered":"2024-09-12T00:22:53.035250+0000","last_clean":"2024-09-12T00:22:53.035250+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:22:53.035250+0000","last_undegraded":"2024-09-12T00:22:53.035250+0000","last_fullsized":"2024-09-12T00:22:53.035250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.034651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:57.265344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.726656+0000","last_change":"2024-09-12T00:23:18.726656+0000","last_active":"2024-09-12T00:23:18.726656+0000","last_peered":"2024-09-12T00:23:18.726656+0000","last_clean":"2024-09-12T00:23:18.726656+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:23:18.726656+0000","last_undegraded":"2024-09-12T00:23:18.726656+0000","last_fullsized":"2024-09-12T00:23:18.726656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.726384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:15.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'72","reported_seq":151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.815989+0000","last_change":"2024-09-12T00:23:13.815989+0000","last_active":"2024-09-12T00:23:13.815989+0000","last_peered":"2024-09-12T00:23:13.815989+0000","last_clean":"2024-09-12T00:23:13.815989+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:23:13.815989+0000","last_undegraded":"2024-09-12T00:23:13.815989+0000","last_fullsized":"2024-09-12T00:23:13.815989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.815744+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:18.956083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.773527+0000","last_change":"2024-09-12T00:23:25.773527+0000","last_active":"2024-09-12T00:23:25.773527+0000","last_peered":"2024-09-12T00:23:25.773527+0000","last_clean":"2024-09-12T00:23:25.773527+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:23:25.773527+0000","last_undegraded":"2024-09-12T00:23:25.773527+0000","last_fullsized":"2024-09-12T00:23:25.773527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.773341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.853684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.767983+0000","last_change":"2024-09-12T00:23:31.767728+0000","last_active":"2024-09-12T00:23:31.767983+0000","last_peered":"2024-09-12T00:23:31.767983+0000","last_clean":"2024-09-12T00:23:31.767983+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:23:31.767983+0000","last_undegraded":"2024-09-12T00:23:31.767983+0000","last_fullsized":"2024-09-12T00:23:31.767983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.767491+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:31.281516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'16","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.878714+0000","last_change":"2024-09-12T00:23:03.878714+0000","last_active":"2024-09-12T00:23:03.878714+0000","last_peered":"2024-09-12T00:23:03.878714+0000","last_clean":"2024-09-12T00:23:03.878714+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:23:03.878714+0000","last_undegraded":"2024-09-12T00:23:03.878714+0000","last_fullsized":"2024-09-12T00:23:03.878714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.878512+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:25.214968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.306296+0000","last_change":"2024-09-12T00:22:40.306113+0000","last_active":"2024-09-12T00:22:40.306296+0000","last_peered":"2024-09-12T00:22:40.306296+0000","last_clean":"2024-09-12T00:22:40.306296+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:22:40.306296+0000","last_undegraded":"2024-09-12T00:22:40.306296+0000","last_fullsized":"2024-09-12T00:22:40.306296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.305907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.508780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.794996+0000","last_change":"2024-09-12T00:23:11.794996+0000","last_active":"2024-09-12T00:23:11.794996+0000","last_peered":"2024-09-12T00:23:11.794996+0000","last_clean":"2024-09-12T00:23:11.794996+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:23:11.794996+0000","last_undegraded":"2024-09-12T00:23:11.794996+0000","last_fullsized":"2024-09-12T00:23:11.794996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.794802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.268181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'40","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.479270+0000","last_change":"2024-09-12T00:18:50.243373+0000","last_active":"2024-09-12T00:22:33.479270+0000","last_peered":"2024-09-12T00:22:33.479270+0000","last_clean":"2024-09-12T00:22:33.479270+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:22:33.479270+0000","last_undegraded":"2024-09-12T00:22:33.479270+0000","last_fullsized":"2024-09-12T00:22:33.479270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.135941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.218191+0000","last_change":"2024-09-12T00:23:30.218191+0000","last_active":"2024-09-12T00:23:30.218191+0000","last_peered":"2024-09-12T00:23:30.218191+0000","last_clean":"2024-09-12T00:23:30.218191+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:23:30.218191+0000","last_undegraded":"2024-09-12T00:23:30.218191+0000","last_fullsized":"2024-09-12T00:23:30.218191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.218010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:35.490956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.611972+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:21:17.611972+0000","last_peered":"2024-09-12T00:21:17.611972+0000","last_clean":"2024-09-12T00:21:17.611972+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:21:17.611972+0000","last_undegraded":"2024-09-12T00:21:17.611972+0000","last_fullsized":"2024-09-12T00:21:17.611972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.922836+0000","last_change":"2024-09-12T00:23:14.922836+0000","last_active":"2024-09-12T00:23:14.922836+0000","last_peered":"2024-09-12T00:23:14.922836+0000","last_clean":"2024-09-12T00:23:14.922836+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:23:14.922836+0000","last_undegraded":"2024-09-12T00:23:14.922836+0000","last_fullsized":"2024-09-12T00:23:14.922836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.922649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:06.834122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.385967+0000","last_change":"2024-09-12T00:22:42.385967+0000","last_active":"2024-09-12T00:22:42.385967+0000","last_peered":"2024-09-12T00:22:42.385967+0000","last_clean":"2024-09-12T00:22:42.385967+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:22:42.385967+0000","last_undegraded":"2024-09-12T00:22:42.385967+0000","last_fullsized":"2024-09-12T00:22:42.385967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.385774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:36.864966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.762434+0000","last_change":"2024-09-12T00:23:10.762434+0000","last_active":"2024-09-12T00:23:10.762434+0000","last_peered":"2024-09-12T00:23:10.762434+0000","last_clean":"2024-09-12T00:23:10.762434+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:23:10.762434+0000","last_undegraded":"2024-09-12T00:23:10.762434+0000","last_fullsized":"2024-09-12T00:23:10.762434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.762259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:08.326149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.850131+0000","last_change":"2024-09-12T00:23:11.850131+0000","last_active":"2024-09-12T00:23:11.850131+0000","last_peered":"2024-09-12T00:23:11.850131+0000","last_clean":"2024-09-12T00:23:11.850131+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:23:11.850131+0000","last_undegraded":"2024-09-12T00:23:11.850131+0000","last_fullsized":"2024-09-12T00:23:11.850131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.849946+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.522162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.733709+0000","last_change":"2024-09-12T00:23:30.733709+0000","last_active":"2024-09-12T00:23:30.733709+0000","last_peered":"2024-09-12T00:23:30.733709+0000","last_clean":"2024-09-12T00:23:30.733709+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:23:30.733709+0000","last_undegraded":"2024-09-12T00:23:30.733709+0000","last_fullsized":"2024-09-12T00:23:30.733709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.733523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:25.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.611925+0000","last_change":"2024-09-12T00:18:54.276132+0000","last_active":"2024-09-12T00:21:17.611925+0000","last_peered":"2024-09-12T00:21:17.611925+0000","last_clean":"2024-09-12T00:21:17.611925+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:21:17.611925+0000","last_undegraded":"2024-09-12T00:21:17.611925+0000","last_fullsized":"2024-09-12T00:21:17.611925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.936957+0000","last_change":"2024-09-12T00:22:55.936957+0000","last_active":"2024-09-12T00:22:55.936957+0000","last_peered":"2024-09-12T00:22:55.936957+0000","last_clean":"2024-09-12T00:22:55.936957+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:55.936957+0000","last_undegraded":"2024-09-12T00:22:55.936957+0000","last_fullsized":"2024-09-12T00:22:55.936957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.936751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.262382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.067458+0000","last_change":"2024-09-12T00:22:54.067458+0000","last_active":"2024-09-12T00:22:54.067458+0000","last_peered":"2024-09-12T00:22:54.067458+0000","last_clean":"2024-09-12T00:22:54.067458+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:22:54.067458+0000","last_undegraded":"2024-09-12T00:22:54.067458+0000","last_fullsized":"2024-09-12T00:22:54.067458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.067268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:29.961955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.295563+0000","last_change":"2024-09-12T00:23:18.295563+0000","last_active":"2024-09-12T00:23:18.295563+0000","last_peered":"2024-09-12T00:23:18.295563+0000","last_clean":"2024-09-12T00:23:18.295563+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:23:18.295563+0000","last_undegraded":"2024-09-12T00:23:18.295563+0000","last_fullsized":"2024-09-12T00:23:18.295563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.295354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:33.445325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:20:52.605672+0000","last_change":"2024-09-12T00:18:50.244705+0000","last_active":"2024-09-12T00:20:52.605672+0000","last_peered":"2024-09-12T00:20:52.605672+0000","last_clean":"2024-09-12T00:20:52.605672+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:20:52.605672+0000","last_undegraded":"2024-09-12T00:20:52.605672+0000","last_fullsized":"2024-09-12T00:20:52.605672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'286","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.742825+0000","last_change":"2024-09-12T00:23:24.742825+0000","last_active":"2024-09-12T00:23:24.742825+0000","last_peered":"2024-09-12T00:23:24.742825+0000","last_clean":"2024-09-12T00:23:24.742825+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:23:24.742825+0000","last_undegraded":"2024-09-12T00:23:24.742825+0000","last_fullsized":"2024-09-12T00:23:24.742825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.742581+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:14.118995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.611789+0000","last_change":"2024-09-12T00:18:54.267577+0000","last_active":"2024-09-12T00:21:17.611789+0000","last_peered":"2024-09-12T00:21:17.611789+0000","last_clean":"2024-09-12T00:21:17.611789+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:21:17.611789+0000","last_undegraded":"2024-09-12T00:21:17.611789+0000","last_fullsized":"2024-09-12T00:21:17.611789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.691998+0000","last_change":"2024-09-12T00:23:01.691998+0000","last_active":"2024-09-12T00:23:01.691998+0000","last_peered":"2024-09-12T00:23:01.691998+0000","last_clean":"2024-09-12T00:23:01.691998+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:23:01.691998+0000","last_undegraded":"2024-09-12T00:23:01.691998+0000","last_fullsized":"2024-09-12T00:23:01.691998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.691825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.900305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.393154+0000","last_change":"2024-09-12T00:22:43.393154+0000","last_active":"2024-09-12T00:22:43.393154+0000","last_peered":"2024-09-12T00:22:43.393154+0000","last_clean":"2024-09-12T00:22:43.393154+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:22:43.393154+0000","last_undegraded":"2024-09-12T00:22:43.393154+0000","last_fullsized":"2024-09-12T00:22:43.393154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.392968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:10.459069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.294939+0000","last_change":"2024-09-12T00:23:17.294939+0000","last_active":"2024-09-12T00:23:17.294939+0000","last_peered":"2024-09-12T00:23:17.294939+0000","last_clean":"2024-09-12T00:23:17.294939+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:23:17.294939+0000","last_undegraded":"2024-09-12T00:23:17.294939+0000","last_fullsized":"2024-09-12T00:23:17.294939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.294701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.708016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'77","reported_seq":159,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.149463+0000","last_change":"2024-09-12T00:23:24.149463+0000","last_active":"2024-09-12T00:23:24.149463+0000","last_peered":"2024-09-12T00:23:24.149463+0000","last_clean":"2024-09-12T00:23:24.149463+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:23:24.149463+0000","last_undegraded":"2024-09-12T00:23:24.149463+0000","last_fullsized":"2024-09-12T00:23:24.149463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'77","last_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_deep_scrub":"33'77","last_deep_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.149240+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:59.010159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.735232+0000","last_change":"2024-09-12T00:23:26.735232+0000","last_active":"2024-09-12T00:23:26.735232+0000","last_peered":"2024-09-12T00:23:26.735232+0000","last_clean":"2024-09-12T00:23:26.735232+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:23:26.735232+0000","last_undegraded":"2024-09-12T00:23:26.735232+0000","last_fullsized":"2024-09-12T00:23:26.735232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.735014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:59.610604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.277960+0000","last_change":"2024-09-12T00:23:36.277960+0000","last_active":"2024-09-12T00:23:36.277960+0000","last_peered":"2024-09-12T00:23:36.277960+0000","last_clean":"2024-09-12T00:23:36.277960+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:23:36.277960+0000","last_undegraded":"2024-09-12T00:23:36.277960+0000","last_fullsized":"2024-09-12T00:23:36.277960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.277772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:33.069312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.686548+0000","last_change":"2024-09-12T00:23:00.686548+0000","last_active":"2024-09-12T00:23:00.686548+0000","last_peered":"2024-09-12T00:23:00.686548+0000","last_clean":"2024-09-12T00:23:00.686548+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:23:00.686548+0000","last_undegraded":"2024-09-12T00:23:00.686548+0000","last_fullsized":"2024-09-12T00:23:00.686548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.686366+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:12.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.088790+0000","last_change":"2024-09-12T00:22:55.088790+0000","last_active":"2024-09-12T00:22:55.088790+0000","last_peered":"2024-09-12T00:22:55.088790+0000","last_clean":"2024-09-12T00:22:55.088790+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:55.088790+0000","last_undegraded":"2024-09-12T00:22:55.088790+0000","last_fullsized":"2024-09-12T00:22:55.088790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.088613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:30.497345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.719313+0000","last_change":"2024-09-12T00:23:09.719313+0000","last_active":"2024-09-12T00:23:09.719313+0000","last_peered":"2024-09-12T00:23:09.719313+0000","last_clean":"2024-09-12T00:23:09.719313+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:23:09.719313+0000","last_undegraded":"2024-09-12T00:23:09.719313+0000","last_fullsized":"2024-09-12T00:23:09.719313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.719094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.163316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'45","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.713647+0000","last_change":"2024-09-12T00:23:22.713647+0000","last_active":"2024-09-12T00:23:22.713647+0000","last_peered":"2024-09-12T00:23:22.713647+0000","last_clean":"2024-09-12T00:23:22.713647+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:23:22.713647+0000","last_undegraded":"2024-09-12T00:23:22.713647+0000","last_fullsized":"2024-09-12T00:23:22.713647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.713460+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:57.574379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.274144+0000","last_change":"2024-09-12T00:18:52.261602+0000","last_active":"2024-09-12T00:19:24.274144+0000","last_peered":"2024-09-12T00:19:24.274144+0000","last_clean":"2024-09-12T00:19:24.274144+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:19:24.274144+0000","last_undegraded":"2024-09-12T00:19:24.274144+0000","last_fullsized":"2024-09-12T00:19:24.274144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:51.342101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:30.991264+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:19:30.991264+0000","last_peered":"2024-09-12T00:19:30.991264+0000","last_clean":"2024-09-12T00:19:30.991264+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:19:30.991264+0000","last_undegraded":"2024-09-12T00:19:30.991264+0000","last_fullsized":"2024-09-12T00:19:30.991264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.780418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.976506+0000","last_change":"2024-09-12T00:23:11.976316+0000","last_active":"2024-09-12T00:23:11.976506+0000","last_peered":"2024-09-12T00:23:11.976506+0000","last_clean":"2024-09-12T00:23:11.976506+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:23:11.976506+0000","last_undegraded":"2024-09-12T00:23:11.976506+0000","last_fullsized":"2024-09-12T00:23:11.976506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.976131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:32.650876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.782465+0000","last_change":"2024-09-12T00:22:40.782298+0000","last_active":"2024-09-12T00:22:40.782465+0000","last_peered":"2024-09-12T00:22:40.782465+0000","last_clean":"2024-09-12T00:22:40.782465+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:22:40.782465+0000","last_undegraded":"2024-09-12T00:22:40.782465+0000","last_fullsized":"2024-09-12T00:22:40.782465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.782108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.669423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.332073+0000","last_change":"2024-09-12T00:23:15.331937+0000","last_active":"2024-09-12T00:23:15.332073+0000","last_peered":"2024-09-12T00:23:15.332073+0000","last_clean":"2024-09-12T00:23:15.332073+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:23:15.332073+0000","last_undegraded":"2024-09-12T00:23:15.332073+0000","last_fullsized":"2024-09-12T00:23:15.332073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.331763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:20.472102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'35","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.360679+0000","last_change":"2024-09-12T00:18:50.230976+0000","last_active":"2024-09-12T00:22:33.360679+0000","last_peered":"2024-09-12T00:22:33.360679+0000","last_clean":"2024-09-12T00:22:33.360679+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:22:33.360679+0000","last_undegraded":"2024-09-12T00:22:33.360679+0000","last_fullsized":"2024-09-12T00:22:33.360679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:16.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:19:24.290262+0000","last_change":"2024-09-12T00:18:52.249235+0000","last_active":"2024-09-12T00:19:24.290262+0000","last_peered":"2024-09-12T00:19:24.290262+0000","last_clean":"2024-09-12T00:19:24.290262+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:19:24.290262+0000","last_undegraded":"2024-09-12T00:19:24.290262+0000","last_fullsized":"2024-09-12T00:19:24.290262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:51.199702+0000","last_clean_scrub_stamp":"2024-09-12T00:18:51.199702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:45.536456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.052802+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.052802+0000","last_peered":"2024-09-12T00:22:01.052802+0000","last_clean":"2024-09-12T00:22:01.052802+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.052802+0000","last_undegraded":"2024-09-12T00:22:01.052802+0000","last_fullsized":"2024-09-12T00:22:01.052802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:18.064265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.718868+0000","last_change":"2024-09-12T00:22:59.718700+0000","last_active":"2024-09-12T00:22:59.718868+0000","last_peered":"2024-09-12T00:22:59.718868+0000","last_clean":"2024-09-12T00:22:59.718868+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:59.718868+0000","last_undegraded":"2024-09-12T00:22:59.718868+0000","last_fullsized":"2024-09-12T00:22:59.718868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.718519+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:09.605835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.419905+0000","last_change":"2024-09-12T00:22:44.419775+0000","last_active":"2024-09-12T00:22:44.419905+0000","last_peered":"2024-09-12T00:22:44.419905+0000","last_clean":"2024-09-12T00:22:44.419905+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:22:44.419905+0000","last_undegraded":"2024-09-12T00:22:44.419905+0000","last_fullsized":"2024-09-12T00:22:44.419905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.419592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:33.207405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.321004+0000","last_change":"2024-09-12T00:23:16.320735+0000","last_active":"2024-09-12T00:23:16.321004+0000","last_peered":"2024-09-12T00:23:16.321004+0000","last_clean":"2024-09-12T00:23:16.321004+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:23:16.321004+0000","last_undegraded":"2024-09-12T00:23:16.321004+0000","last_fullsized":"2024-09-12T00:23:16.321004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.320511+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:44.404081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'47","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:33.378393+0000","last_change":"2024-09-12T00:18:50.226782+0000","last_active":"2024-09-12T00:22:33.378393+0000","last_peered":"2024-09-12T00:22:33.378393+0000","last_clean":"2024-09-12T00:22:33.378393+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:22:33.378393+0000","last_undegraded":"2024-09-12T00:22:33.378393+0000","last_fullsized":"2024-09-12T00:22:33.378393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:49.186617+0000","last_clean_scrub_stamp":"2024-09-12T00:18:49.186617+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.004752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.716235+0000","last_change":"2024-09-12T00:23:27.716235+0000","last_active":"2024-09-12T00:23:27.716235+0000","last_peered":"2024-09-12T00:23:27.716235+0000","last_clean":"2024-09-12T00:23:27.716235+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:23:27.716235+0000","last_undegraded":"2024-09-12T00:23:27.716235+0000","last_fullsized":"2024-09-12T00:23:27.716235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.716028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:24.562308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.612115+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:21:17.612115+0000","last_peered":"2024-09-12T00:21:17.612115+0000","last_clean":"2024-09-12T00:21:17.612115+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:21:17.612115+0000","last_undegraded":"2024-09-12T00:21:17.612115+0000","last_fullsized":"2024-09-12T00:21:17.612115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.364318+0000","last_change":"2024-09-12T00:22:56.364160+0000","last_active":"2024-09-12T00:22:56.364318+0000","last_peered":"2024-09-12T00:22:56.364318+0000","last_clean":"2024-09-12T00:22:56.364318+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:22:56.364318+0000","last_undegraded":"2024-09-12T00:22:56.364318+0000","last_fullsized":"2024-09-12T00:22:56.364318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.363976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.256275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.797911+0000","last_change":"2024-09-12T00:22:45.797737+0000","last_active":"2024-09-12T00:22:45.797911+0000","last_peered":"2024-09-12T00:22:45.797911+0000","last_clean":"2024-09-12T00:22:45.797911+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:22:45.797911+0000","last_undegraded":"2024-09-12T00:22:45.797911+0000","last_fullsized":"2024-09-12T00:22:45.797911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.797484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:00.294956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.808574+0000","last_change":"2024-09-12T00:23:07.808574+0000","last_active":"2024-09-12T00:23:07.808574+0000","last_peered":"2024-09-12T00:23:07.808574+0000","last_clean":"2024-09-12T00:23:07.808574+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:23:07.808574+0000","last_undegraded":"2024-09-12T00:23:07.808574+0000","last_fullsized":"2024-09-12T00:23:07.808574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.808393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.826760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.857883+0000","last_change":"2024-09-12T00:22:44.857717+0000","last_active":"2024-09-12T00:22:44.857883+0000","last_peered":"2024-09-12T00:22:44.857883+0000","last_clean":"2024-09-12T00:22:44.857883+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:22:44.857883+0000","last_undegraded":"2024-09-12T00:22:44.857883+0000","last_fullsized":"2024-09-12T00:22:44.857883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.857528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:34.268174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.885038+0000","last_change":"2024-09-12T00:23:16.885038+0000","last_active":"2024-09-12T00:23:16.885038+0000","last_peered":"2024-09-12T00:23:16.885038+0000","last_clean":"2024-09-12T00:23:16.885038+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:23:16.885038+0000","last_undegraded":"2024-09-12T00:23:16.885038+0000","last_fullsized":"2024-09-12T00:23:16.885038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.884827+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.406267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.064313+0000","last_change":"2024-09-12T00:22:56.064142+0000","last_active":"2024-09-12T00:22:56.064313+0000","last_peered":"2024-09-12T00:22:56.064313+0000","last_clean":"2024-09-12T00:22:56.064313+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:22:56.064313+0000","last_undegraded":"2024-09-12T00:22:56.064313+0000","last_fullsized":"2024-09-12T00:22:56.064313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.063956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.325584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.875973+0000","last_change":"2024-09-12T00:23:02.875774+0000","last_active":"2024-09-12T00:23:02.875973+0000","last_peered":"2024-09-12T00:23:02.875973+0000","last_clean":"2024-09-12T00:23:02.875973+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:23:02.875973+0000","last_undegraded":"2024-09-12T00:23:02.875973+0000","last_fullsized":"2024-09-12T00:23:02.875973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.875589+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.470261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.951519+0000","last_change":"2024-09-12T00:22:51.951351+0000","last_active":"2024-09-12T00:22:51.951519+0000","last_peered":"2024-09-12T00:22:51.951519+0000","last_clean":"2024-09-12T00:22:51.951519+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:22:51.951519+0000","last_undegraded":"2024-09-12T00:22:51.951519+0000","last_fullsized":"2024-09-12T00:22:51.951519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.951154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:49.515044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.882172+0000","last_change":"2024-09-12T00:22:58.882172+0000","last_active":"2024-09-12T00:22:58.882172+0000","last_peered":"2024-09-12T00:22:58.882172+0000","last_clean":"2024-09-12T00:22:58.882172+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:58.882172+0000","last_undegraded":"2024-09-12T00:22:58.882172+0000","last_fullsized":"2024-09-12T00:22:58.882172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.881909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:59.881831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.860676+0000","last_change":"2024-09-12T00:22:47.860535+0000","last_active":"2024-09-12T00:22:47.860676+0000","last_peered":"2024-09-12T00:22:47.860676+0000","last_clean":"2024-09-12T00:22:47.860676+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:22:47.860676+0000","last_undegraded":"2024-09-12T00:22:47.860676+0000","last_fullsized":"2024-09-12T00:22:47.860676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.860353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.356404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.351486+0000","last_change":"2024-09-12T00:22:57.351196+0000","last_active":"2024-09-12T00:22:57.351486+0000","last_peered":"2024-09-12T00:22:57.351486+0000","last_clean":"2024-09-12T00:22:57.351486+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:57.351486+0000","last_undegraded":"2024-09-12T00:22:57.351486+0000","last_fullsized":"2024-09-12T00:22:57.351486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.350978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:29.676609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.419200+0000","last_change":"2024-09-12T00:22:45.418904+0000","last_active":"2024-09-12T00:22:45.419200+0000","last_peered":"2024-09-12T00:22:45.419200+0000","last_clean":"2024-09-12T00:22:45.419200+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:22:45.419200+0000","last_undegraded":"2024-09-12T00:22:45.419200+0000","last_fullsized":"2024-09-12T00:22:45.419200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.418677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:28.543265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.889052+0000","last_change":"2024-09-12T00:23:01.889052+0000","last_active":"2024-09-12T00:23:01.889052+0000","last_peered":"2024-09-12T00:23:01.889052+0000","last_clean":"2024-09-12T00:23:01.889052+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:23:01.889052+0000","last_undegraded":"2024-09-12T00:23:01.889052+0000","last_fullsized":"2024-09-12T00:23:01.889052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.888826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:23.218572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.761030+0000","last_change":"2024-09-12T00:22:46.760728+0000","last_active":"2024-09-12T00:22:46.761030+0000","last_peered":"2024-09-12T00:22:46.761030+0000","last_clean":"2024-09-12T00:22:46.761030+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:22:46.761030+0000","last_undegraded":"2024-09-12T00:22:46.761030+0000","last_fullsized":"2024-09-12T00:22:46.761030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.760505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:03.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.411438+0000","last_change":"2024-09-12T00:22:55.411268+0000","last_active":"2024-09-12T00:22:55.411438+0000","last_peered":"2024-09-12T00:22:55.411438+0000","last_clean":"2024-09-12T00:22:55.411438+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:55.411438+0000","last_undegraded":"2024-09-12T00:22:55.411438+0000","last_fullsized":"2024-09-12T00:22:55.411438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.411085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.955659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.837988+0000","last_change":"2024-09-12T00:22:43.837801+0000","last_active":"2024-09-12T00:22:43.837988+0000","last_peered":"2024-09-12T00:22:43.837988+0000","last_clean":"2024-09-12T00:22:43.837988+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:22:43.837988+0000","last_undegraded":"2024-09-12T00:22:43.837988+0000","last_fullsized":"2024-09-12T00:22:43.837988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.837619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:26.962207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.433588+0000","last_change":"2024-09-12T00:23:04.433443+0000","last_active":"2024-09-12T00:23:04.433588+0000","last_peered":"2024-09-12T00:23:04.433588+0000","last_clean":"2024-09-12T00:23:04.433588+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:23:04.433588+0000","last_undegraded":"2024-09-12T00:23:04.433588+0000","last_fullsized":"2024-09-12T00:23:04.433588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.433267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:39.027939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.127791+0000","last_change":"2024-09-12T00:22:58.127664+0000","last_active":"2024-09-12T00:22:58.127791+0000","last_peered":"2024-09-12T00:22:58.127791+0000","last_clean":"2024-09-12T00:22:58.127791+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:22:58.127791+0000","last_undegraded":"2024-09-12T00:22:58.127791+0000","last_fullsized":"2024-09-12T00:22:58.127791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.127465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.328805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.895060+0000","last_change":"2024-09-12T00:23:18.894878+0000","last_active":"2024-09-12T00:23:18.895060+0000","last_peered":"2024-09-12T00:23:18.895060+0000","last_clean":"2024-09-12T00:23:18.895060+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:23:18.895060+0000","last_undegraded":"2024-09-12T00:23:18.895060+0000","last_fullsized":"2024-09-12T00:23:18.895060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.894667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.737541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.829130+0000","last_change":"2024-09-12T00:22:45.828950+0000","last_active":"2024-09-12T00:22:45.829130+0000","last_peered":"2024-09-12T00:22:45.829130+0000","last_clean":"2024-09-12T00:22:45.829130+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:22:45.829130+0000","last_undegraded":"2024-09-12T00:22:45.829130+0000","last_fullsized":"2024-09-12T00:22:45.829130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.828769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.446702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.843813+0000","last_change":"2024-09-12T00:22:57.843671+0000","last_active":"2024-09-12T00:22:57.843813+0000","last_peered":"2024-09-12T00:22:57.843813+0000","last_clean":"2024-09-12T00:22:57.843813+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:22:57.843813+0000","last_undegraded":"2024-09-12T00:22:57.843813+0000","last_fullsized":"2024-09-12T00:22:57.843813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.843490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:06.187761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.388924+0000","last_change":"2024-09-12T00:22:46.388768+0000","last_active":"2024-09-12T00:22:46.388924+0000","last_peered":"2024-09-12T00:22:46.388924+0000","last_clean":"2024-09-12T00:22:46.388924+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:22:46.388924+0000","last_undegraded":"2024-09-12T00:22:46.388924+0000","last_fullsized":"2024-09-12T00:22:46.388924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.388580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:18.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.374312+0000","last_change":"2024-09-12T00:23:01.374170+0000","last_active":"2024-09-12T00:23:01.374312+0000","last_peered":"2024-09-12T00:23:01.374312+0000","last_clean":"2024-09-12T00:23:01.374312+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:23:01.374312+0000","last_undegraded":"2024-09-12T00:23:01.374312+0000","last_fullsized":"2024-09-12T00:23:01.374312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.373987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:05.846953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.405470+0000","last_change":"2024-09-12T00:22:47.405301+0000","last_active":"2024-09-12T00:22:47.405470+0000","last_peered":"2024-09-12T00:22:47.405470+0000","last_clean":"2024-09-12T00:22:47.405470+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:22:47.405470+0000","last_undegraded":"2024-09-12T00:22:47.405470+0000","last_fullsized":"2024-09-12T00:22:47.405470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.405108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:56.440895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.408318+0000","last_change":"2024-09-12T00:22:59.408156+0000","last_active":"2024-09-12T00:22:59.408318+0000","last_peered":"2024-09-12T00:22:59.408318+0000","last_clean":"2024-09-12T00:22:59.408318+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:59.408318+0000","last_undegraded":"2024-09-12T00:22:59.408318+0000","last_fullsized":"2024-09-12T00:22:59.408318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.407970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.085566+0000","last_change":"2024-09-12T00:22:57.085427+0000","last_active":"2024-09-12T00:22:57.085566+0000","last_peered":"2024-09-12T00:22:57.085566+0000","last_clean":"2024-09-12T00:22:57.085566+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:22:57.085566+0000","last_undegraded":"2024-09-12T00:22:57.085566+0000","last_fullsized":"2024-09-12T00:22:57.085566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.085239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.771180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.421285+0000","last_change":"2024-09-12T00:23:02.421145+0000","last_active":"2024-09-12T00:23:02.421285+0000","last_peered":"2024-09-12T00:23:02.421285+0000","last_clean":"2024-09-12T00:23:02.421285+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:23:02.421285+0000","last_undegraded":"2024-09-12T00:23:02.421285+0000","last_fullsized":"2024-09-12T00:23:02.421285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.420954+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:36.359342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.165740+0000","last_change":"2024-09-12T00:22:59.165563+0000","last_active":"2024-09-12T00:22:59.165740+0000","last_peered":"2024-09-12T00:22:59.165740+0000","last_clean":"2024-09-12T00:22:59.165740+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:22:59.165740+0000","last_undegraded":"2024-09-12T00:22:59.165740+0000","last_fullsized":"2024-09-12T00:22:59.165740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.165334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:16.298385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.857582+0000","last_change":"2024-09-12T00:23:17.857582+0000","last_active":"2024-09-12T00:23:17.857582+0000","last_peered":"2024-09-12T00:23:17.857582+0000","last_clean":"2024-09-12T00:23:17.857582+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:23:17.857582+0000","last_undegraded":"2024-09-12T00:23:17.857582+0000","last_fullsized":"2024-09-12T00:23:17.857582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.857414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:48.868003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.779705+0000","last_change":"2024-09-12T00:22:47.779560+0000","last_active":"2024-09-12T00:22:47.779705+0000","last_peered":"2024-09-12T00:22:47.779705+0000","last_clean":"2024-09-12T00:22:47.779705+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:22:47.779705+0000","last_undegraded":"2024-09-12T00:22:47.779705+0000","last_fullsized":"2024-09-12T00:22:47.779705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.779379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.921779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.368579+0000","last_change":"2024-09-12T00:23:00.368297+0000","last_active":"2024-09-12T00:23:00.368579+0000","last_peered":"2024-09-12T00:23:00.368579+0000","last_clean":"2024-09-12T00:23:00.368579+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:23:00.368579+0000","last_undegraded":"2024-09-12T00:23:00.368579+0000","last_fullsized":"2024-09-12T00:23:00.368579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.368084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:01.368006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.123443+0000","last_change":"2024-09-12T00:23:00.123271+0000","last_active":"2024-09-12T00:23:00.123443+0000","last_peered":"2024-09-12T00:23:00.123443+0000","last_clean":"2024-09-12T00:23:00.123443+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:23:00.123443+0000","last_undegraded":"2024-09-12T00:23:00.123443+0000","last_fullsized":"2024-09-12T00:23:00.123443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.123089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:30.766748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.162155+0000","last_change":"2024-09-12T00:23:01.161909+0000","last_active":"2024-09-12T00:23:01.162155+0000","last_peered":"2024-09-12T00:23:01.162155+0000","last_clean":"2024-09-12T00:23:01.162155+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:23:01.162155+0000","last_undegraded":"2024-09-12T00:23:01.162155+0000","last_fullsized":"2024-09-12T00:23:01.162155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.161644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:33.787276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.851646+0000","last_change":"2024-09-12T00:23:00.851387+0000","last_active":"2024-09-12T00:23:00.851646+0000","last_peered":"2024-09-12T00:23:00.851646+0000","last_clean":"2024-09-12T00:23:00.851646+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:23:00.851646+0000","last_undegraded":"2024-09-12T00:23:00.851646+0000","last_fullsized":"2024-09-12T00:23:00.851646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.851152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:34.789540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.888144+0000","last_change":"2024-09-12T00:22:49.887896+0000","last_active":"2024-09-12T00:22:49.888144+0000","last_peered":"2024-09-12T00:22:49.888144+0000","last_clean":"2024-09-12T00:22:49.888144+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:22:49.888144+0000","last_undegraded":"2024-09-12T00:22:49.888144+0000","last_fullsized":"2024-09-12T00:22:49.888144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.887620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.362152+0000","last_change":"2024-09-12T00:23:07.361953+0000","last_active":"2024-09-12T00:23:07.362152+0000","last_peered":"2024-09-12T00:23:07.362152+0000","last_clean":"2024-09-12T00:23:07.362152+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:23:07.362152+0000","last_undegraded":"2024-09-12T00:23:07.362152+0000","last_fullsized":"2024-09-12T00:23:07.362152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.361766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:56.738180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1734,"ondisk_log_size":1734,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705729,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":150916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":737144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":737488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":149912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:23:39.752 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.752 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.752 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.753 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.753 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.753 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.753 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.753 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.754 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.754 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.754 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.754 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.755 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.755 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.755 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.755 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.756 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:51.199702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.757 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:49.186617+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.758 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:23:39.758 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:23:59.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:23:59.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76f54c0640 1 Processor -- start 2024-09-12T00:23:59.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76f54c0640 1 -- start start 2024-09-12T00:23:59.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76f54c0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76f0111890 0x7f76f0132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:59.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76f54c0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f0073a90 con 0x7f76f0110da0 2024-09-12T00:23:59.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76f54c0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f76f00696e0 con 0x7f76f0111890 2024-09-12T00:23:59.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76e7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76f0111890 0x7f76f0132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:59.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76eeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f76f0110da0 0x7f76f0111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46004/0 (socket says 172.21.15.31:46004) 2024-09-12T00:23:59.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76eeffd640 1 -- 172.21.15.31:0/2754637726 learned_addr learned my addr 172.21.15.31:0/2754637726 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:23:59.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76e7fff640 1 -- 172.21.15.31:0/2754637726 >> v1:172.21.15.31:6789/0 conn(0x7f76f0110da0 legacy=0x7f76f0111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:59.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76e7fff640 1 -- 172.21.15.31:0/2754637726 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f006dd50 con 0x7f76f0111890 2024-09-12T00:23:59.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.891+0000 7f76e7fff640 1 --2- 172.21.15.31:0/2754637726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0111890 0x7f76f0132450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009740 tx=0x7f76e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e78170f42aa713 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:59.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76ee7fc640 1 -- 172.21.15.31:0/2754637726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e00b0070 con 0x7f76f0111890 2024-09-12T00:23:59.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76ee7fc640 1 -- 172.21.15.31:0/2754637726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e00ab530 con 0x7f76f0111890 2024-09-12T00:23:59.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76ee7fc640 1 -- 172.21.15.31:0/2754637726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76e00ab830 con 0x7f76f0111890 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- 172.21.15.31:0/2754637726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0111890 msgr2=0x7f76f0132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2754637726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0111890 0x7f76f0132450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009740 tx=0x7f76e001c370 comp rx=0 tx=0).stop 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- 172.21.15.31:0/2754637726 shutdown_connections 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2754637726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0111890 0x7f76f0132450 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- 172.21.15.31:0/2754637726 >> 172.21.15.31:0/2754637726 conn(0x7f76f0070900 msgr2=0x7f76f0072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- 172.21.15.31:0/2754637726 shutdown_connections 2024-09-12T00:23:59.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- 172.21.15.31:0/2754637726 wait complete. 2024-09-12T00:23:59.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 Processor -- start 2024-09-12T00:23:59.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- start start 2024-09-12T00:23:59.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:59.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76f54c0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0135330 con 0x7f76f0110da0 2024-09-12T00:23:59.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76eeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:59.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76eeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38242/0 (socket says 172.21.15.31:38242) 2024-09-12T00:23:59.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76eeffd640 1 -- 172.21.15.31:0/2922406099 learned_addr learned my addr 172.21.15.31:0/2922406099 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76eeffd640 1 -- 172.21.15.31:0/2922406099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f012f930 con 0x7f76f0110da0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76eeffd640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c450 tx=0x7f76d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.895+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d8017070 con 0x7f76f0110da0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8005c20 con 0x7f76f0110da0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f012fbe0 con 0x7f76f0110da0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76d80070d0 con 0x7f76f0110da0 2024-09-12T00:23:59.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f0122dc0 con 0x7f76f0110da0 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76d801a070 con 0x7f76f0110da0 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f0111180 con 0x7f76f0110da0 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e77fe640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 0x7f76d003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f76d804eba0 con 0x7f76f0110da0 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e7fff640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 0x7f76d003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:23:59.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.899+0000 7f76e7fff640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 0x7f76d003d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ad000 tx=0x7f76e00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:23:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:23:59.903+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f76d8019cd0 con 0x7f76f0110da0 2024-09-12T00:24:00.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.071+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76f0127610 con 0x7f76d003b1d0 2024-09-12T00:24:00.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.099+0000 7f76e77fe640 1 -- 172.21.15.31:0/2922406099 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666002 (secure 0 0 0) 0x7f76e00ab500 con 0x7f76d003b1d0 2024-09-12T00:24:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:24:00.114 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 msgr2=0x7f76d003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 0x7f76d003d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76e00ad000 tx=0x7f76e00a6000 comp rx=0 tx=0).stop 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 msgr2=0x7f76f01226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f76d800c450 tx=0x7f76d800c910 comp rx=0 tx=0).stop 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 shutdown_connections 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f76d003b1d0 0x7f76d003d690 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 --2- 172.21.15.31:0/2922406099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f0110da0 0x7f76f01226b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 >> 172.21.15.31:0/2922406099 conn(0x7f76f0070900 msgr2=0x7f76f012ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 shutdown_connections 2024-09-12T00:24:00.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:00.107+0000 7f76f54c0640 1 -- 172.21.15.31:0/2922406099 wait complete. 2024-09-12T00:24:00.125 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-12T00:23:58.661884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5401,"num_read_kb":4955,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5016,"ondisk_log_size":5016,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165056,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322304,"statfs":{"total":386547056640,"available":386378039296,"internally_reserved":0,"allocated":2949120,"data_stored":1775460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":165996313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006330"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.776360+0000","last_change":"2024-09-12T00:22:51.776190+0000","last_active":"2024-09-12T00:22:51.776360+0000","last_peered":"2024-09-12T00:22:51.776360+0000","last_clean":"2024-09-12T00:22:51.776360+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:22:51.776360+0000","last_undegraded":"2024-09-12T00:22:51.776360+0000","last_fullsized":"2024-09-12T00:22:51.776360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.776007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.205681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.318733+0000","last_change":"2024-09-12T00:23:08.318599+0000","last_active":"2024-09-12T00:23:08.318733+0000","last_peered":"2024-09-12T00:23:08.318733+0000","last_clean":"2024-09-12T00:23:08.318733+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:23:08.318733+0000","last_undegraded":"2024-09-12T00:23:08.318733+0000","last_fullsized":"2024-09-12T00:23:08.318733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.318428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:11.398771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.963190+0000","last_change":"2024-09-12T00:22:53.963022+0000","last_active":"2024-09-12T00:22:53.963190+0000","last_peered":"2024-09-12T00:22:53.963190+0000","last_clean":"2024-09-12T00:22:53.963190+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:22:53.963190+0000","last_undegraded":"2024-09-12T00:22:53.963190+0000","last_fullsized":"2024-09-12T00:22:53.963190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.962810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:20.507384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.886927+0000","last_change":"2024-09-12T00:23:20.886670+0000","last_active":"2024-09-12T00:23:20.886927+0000","last_peered":"2024-09-12T00:23:20.886927+0000","last_clean":"2024-09-12T00:23:20.886927+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:23:20.886927+0000","last_undegraded":"2024-09-12T00:23:20.886927+0000","last_fullsized":"2024-09-12T00:23:20.886927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.886463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:38.609500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.128441+0000","last_change":"2024-09-12T00:23:06.128441+0000","last_active":"2024-09-12T00:23:06.128441+0000","last_peered":"2024-09-12T00:23:06.128441+0000","last_clean":"2024-09-12T00:23:06.128441+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:23:06.128441+0000","last_undegraded":"2024-09-12T00:23:06.128441+0000","last_fullsized":"2024-09-12T00:23:06.128441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.128258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.765425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.868976+0000","last_change":"2024-09-12T00:23:21.868830+0000","last_active":"2024-09-12T00:23:21.868976+0000","last_peered":"2024-09-12T00:23:21.868976+0000","last_clean":"2024-09-12T00:23:21.868976+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:23:21.868976+0000","last_undegraded":"2024-09-12T00:23:21.868976+0000","last_fullsized":"2024-09-12T00:23:21.868976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.868648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:48.574200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.765815+0000","last_change":"2024-09-12T00:22:50.765815+0000","last_active":"2024-09-12T00:22:50.765815+0000","last_peered":"2024-09-12T00:22:50.765815+0000","last_clean":"2024-09-12T00:22:50.765815+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:50.765815+0000","last_undegraded":"2024-09-12T00:22:50.765815+0000","last_fullsized":"2024-09-12T00:22:50.765815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.765631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:43.898814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.859098+0000","last_change":"2024-09-12T00:23:23.858938+0000","last_active":"2024-09-12T00:23:23.859098+0000","last_peered":"2024-09-12T00:23:23.859098+0000","last_clean":"2024-09-12T00:23:23.859098+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:23:23.859098+0000","last_undegraded":"2024-09-12T00:23:23.859098+0000","last_fullsized":"2024-09-12T00:23:23.859098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.858738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:32.992380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.118092+0000","last_change":"2024-09-12T00:23:04.117840+0000","last_active":"2024-09-12T00:23:04.118092+0000","last_peered":"2024-09-12T00:23:04.118092+0000","last_clean":"2024-09-12T00:23:04.118092+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:23:04.118092+0000","last_undegraded":"2024-09-12T00:23:04.118092+0000","last_fullsized":"2024-09-12T00:23:04.118092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.117631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.338073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.365803+0000","last_change":"2024-09-12T00:23:09.365803+0000","last_active":"2024-09-12T00:23:09.365803+0000","last_peered":"2024-09-12T00:23:09.365803+0000","last_clean":"2024-09-12T00:23:09.365803+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:23:09.365803+0000","last_undegraded":"2024-09-12T00:23:09.365803+0000","last_fullsized":"2024-09-12T00:23:09.365803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.365625+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:02.383992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.751844+0000","last_change":"2024-09-12T00:22:49.751719+0000","last_active":"2024-09-12T00:22:49.751844+0000","last_peered":"2024-09-12T00:22:49.751844+0000","last_clean":"2024-09-12T00:22:49.751844+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:22:49.751844+0000","last_undegraded":"2024-09-12T00:22:49.751844+0000","last_fullsized":"2024-09-12T00:22:49.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.751527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.037605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.837158+0000","last_change":"2024-09-12T00:23:22.837158+0000","last_active":"2024-09-12T00:23:22.837158+0000","last_peered":"2024-09-12T00:23:22.837158+0000","last_clean":"2024-09-12T00:23:22.837158+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:23:22.837158+0000","last_undegraded":"2024-09-12T00:23:22.837158+0000","last_fullsized":"2024-09-12T00:23:22.837158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.836976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:54.939860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.155580+0000","last_change":"2024-09-12T00:23:03.155399+0000","last_active":"2024-09-12T00:23:03.155580+0000","last_peered":"2024-09-12T00:23:03.155580+0000","last_clean":"2024-09-12T00:23:03.155580+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:23:03.155580+0000","last_undegraded":"2024-09-12T00:23:03.155580+0000","last_fullsized":"2024-09-12T00:23:03.155580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.155222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:47.560452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.684984+0000","last_change":"2024-09-12T00:23:03.684984+0000","last_active":"2024-09-12T00:23:03.684984+0000","last_peered":"2024-09-12T00:23:03.684984+0000","last_clean":"2024-09-12T00:23:03.684984+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:23:03.684984+0000","last_undegraded":"2024-09-12T00:23:03.684984+0000","last_fullsized":"2024-09-12T00:23:03.684984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.684709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.095355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.894006+0000","last_change":"2024-09-12T00:22:48.893869+0000","last_active":"2024-09-12T00:22:48.894006+0000","last_peered":"2024-09-12T00:22:48.894006+0000","last_clean":"2024-09-12T00:22:48.894006+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:22:48.894006+0000","last_undegraded":"2024-09-12T00:22:48.894006+0000","last_fullsized":"2024-09-12T00:22:48.894006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.893683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:04.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.700907+0000","last_change":"2024-09-12T00:23:04.700907+0000","last_active":"2024-09-12T00:23:04.700907+0000","last_peered":"2024-09-12T00:23:04.700907+0000","last_clean":"2024-09-12T00:23:04.700907+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:23:04.700907+0000","last_undegraded":"2024-09-12T00:23:04.700907+0000","last_fullsized":"2024-09-12T00:23:04.700907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.700730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:30.318663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.896857+0000","last_change":"2024-09-12T00:23:19.896568+0000","last_active":"2024-09-12T00:23:19.896857+0000","last_peered":"2024-09-12T00:23:19.896857+0000","last_clean":"2024-09-12T00:23:19.896857+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:23:19.896857+0000","last_undegraded":"2024-09-12T00:23:19.896857+0000","last_fullsized":"2024-09-12T00:23:19.896857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.896281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:30.170323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.381401+0000","last_change":"2024-09-12T00:22:50.381220+0000","last_active":"2024-09-12T00:22:50.381401+0000","last_peered":"2024-09-12T00:22:50.381401+0000","last_clean":"2024-09-12T00:22:50.381401+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:22:50.381401+0000","last_undegraded":"2024-09-12T00:22:50.381401+0000","last_fullsized":"2024-09-12T00:22:50.381401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:05.740216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.395208+0000","last_change":"2024-09-12T00:23:03.395067+0000","last_active":"2024-09-12T00:23:03.395208+0000","last_peered":"2024-09-12T00:23:03.395208+0000","last_clean":"2024-09-12T00:23:03.395208+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:23:03.395208+0000","last_undegraded":"2024-09-12T00:23:03.395208+0000","last_fullsized":"2024-09-12T00:23:03.395208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.394885+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:09.804874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.797760+0000","last_change":"2024-09-12T00:22:48.797589+0000","last_active":"2024-09-12T00:22:48.797760+0000","last_peered":"2024-09-12T00:22:48.797760+0000","last_clean":"2024-09-12T00:22:48.797760+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:22:48.797760+0000","last_undegraded":"2024-09-12T00:22:48.797760+0000","last_fullsized":"2024-09-12T00:22:48.797760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.797378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:43.134132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.439269+0000","last_change":"2024-09-12T00:23:05.439096+0000","last_active":"2024-09-12T00:23:05.439269+0000","last_peered":"2024-09-12T00:23:05.439269+0000","last_clean":"2024-09-12T00:23:05.439269+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:23:05.439269+0000","last_undegraded":"2024-09-12T00:23:05.439269+0000","last_fullsized":"2024-09-12T00:23:05.439269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.438924+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:26.775381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.390245+0000","last_change":"2024-09-12T00:22:48.390120+0000","last_active":"2024-09-12T00:22:48.390245+0000","last_peered":"2024-09-12T00:22:48.390245+0000","last_clean":"2024-09-12T00:22:48.390245+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:22:48.390245+0000","last_undegraded":"2024-09-12T00:22:48.390245+0000","last_fullsized":"2024-09-12T00:22:48.390245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.389942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.548963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.829942+0000","last_change":"2024-09-12T00:23:06.829700+0000","last_active":"2024-09-12T00:23:06.829942+0000","last_peered":"2024-09-12T00:23:06.829942+0000","last_clean":"2024-09-12T00:23:06.829942+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:23:06.829942+0000","last_undegraded":"2024-09-12T00:23:06.829942+0000","last_fullsized":"2024-09-12T00:23:06.829942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.829458+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:09.909801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.394001+0000","last_change":"2024-09-12T00:22:49.393858+0000","last_active":"2024-09-12T00:22:49.394001+0000","last_peered":"2024-09-12T00:22:49.394001+0000","last_clean":"2024-09-12T00:22:49.394001+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:22:49.394001+0000","last_undegraded":"2024-09-12T00:22:49.394001+0000","last_fullsized":"2024-09-12T00:22:49.394001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.393664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.905345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.724991+0000","last_change":"2024-09-12T00:23:02.724818+0000","last_active":"2024-09-12T00:23:02.724991+0000","last_peered":"2024-09-12T00:23:02.724991+0000","last_clean":"2024-09-12T00:23:02.724991+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:23:02.724991+0000","last_undegraded":"2024-09-12T00:23:02.724991+0000","last_fullsized":"2024-09-12T00:23:02.724991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.724643+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:13.949257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.985602+0000","last_change":"2024-09-12T00:22:52.985430+0000","last_active":"2024-09-12T00:22:52.985602+0000","last_peered":"2024-09-12T00:22:52.985602+0000","last_clean":"2024-09-12T00:22:52.985602+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:22:52.985602+0000","last_undegraded":"2024-09-12T00:22:52.985602+0000","last_fullsized":"2024-09-12T00:22:52.985602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:11.458618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'6","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.399827+0000","last_change":"2024-09-12T00:23:06.399553+0000","last_active":"2024-09-12T00:23:06.399827+0000","last_peered":"2024-09-12T00:23:06.399827+0000","last_clean":"2024-09-12T00:23:06.399827+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:23:06.399827+0000","last_undegraded":"2024-09-12T00:23:06.399827+0000","last_fullsized":"2024-09-12T00:23:06.399827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.399335+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:58.180682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.129041+0000","last_change":"2024-09-12T00:23:02.128899+0000","last_active":"2024-09-12T00:23:02.129041+0000","last_peered":"2024-09-12T00:23:02.129041+0000","last_clean":"2024-09-12T00:23:02.129041+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:23:02.129041+0000","last_undegraded":"2024-09-12T00:23:02.129041+0000","last_fullsized":"2024-09-12T00:23:02.129041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.128715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:26.580947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.270013+0000","last_change":"2024-09-12T00:23:37.269763+0000","last_active":"2024-09-12T00:23:37.270013+0000","last_peered":"2024-09-12T00:23:37.270013+0000","last_clean":"2024-09-12T00:23:37.270013+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:23:37.270013+0000","last_undegraded":"2024-09-12T00:23:37.270013+0000","last_fullsized":"2024-09-12T00:23:37.270013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.269540+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.878743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.016722+0000","last_change":"2024-09-12T00:23:09.016573+0000","last_active":"2024-09-12T00:23:09.016722+0000","last_peered":"2024-09-12T00:23:09.016722+0000","last_clean":"2024-09-12T00:23:09.016722+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:23:09.016722+0000","last_undegraded":"2024-09-12T00:23:09.016722+0000","last_fullsized":"2024-09-12T00:23:09.016722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.016364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:43.015238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.017023+0000","last_change":"2024-09-12T00:22:51.016861+0000","last_active":"2024-09-12T00:22:51.017023+0000","last_peered":"2024-09-12T00:22:51.017023+0000","last_clean":"2024-09-12T00:22:51.017023+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:22:51.017023+0000","last_undegraded":"2024-09-12T00:22:51.017023+0000","last_fullsized":"2024-09-12T00:22:51.017023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.016681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.962090+0000","last_change":"2024-09-12T00:23:31.961933+0000","last_active":"2024-09-12T00:23:31.962090+0000","last_peered":"2024-09-12T00:23:31.962090+0000","last_clean":"2024-09-12T00:23:31.962090+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:23:31.962090+0000","last_undegraded":"2024-09-12T00:23:31.962090+0000","last_fullsized":"2024-09-12T00:23:31.962090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.961757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:47.635223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:44.969812+0000","last_change":"2024-09-12T00:23:44.969812+0000","last_active":"2024-09-12T00:23:44.969812+0000","last_peered":"2024-09-12T00:23:44.969812+0000","last_clean":"2024-09-12T00:23:44.969812+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:23:44.969812+0000","last_undegraded":"2024-09-12T00:23:44.969812+0000","last_fullsized":"2024-09-12T00:23:44.969812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:44.969606+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:44.969606+0000","last_clean_scrub_stamp":"2024-09-12T00:23:44.969606+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:35.419284+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.203037+0000","last_change":"2024-09-12T00:23:29.202904+0000","last_active":"2024-09-12T00:23:29.203037+0000","last_peered":"2024-09-12T00:23:29.203037+0000","last_clean":"2024-09-12T00:23:29.203037+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:23:29.203037+0000","last_undegraded":"2024-09-12T00:23:29.203037+0000","last_fullsized":"2024-09-12T00:23:29.203037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.202735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:26.049014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.229286+0000","last_change":"2024-09-12T00:23:38.229130+0000","last_active":"2024-09-12T00:23:38.229286+0000","last_peered":"2024-09-12T00:23:38.229286+0000","last_clean":"2024-09-12T00:23:38.229286+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:23:38.229286+0000","last_undegraded":"2024-09-12T00:23:38.229286+0000","last_fullsized":"2024-09-12T00:23:38.229286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-12T00:23:38.228909+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-12T00:23:38.228909+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.228909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:39.522007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.962017+0000","last_change":"2024-09-12T00:23:13.961891+0000","last_active":"2024-09-12T00:23:13.962017+0000","last_peered":"2024-09-12T00:23:13.962017+0000","last_clean":"2024-09-12T00:23:13.962017+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:23:13.962017+0000","last_undegraded":"2024-09-12T00:23:13.962017+0000","last_fullsized":"2024-09-12T00:23:13.962017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.961704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:07.483381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.797176+0000","last_change":"2024-09-12T00:22:43.797026+0000","last_active":"2024-09-12T00:22:43.797176+0000","last_peered":"2024-09-12T00:22:43.797176+0000","last_clean":"2024-09-12T00:22:43.797176+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:22:43.797176+0000","last_undegraded":"2024-09-12T00:22:43.797176+0000","last_fullsized":"2024-09-12T00:22:43.797176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.796840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:32.300041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.369745+0000","last_change":"2024-09-12T00:23:14.369745+0000","last_active":"2024-09-12T00:23:14.369745+0000","last_peered":"2024-09-12T00:23:14.369745+0000","last_clean":"2024-09-12T00:23:14.369745+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:23:14.369745+0000","last_undegraded":"2024-09-12T00:23:14.369745+0000","last_fullsized":"2024-09-12T00:23:14.369745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.369579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.600971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.155307+0000","last_change":"2024-09-12T00:23:23.155034+0000","last_active":"2024-09-12T00:23:23.155307+0000","last_peered":"2024-09-12T00:23:23.155307+0000","last_clean":"2024-09-12T00:23:23.155307+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:23:23.155307+0000","last_undegraded":"2024-09-12T00:23:23.155307+0000","last_fullsized":"2024-09-12T00:23:23.155307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.154802+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:07.955527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.162091+0000","last_change":"2024-09-12T00:23:28.161930+0000","last_active":"2024-09-12T00:23:28.162091+0000","last_peered":"2024-09-12T00:23:28.162091+0000","last_clean":"2024-09-12T00:23:28.162091+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:23:28.162091+0000","last_undegraded":"2024-09-12T00:23:28.162091+0000","last_fullsized":"2024-09-12T00:23:28.162091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.161717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:01.037307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.708595+0000","last_change":"2024-09-12T00:23:33.708440+0000","last_active":"2024-09-12T00:23:33.708595+0000","last_peered":"2024-09-12T00:23:33.708595+0000","last_clean":"2024-09-12T00:23:33.708595+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:23:33.708595+0000","last_undegraded":"2024-09-12T00:23:33.708595+0000","last_fullsized":"2024-09-12T00:23:33.708595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.708253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.689561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.939814+0000","last_change":"2024-09-12T00:23:12.939642+0000","last_active":"2024-09-12T00:23:12.939814+0000","last_peered":"2024-09-12T00:23:12.939814+0000","last_clean":"2024-09-12T00:23:12.939814+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:23:12.939814+0000","last_undegraded":"2024-09-12T00:23:12.939814+0000","last_fullsized":"2024-09-12T00:23:12.939814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.939457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.805086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.061676+0000","last_change":"2024-09-12T00:22:50.061542+0000","last_active":"2024-09-12T00:22:50.061676+0000","last_peered":"2024-09-12T00:22:50.061676+0000","last_clean":"2024-09-12T00:22:50.061676+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:22:50.061676+0000","last_undegraded":"2024-09-12T00:22:50.061676+0000","last_fullsized":"2024-09-12T00:22:50.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.061348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:59.156666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.840770+0000","last_change":"2024-09-12T00:23:09.840652+0000","last_active":"2024-09-12T00:23:09.840770+0000","last_peered":"2024-09-12T00:23:09.840770+0000","last_clean":"2024-09-12T00:23:09.840770+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:23:09.840770+0000","last_undegraded":"2024-09-12T00:23:09.840770+0000","last_fullsized":"2024-09-12T00:23:09.840770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.840470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:18.847901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'31","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.759568+0000","last_change":"2024-09-12T00:23:17.759391+0000","last_active":"2024-09-12T00:23:17.759568+0000","last_peered":"2024-09-12T00:23:17.759568+0000","last_clean":"2024-09-12T00:23:17.759568+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:23:17.759568+0000","last_undegraded":"2024-09-12T00:23:17.759568+0000","last_fullsized":"2024-09-12T00:23:17.759568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.759194+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:15.514131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":396,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:50.915646+0000","last_change":"2024-09-12T00:23:50.915646+0000","last_active":"2024-09-12T00:23:50.915646+0000","last_peered":"2024-09-12T00:23:50.915646+0000","last_clean":"2024-09-12T00:23:50.915646+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:23:50.915646+0000","last_undegraded":"2024-09-12T00:23:50.915646+0000","last_fullsized":"2024-09-12T00:23:50.915646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:50.915463+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:50.915463+0000","last_clean_scrub_stamp":"2024-09-12T00:23:50.915463+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:52.689437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.732365+0000","last_change":"2024-09-12T00:23:30.732233+0000","last_active":"2024-09-12T00:23:30.732365+0000","last_peered":"2024-09-12T00:23:30.732365+0000","last_clean":"2024-09-12T00:23:30.732365+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:23:30.732365+0000","last_undegraded":"2024-09-12T00:23:30.732365+0000","last_fullsized":"2024-09-12T00:23:30.732365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.732049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:20.404264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.837234+0000","last_change":"2024-09-12T00:22:59.837098+0000","last_active":"2024-09-12T00:22:59.837234+0000","last_peered":"2024-09-12T00:22:59.837234+0000","last_clean":"2024-09-12T00:22:59.837234+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:59.837234+0000","last_undegraded":"2024-09-12T00:22:59.837234+0000","last_fullsized":"2024-09-12T00:22:59.837234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.836918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.309884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.345876+0000","last_change":"2024-09-12T00:22:41.345748+0000","last_active":"2024-09-12T00:22:41.345876+0000","last_peered":"2024-09-12T00:22:41.345876+0000","last_clean":"2024-09-12T00:22:41.345876+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:22:41.345876+0000","last_undegraded":"2024-09-12T00:22:41.345876+0000","last_fullsized":"2024-09-12T00:22:41.345876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.345566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:36.735410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"33'2","reported_seq":231,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.000677+0000","last_change":"2024-09-12T00:23:33.000372+0000","last_active":"2024-09-12T00:23:33.000677+0000","last_peered":"2024-09-12T00:23:33.000677+0000","last_clean":"2024-09-12T00:23:33.000677+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:23:33.000677+0000","last_undegraded":"2024-09-12T00:23:33.000677+0000","last_fullsized":"2024-09-12T00:23:33.000677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.000090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:12.347397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.781974+0000","last_change":"2024-09-12T00:23:18.781836+0000","last_active":"2024-09-12T00:23:18.781974+0000","last_peered":"2024-09-12T00:23:18.781974+0000","last_clean":"2024-09-12T00:23:18.781974+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:23:18.781974+0000","last_undegraded":"2024-09-12T00:23:18.781974+0000","last_fullsized":"2024-09-12T00:23:18.781974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.781614+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:45.399468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'286","reported_seq":456,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.761859+0000","last_change":"2024-09-12T00:23:25.761580+0000","last_active":"2024-09-12T00:23:25.761859+0000","last_peered":"2024-09-12T00:23:25.761859+0000","last_clean":"2024-09-12T00:23:25.761859+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:23:25.761859+0000","last_undegraded":"2024-09-12T00:23:25.761859+0000","last_fullsized":"2024-09-12T00:23:25.761859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.761356+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:04.491765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.085218+0000","last_change":"2024-09-12T00:23:07.084961+0000","last_active":"2024-09-12T00:23:07.085218+0000","last_peered":"2024-09-12T00:23:07.085218+0000","last_clean":"2024-09-12T00:23:07.085218+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:23:07.085218+0000","last_undegraded":"2024-09-12T00:23:07.085218+0000","last_fullsized":"2024-09-12T00:23:07.085218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.084724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.811716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.772738+0000","last_change":"2024-09-12T00:22:41.772590+0000","last_active":"2024-09-12T00:22:41.772738+0000","last_peered":"2024-09-12T00:22:41.772738+0000","last_clean":"2024-09-12T00:22:41.772738+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:41.772738+0000","last_undegraded":"2024-09-12T00:22:41.772738+0000","last_fullsized":"2024-09-12T00:22:41.772738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.772363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.380735+0000","last_change":"2024-09-12T00:23:11.380735+0000","last_active":"2024-09-12T00:23:11.380735+0000","last_peered":"2024-09-12T00:23:11.380735+0000","last_clean":"2024-09-12T00:23:11.380735+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:23:11.380735+0000","last_undegraded":"2024-09-12T00:23:11.380735+0000","last_fullsized":"2024-09-12T00:23:11.380735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.380468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:20.387899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'62","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.763583+0000","last_change":"2024-09-12T00:23:14.763583+0000","last_active":"2024-09-12T00:23:14.763583+0000","last_peered":"2024-09-12T00:23:14.763583+0000","last_clean":"2024-09-12T00:23:14.763583+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:23:14.763583+0000","last_undegraded":"2024-09-12T00:23:14.763583+0000","last_fullsized":"2024-09-12T00:23:14.763583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'62","last_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_deep_scrub":"33'62","last_deep_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.763365+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:39.983068+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.755117+0000","last_change":"2024-09-12T00:23:24.755117+0000","last_active":"2024-09-12T00:23:24.755117+0000","last_peered":"2024-09-12T00:23:24.755117+0000","last_clean":"2024-09-12T00:23:24.755117+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:23:24.755117+0000","last_undegraded":"2024-09-12T00:23:24.755117+0000","last_fullsized":"2024-09-12T00:23:24.755117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.754908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:00.095135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.754381+0000","last_change":"2024-09-12T00:23:27.754381+0000","last_active":"2024-09-12T00:23:27.754381+0000","last_peered":"2024-09-12T00:23:27.754381+0000","last_clean":"2024-09-12T00:23:27.754381+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:23:27.754381+0000","last_undegraded":"2024-09-12T00:23:27.754381+0000","last_fullsized":"2024-09-12T00:23:27.754381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.754200+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:53.666701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.432243+0000","last_change":"2024-09-12T00:22:52.432048+0000","last_active":"2024-09-12T00:22:52.432243+0000","last_peered":"2024-09-12T00:22:52.432243+0000","last_clean":"2024-09-12T00:22:52.432243+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:22:52.432243+0000","last_undegraded":"2024-09-12T00:22:52.432243+0000","last_fullsized":"2024-09-12T00:22:52.432243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.431871+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.876093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.795646+0000","last_change":"2024-09-12T00:22:40.795499+0000","last_active":"2024-09-12T00:22:40.795646+0000","last_peered":"2024-09-12T00:22:40.795646+0000","last_clean":"2024-09-12T00:22:40.795646+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:22:40.795646+0000","last_undegraded":"2024-09-12T00:22:40.795646+0000","last_fullsized":"2024-09-12T00:22:40.795646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.795325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:29.485413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.766513+0000","last_change":"2024-09-12T00:23:14.766513+0000","last_active":"2024-09-12T00:23:14.766513+0000","last_peered":"2024-09-12T00:23:14.766513+0000","last_clean":"2024-09-12T00:23:14.766513+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:23:14.766513+0000","last_undegraded":"2024-09-12T00:23:14.766513+0000","last_fullsized":"2024-09-12T00:23:14.766513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.766308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.849877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.945468+0000","last_change":"2024-09-12T00:23:38.945468+0000","last_active":"2024-09-12T00:23:38.945468+0000","last_peered":"2024-09-12T00:23:38.945468+0000","last_clean":"2024-09-12T00:23:38.945468+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:23:38.945468+0000","last_undegraded":"2024-09-12T00:23:38.945468+0000","last_fullsized":"2024-09-12T00:23:38.945468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-12T00:23:38.945282+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-12T00:23:38.945282+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.945282+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.103782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.753618+0000","last_change":"2024-09-12T00:23:37.753618+0000","last_active":"2024-09-12T00:23:37.753618+0000","last_peered":"2024-09-12T00:23:37.753618+0000","last_clean":"2024-09-12T00:23:37.753618+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:23:37.753618+0000","last_undegraded":"2024-09-12T00:23:37.753618+0000","last_fullsized":"2024-09-12T00:23:37.753618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:37.753439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:37.753439+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.753439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:24.147808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.237461+0000","last_change":"2024-09-12T00:23:32.237461+0000","last_active":"2024-09-12T00:23:32.237461+0000","last_peered":"2024-09-12T00:23:32.237461+0000","last_clean":"2024-09-12T00:23:32.237461+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:23:32.237461+0000","last_undegraded":"2024-09-12T00:23:32.237461+0000","last_fullsized":"2024-09-12T00:23:32.237461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.237272+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:27.360129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.652375+0000","last_change":"2024-09-12T00:22:56.652212+0000","last_active":"2024-09-12T00:22:56.652375+0000","last_peered":"2024-09-12T00:22:56.652375+0000","last_clean":"2024-09-12T00:22:56.652375+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:56.652375+0000","last_undegraded":"2024-09-12T00:22:56.652375+0000","last_fullsized":"2024-09-12T00:22:56.652375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.652038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.998075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.097480+0000","last_change":"2024-09-12T00:22:49.097322+0000","last_active":"2024-09-12T00:22:49.097480+0000","last_peered":"2024-09-12T00:22:49.097480+0000","last_clean":"2024-09-12T00:22:49.097480+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:22:49.097480+0000","last_undegraded":"2024-09-12T00:22:49.097480+0000","last_fullsized":"2024-09-12T00:22:49.097480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.097141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:19.046570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.793060+0000","last_change":"2024-09-12T00:23:08.792927+0000","last_active":"2024-09-12T00:23:08.793060+0000","last_peered":"2024-09-12T00:23:08.793060+0000","last_clean":"2024-09-12T00:23:08.793060+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:23:08.793060+0000","last_undegraded":"2024-09-12T00:23:08.793060+0000","last_fullsized":"2024-09-12T00:23:08.793060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.792752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:34.705253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'61","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.965661+0000","last_change":"2024-09-12T00:23:36.965661+0000","last_active":"2024-09-12T00:23:36.965661+0000","last_peered":"2024-09-12T00:23:36.965661+0000","last_clean":"2024-09-12T00:23:36.965661+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:23:36.965661+0000","last_undegraded":"2024-09-12T00:23:36.965661+0000","last_fullsized":"2024-09-12T00:23:36.965661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.965454+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.860037+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'286","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.706053+0000","last_change":"2024-09-12T00:23:29.706053+0000","last_active":"2024-09-12T00:23:29.706053+0000","last_peered":"2024-09-12T00:23:29.706053+0000","last_clean":"2024-09-12T00:23:29.706053+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:23:29.706053+0000","last_undegraded":"2024-09-12T00:23:29.706053+0000","last_fullsized":"2024-09-12T00:23:29.706053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.705871+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:17.737412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.745194+0000","last_change":"2024-09-12T00:23:34.745194+0000","last_active":"2024-09-12T00:23:34.745194+0000","last_peered":"2024-09-12T00:23:34.745194+0000","last_clean":"2024-09-12T00:23:34.745194+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:23:34.745194+0000","last_undegraded":"2024-09-12T00:23:34.745194+0000","last_fullsized":"2024-09-12T00:23:34.745194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.745014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:31.536554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.683417+0000","last_change":"2024-09-12T00:22:55.683235+0000","last_active":"2024-09-12T00:22:55.683417+0000","last_peered":"2024-09-12T00:22:55.683417+0000","last_clean":"2024-09-12T00:22:55.683417+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:55.683417+0000","last_undegraded":"2024-09-12T00:22:55.683417+0000","last_fullsized":"2024-09-12T00:22:55.683417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.683049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:38.119930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.023749+0000","last_change":"2024-09-12T00:22:47.023618+0000","last_active":"2024-09-12T00:22:47.023749+0000","last_peered":"2024-09-12T00:22:47.023749+0000","last_clean":"2024-09-12T00:22:47.023749+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:22:47.023749+0000","last_undegraded":"2024-09-12T00:22:47.023749+0000","last_fullsized":"2024-09-12T00:22:47.023749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.023424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:59.258309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.726263+0000","last_change":"2024-09-12T00:23:05.726024+0000","last_active":"2024-09-12T00:23:05.726263+0000","last_peered":"2024-09-12T00:23:05.726263+0000","last_clean":"2024-09-12T00:23:05.726263+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:23:05.726263+0000","last_undegraded":"2024-09-12T00:23:05.726263+0000","last_fullsized":"2024-09-12T00:23:05.726263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.725828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:35.191271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'79","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.915758+0000","last_change":"2024-09-12T00:23:37.915758+0000","last_active":"2024-09-12T00:23:37.915758+0000","last_peered":"2024-09-12T00:23:37.915758+0000","last_clean":"2024-09-12T00:23:37.915758+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:23:37.915758+0000","last_undegraded":"2024-09-12T00:23:37.915758+0000","last_fullsized":"2024-09-12T00:23:37.915758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'79","last_scrub_stamp":"2024-09-12T00:23:37.915538+0000","last_deep_scrub":"33'79","last_deep_scrub_stamp":"2024-09-12T00:23:37.915538+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.915538+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.317336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.721415+0000","last_change":"2024-09-12T00:23:23.721415+0000","last_active":"2024-09-12T00:23:23.721415+0000","last_peered":"2024-09-12T00:23:23.721415+0000","last_clean":"2024-09-12T00:23:23.721415+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:23:23.721415+0000","last_undegraded":"2024-09-12T00:23:23.721415+0000","last_fullsized":"2024-09-12T00:23:23.721415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.721237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.538900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'26","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.707322+0000","last_change":"2024-09-12T00:23:28.707322+0000","last_active":"2024-09-12T00:23:28.707322+0000","last_peered":"2024-09-12T00:23:28.707322+0000","last_clean":"2024-09-12T00:23:28.707322+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:23:28.707322+0000","last_undegraded":"2024-09-12T00:23:28.707322+0000","last_fullsized":"2024-09-12T00:23:28.707322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.707119+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:33.980065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.393141+0000","last_change":"2024-09-12T00:22:54.392952+0000","last_active":"2024-09-12T00:22:54.393141+0000","last_peered":"2024-09-12T00:22:54.393141+0000","last_clean":"2024-09-12T00:22:54.393141+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:54.393141+0000","last_undegraded":"2024-09-12T00:22:54.393141+0000","last_fullsized":"2024-09-12T00:22:54.393141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.392767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:12.866147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.874156+0000","last_change":"2024-09-12T00:22:46.874023+0000","last_active":"2024-09-12T00:22:46.874156+0000","last_peered":"2024-09-12T00:22:46.874156+0000","last_clean":"2024-09-12T00:22:46.874156+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:22:46.874156+0000","last_undegraded":"2024-09-12T00:22:46.874156+0000","last_fullsized":"2024-09-12T00:22:46.874156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.873837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:16.339279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.705078+0000","last_change":"2024-09-12T00:23:07.704869+0000","last_active":"2024-09-12T00:23:07.705078+0000","last_peered":"2024-09-12T00:23:07.705078+0000","last_clean":"2024-09-12T00:23:07.705078+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:23:07.705078+0000","last_undegraded":"2024-09-12T00:23:07.705078+0000","last_fullsized":"2024-09-12T00:23:07.705078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.704656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:23.063840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.176520+0000","last_change":"2024-09-12T00:23:22.176363+0000","last_active":"2024-09-12T00:23:22.176520+0000","last_peered":"2024-09-12T00:23:22.176520+0000","last_clean":"2024-09-12T00:23:22.176520+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:23:22.176520+0000","last_undegraded":"2024-09-12T00:23:22.176520+0000","last_fullsized":"2024-09-12T00:23:22.176520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.176164+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:34.304576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:48.994938+0000","last_change":"2024-09-12T00:23:48.994938+0000","last_active":"2024-09-12T00:23:48.994938+0000","last_peered":"2024-09-12T00:23:48.994938+0000","last_clean":"2024-09-12T00:23:48.994938+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:23:48.994938+0000","last_undegraded":"2024-09-12T00:23:48.994938+0000","last_fullsized":"2024-09-12T00:23:48.994938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:48.994751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:48.994751+0000","last_clean_scrub_stamp":"2024-09-12T00:23:48.994751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:59.438963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:52.892253+0000","last_change":"2024-09-12T00:23:52.892253+0000","last_active":"2024-09-12T00:23:52.892253+0000","last_peered":"2024-09-12T00:23:52.892253+0000","last_clean":"2024-09-12T00:23:52.892253+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:23:52.892253+0000","last_undegraded":"2024-09-12T00:23:52.892253+0000","last_fullsized":"2024-09-12T00:23:52.892253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:52.892008+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:52.892008+0000","last_clean_scrub_stamp":"2024-09-12T00:23:52.892008+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.074728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.003649+0000","last_change":"2024-09-12T00:23:10.003493+0000","last_active":"2024-09-12T00:23:10.003649+0000","last_peered":"2024-09-12T00:23:10.003649+0000","last_clean":"2024-09-12T00:23:10.003649+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:23:10.003649+0000","last_undegraded":"2024-09-12T00:23:10.003649+0000","last_fullsized":"2024-09-12T00:23:10.003649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.003307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:46.132710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.991804+0000","last_change":"2024-09-12T00:22:45.991549+0000","last_active":"2024-09-12T00:22:45.991804+0000","last_peered":"2024-09-12T00:22:45.991804+0000","last_clean":"2024-09-12T00:22:45.991804+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:22:45.991804+0000","last_undegraded":"2024-09-12T00:22:45.991804+0000","last_fullsized":"2024-09-12T00:22:45.991804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.991336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:42.782875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.823994+0000","last_change":"2024-09-12T00:23:10.823854+0000","last_active":"2024-09-12T00:23:10.823994+0000","last_peered":"2024-09-12T00:23:10.823994+0000","last_clean":"2024-09-12T00:23:10.823994+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:23:10.823994+0000","last_undegraded":"2024-09-12T00:23:10.823994+0000","last_fullsized":"2024-09-12T00:23:10.823994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.823673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:48.346256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.712773+0000","last_change":"2024-09-12T00:23:15.712629+0000","last_active":"2024-09-12T00:23:15.712773+0000","last_peered":"2024-09-12T00:23:15.712773+0000","last_clean":"2024-09-12T00:23:15.712773+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:23:15.712773+0000","last_undegraded":"2024-09-12T00:23:15.712773+0000","last_fullsized":"2024-09-12T00:23:15.712773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.712426+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:44.227558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'286","reported_seq":446,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.834812+0000","last_change":"2024-09-12T00:23:21.834664+0000","last_active":"2024-09-12T00:23:21.834812+0000","last_peered":"2024-09-12T00:23:21.834812+0000","last_clean":"2024-09-12T00:23:21.834812+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:23:21.834812+0000","last_undegraded":"2024-09-12T00:23:21.834812+0000","last_fullsized":"2024-09-12T00:23:21.834812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.834474+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.429146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.724078+0000","last_change":"2024-09-12T00:23:32.724078+0000","last_active":"2024-09-12T00:23:32.724078+0000","last_peered":"2024-09-12T00:23:32.724078+0000","last_clean":"2024-09-12T00:23:32.724078+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:23:32.724078+0000","last_undegraded":"2024-09-12T00:23:32.724078+0000","last_fullsized":"2024-09-12T00:23:32.724078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.723839+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.576755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.687472+0000","last_change":"2024-09-12T00:22:57.687239+0000","last_active":"2024-09-12T00:22:57.687472+0000","last_peered":"2024-09-12T00:22:57.687472+0000","last_clean":"2024-09-12T00:22:57.687472+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:22:57.687472+0000","last_undegraded":"2024-09-12T00:22:57.687472+0000","last_fullsized":"2024-09-12T00:22:57.687472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.687015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:52.889888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.055380+0000","last_change":"2024-09-12T00:22:48.055242+0000","last_active":"2024-09-12T00:22:48.055380+0000","last_peered":"2024-09-12T00:22:48.055380+0000","last_clean":"2024-09-12T00:22:48.055380+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:22:48.055380+0000","last_undegraded":"2024-09-12T00:22:48.055380+0000","last_fullsized":"2024-09-12T00:22:48.055380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.055065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:08.979877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.389518+0000","last_change":"2024-09-12T00:23:12.389268+0000","last_active":"2024-09-12T00:23:12.389518+0000","last_peered":"2024-09-12T00:23:12.389518+0000","last_clean":"2024-09-12T00:23:12.389518+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:23:12.389518+0000","last_undegraded":"2024-09-12T00:23:12.389518+0000","last_fullsized":"2024-09-12T00:23:12.389518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.389028+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.911611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:40.976487+0000","last_change":"2024-09-12T00:23:40.976487+0000","last_active":"2024-09-12T00:23:40.976487+0000","last_peered":"2024-09-12T00:23:40.976487+0000","last_clean":"2024-09-12T00:23:40.976487+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:23:40.976487+0000","last_undegraded":"2024-09-12T00:23:40.976487+0000","last_fullsized":"2024-09-12T00:23:40.976487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-12T00:23:40.976251+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-12T00:23:40.976251+0000","last_clean_scrub_stamp":"2024-09-12T00:23:40.976251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:04.768070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'286","reported_seq":483,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.117161+0000","last_change":"2024-09-12T00:23:26.117161+0000","last_active":"2024-09-12T00:23:26.117161+0000","last_peered":"2024-09-12T00:23:26.117161+0000","last_clean":"2024-09-12T00:23:26.117161+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:23:26.117161+0000","last_undegraded":"2024-09-12T00:23:26.117161+0000","last_fullsized":"2024-09-12T00:23:26.117161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.116977+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:01.457204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.774401+0000","last_change":"2024-09-12T00:23:26.774401+0000","last_active":"2024-09-12T00:23:26.774401+0000","last_peered":"2024-09-12T00:23:26.774401+0000","last_clean":"2024-09-12T00:23:26.774401+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:23:26.774401+0000","last_undegraded":"2024-09-12T00:23:26.774401+0000","last_fullsized":"2024-09-12T00:23:26.774401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.774216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.792583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.426031+0000","last_change":"2024-09-12T00:22:53.425858+0000","last_active":"2024-09-12T00:22:53.426031+0000","last_peered":"2024-09-12T00:22:53.426031+0000","last_clean":"2024-09-12T00:22:53.426031+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:53.426031+0000","last_undegraded":"2024-09-12T00:22:53.426031+0000","last_fullsized":"2024-09-12T00:22:53.426031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.425681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:50.989571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.037177+0000","last_change":"2024-09-12T00:22:45.037018+0000","last_active":"2024-09-12T00:22:45.037177+0000","last_peered":"2024-09-12T00:22:45.037177+0000","last_clean":"2024-09-12T00:22:45.037177+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:22:45.037177+0000","last_undegraded":"2024-09-12T00:22:45.037177+0000","last_fullsized":"2024-09-12T00:22:45.037177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.036831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:05.107642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.973980+0000","last_change":"2024-09-12T00:23:29.973980+0000","last_active":"2024-09-12T00:23:29.973980+0000","last_peered":"2024-09-12T00:23:29.973980+0000","last_clean":"2024-09-12T00:23:29.973980+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:23:29.973980+0000","last_undegraded":"2024-09-12T00:23:29.973980+0000","last_fullsized":"2024-09-12T00:23:29.973980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.973764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:26.938202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.225959+0000","last_change":"2024-09-12T00:23:21.225814+0000","last_active":"2024-09-12T00:23:21.225959+0000","last_peered":"2024-09-12T00:23:21.225959+0000","last_clean":"2024-09-12T00:23:21.225959+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:23:21.225959+0000","last_undegraded":"2024-09-12T00:23:21.225959+0000","last_fullsized":"2024-09-12T00:23:21.225959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.225622+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.693429+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.787743+0000","last_change":"2024-09-12T00:23:22.787743+0000","last_active":"2024-09-12T00:23:22.787743+0000","last_peered":"2024-09-12T00:23:22.787743+0000","last_clean":"2024-09-12T00:23:22.787743+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:23:22.787743+0000","last_undegraded":"2024-09-12T00:23:22.787743+0000","last_fullsized":"2024-09-12T00:23:22.787743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.787566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:44.124023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.267444+0000","last_change":"2024-09-12T00:23:31.267444+0000","last_active":"2024-09-12T00:23:31.267444+0000","last_peered":"2024-09-12T00:23:31.267444+0000","last_clean":"2024-09-12T00:23:31.267444+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:23:31.267444+0000","last_undegraded":"2024-09-12T00:23:31.267444+0000","last_fullsized":"2024-09-12T00:23:31.267444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.267222+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:19.298763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.741818+0000","last_change":"2024-09-12T00:22:53.741667+0000","last_active":"2024-09-12T00:22:53.741818+0000","last_peered":"2024-09-12T00:22:53.741818+0000","last_clean":"2024-09-12T00:22:53.741818+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:22:53.741818+0000","last_undegraded":"2024-09-12T00:22:53.741818+0000","last_fullsized":"2024-09-12T00:22:53.741818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.741481+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:54.588986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.330431+0000","last_change":"2024-09-12T00:22:38.330431+0000","last_active":"2024-09-12T00:22:38.330431+0000","last_peered":"2024-09-12T00:22:38.330431+0000","last_clean":"2024-09-12T00:22:38.330431+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:22:38.330431+0000","last_undegraded":"2024-09-12T00:22:38.330431+0000","last_fullsized":"2024-09-12T00:22:38.330431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.330231+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:47.818803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.088492+0000","last_change":"2024-09-12T00:22:40.088223+0000","last_active":"2024-09-12T00:22:40.088492+0000","last_peered":"2024-09-12T00:22:40.088492+0000","last_clean":"2024-09-12T00:22:40.088492+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:22:40.088492+0000","last_undegraded":"2024-09-12T00:22:40.088492+0000","last_fullsized":"2024-09-12T00:22:40.088492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.087970+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.489548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.015916+0000","last_change":"2024-09-12T00:22:43.015652+0000","last_active":"2024-09-12T00:22:43.015916+0000","last_peered":"2024-09-12T00:22:43.015916+0000","last_clean":"2024-09-12T00:22:43.015916+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:43.015916+0000","last_undegraded":"2024-09-12T00:22:43.015916+0000","last_fullsized":"2024-09-12T00:22:43.015916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.015422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:23.844048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.395580+0000","last_change":"2024-09-12T00:23:10.395580+0000","last_active":"2024-09-12T00:23:10.395580+0000","last_peered":"2024-09-12T00:23:10.395580+0000","last_clean":"2024-09-12T00:23:10.395580+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:23:10.395580+0000","last_undegraded":"2024-09-12T00:23:10.395580+0000","last_fullsized":"2024-09-12T00:23:10.395580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.395395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'97","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.996724+0000","last_change":"2024-09-12T00:23:35.996724+0000","last_active":"2024-09-12T00:23:35.996724+0000","last_peered":"2024-09-12T00:23:35.996724+0000","last_clean":"2024-09-12T00:23:35.996724+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:23:35.996724+0000","last_undegraded":"2024-09-12T00:23:35.996724+0000","last_fullsized":"2024-09-12T00:23:35.996724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.996525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.788244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.785001+0000","last_change":"2024-09-12T00:23:15.785001+0000","last_active":"2024-09-12T00:23:15.785001+0000","last_peered":"2024-09-12T00:23:15.785001+0000","last_clean":"2024-09-12T00:23:15.785001+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:23:15.785001+0000","last_undegraded":"2024-09-12T00:23:15.785001+0000","last_fullsized":"2024-09-12T00:23:15.785001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.784792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:05.198107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.727983+0000","last_change":"2024-09-12T00:23:28.727983+0000","last_active":"2024-09-12T00:23:28.727983+0000","last_peered":"2024-09-12T00:23:28.727983+0000","last_clean":"2024-09-12T00:23:28.727983+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:23:28.727983+0000","last_undegraded":"2024-09-12T00:23:28.727983+0000","last_fullsized":"2024-09-12T00:23:28.727983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'82","last_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_deep_scrub":"33'82","last_deep_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.727807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:37.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.038978+0000","last_change":"2024-09-12T00:23:08.038978+0000","last_active":"2024-09-12T00:23:08.038978+0000","last_peered":"2024-09-12T00:23:08.038978+0000","last_clean":"2024-09-12T00:23:08.038978+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:23:08.038978+0000","last_undegraded":"2024-09-12T00:23:08.038978+0000","last_fullsized":"2024-09-12T00:23:08.038978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.038792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:47.713400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.101143+0000","last_change":"2024-09-12T00:22:38.101143+0000","last_active":"2024-09-12T00:22:38.101143+0000","last_peered":"2024-09-12T00:22:38.101143+0000","last_clean":"2024-09-12T00:22:38.101143+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:22:38.101143+0000","last_undegraded":"2024-09-12T00:22:38.101143+0000","last_fullsized":"2024-09-12T00:22:38.101143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.100967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:57.104038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.819521+0000","last_change":"2024-09-12T00:22:41.819357+0000","last_active":"2024-09-12T00:22:41.819521+0000","last_peered":"2024-09-12T00:22:41.819521+0000","last_clean":"2024-09-12T00:22:41.819521+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:22:41.819521+0000","last_undegraded":"2024-09-12T00:22:41.819521+0000","last_fullsized":"2024-09-12T00:22:41.819521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.819171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.252502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.975236+0000","last_change":"2024-09-12T00:23:27.975236+0000","last_active":"2024-09-12T00:23:27.975236+0000","last_peered":"2024-09-12T00:23:27.975236+0000","last_clean":"2024-09-12T00:23:27.975236+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:23:27.975236+0000","last_undegraded":"2024-09-12T00:23:27.975236+0000","last_fullsized":"2024-09-12T00:23:27.975236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.975054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.142602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'301","reported_seq":534,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.254372+0000","last_change":"2024-09-12T00:23:20.254372+0000","last_active":"2024-09-12T00:23:20.254372+0000","last_peered":"2024-09-12T00:23:20.254372+0000","last_clean":"2024-09-12T00:23:20.254372+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:23:20.254372+0000","last_undegraded":"2024-09-12T00:23:20.254372+0000","last_fullsized":"2024-09-12T00:23:20.254372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'301","last_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_deep_scrub":"33'301","last_deep_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.254181+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.785930+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:46.989824+0000","last_change":"2024-09-12T00:23:46.989824+0000","last_active":"2024-09-12T00:23:46.989824+0000","last_peered":"2024-09-12T00:23:46.989824+0000","last_clean":"2024-09-12T00:23:46.989824+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:23:46.989824+0000","last_undegraded":"2024-09-12T00:23:46.989824+0000","last_fullsized":"2024-09-12T00:23:46.989824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:46.989642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:46.989642+0000","last_clean_scrub_stamp":"2024-09-12T00:23:46.989642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.258889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.274760+0000","last_change":"2024-09-12T00:23:34.274760+0000","last_active":"2024-09-12T00:23:34.274760+0000","last_peered":"2024-09-12T00:23:34.274760+0000","last_clean":"2024-09-12T00:23:34.274760+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:23:34.274760+0000","last_undegraded":"2024-09-12T00:23:34.274760+0000","last_fullsized":"2024-09-12T00:23:34.274760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.274531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.127447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.892856+0000","last_change":"2024-09-12T00:22:56.892682+0000","last_active":"2024-09-12T00:22:56.892856+0000","last_peered":"2024-09-12T00:22:56.892856+0000","last_clean":"2024-09-12T00:22:56.892856+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:56.892856+0000","last_undegraded":"2024-09-12T00:22:56.892856+0000","last_fullsized":"2024-09-12T00:22:56.892856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.892476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:41.105061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.794403+0000","last_change":"2024-09-12T00:22:38.794195+0000","last_active":"2024-09-12T00:22:38.794403+0000","last_peered":"2024-09-12T00:22:38.794403+0000","last_clean":"2024-09-12T00:22:38.794403+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:22:38.794403+0000","last_undegraded":"2024-09-12T00:22:38.794403+0000","last_fullsized":"2024-09-12T00:22:38.794403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.794009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:39.382664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.745657+0000","last_change":"2024-09-12T00:22:39.745499+0000","last_active":"2024-09-12T00:22:39.745657+0000","last_peered":"2024-09-12T00:22:39.745657+0000","last_clean":"2024-09-12T00:22:39.745657+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:22:39.745657+0000","last_undegraded":"2024-09-12T00:22:39.745657+0000","last_fullsized":"2024-09-12T00:22:39.745657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.745298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.209943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.757419+0000","last_change":"2024-09-12T00:23:06.757280+0000","last_active":"2024-09-12T00:23:06.757419+0000","last_peered":"2024-09-12T00:23:06.757419+0000","last_clean":"2024-09-12T00:23:06.757419+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:23:06.757419+0000","last_undegraded":"2024-09-12T00:23:06.757419+0000","last_fullsized":"2024-09-12T00:23:06.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.757101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:36.253152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.804413+0000","last_change":"2024-09-12T00:23:13.804413+0000","last_active":"2024-09-12T00:23:13.804413+0000","last_peered":"2024-09-12T00:23:13.804413+0000","last_clean":"2024-09-12T00:23:13.804413+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:23:13.804413+0000","last_undegraded":"2024-09-12T00:23:13.804413+0000","last_fullsized":"2024-09-12T00:23:13.804413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.804104+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.235994+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.731479+0000","last_change":"2024-09-12T00:23:21.731479+0000","last_active":"2024-09-12T00:23:21.731479+0000","last_peered":"2024-09-12T00:23:21.731479+0000","last_clean":"2024-09-12T00:23:21.731479+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:23:21.731479+0000","last_undegraded":"2024-09-12T00:23:21.731479+0000","last_fullsized":"2024-09-12T00:23:21.731479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.731300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.532025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.916522+0000","last_change":"2024-09-12T00:18:54.265367+0000","last_active":"2024-09-12T00:22:01.916522+0000","last_peered":"2024-09-12T00:22:01.916522+0000","last_clean":"2024-09-12T00:22:01.916522+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:22:01.916522+0000","last_undegraded":"2024-09-12T00:22:01.916522+0000","last_fullsized":"2024-09-12T00:22:01.916522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.935849+0000","last_change":"2024-09-12T00:22:50.935612+0000","last_active":"2024-09-12T00:22:50.935849+0000","last_peered":"2024-09-12T00:22:50.935849+0000","last_clean":"2024-09-12T00:22:50.935849+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:22:50.935849+0000","last_undegraded":"2024-09-12T00:22:50.935849+0000","last_fullsized":"2024-09-12T00:22:50.935849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.935377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:27.379599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.123005+0000","last_change":"2024-09-12T00:22:39.122842+0000","last_active":"2024-09-12T00:22:39.123005+0000","last_peered":"2024-09-12T00:22:39.123005+0000","last_clean":"2024-09-12T00:22:39.123005+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:22:39.123005+0000","last_undegraded":"2024-09-12T00:22:39.123005+0000","last_fullsized":"2024-09-12T00:22:39.123005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.122671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.081831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.755968+0000","last_change":"2024-09-12T00:22:37.755805+0000","last_active":"2024-09-12T00:22:37.755968+0000","last_peered":"2024-09-12T00:22:37.755968+0000","last_clean":"2024-09-12T00:22:37.755968+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:22:37.755968+0000","last_undegraded":"2024-09-12T00:22:37.755968+0000","last_fullsized":"2024-09-12T00:22:37.755968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.755556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:00.374036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.892359+0000","last_change":"2024-09-12T00:23:04.892359+0000","last_active":"2024-09-12T00:23:04.892359+0000","last_peered":"2024-09-12T00:23:04.892359+0000","last_clean":"2024-09-12T00:23:04.892359+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:23:04.892359+0000","last_undegraded":"2024-09-12T00:23:04.892359+0000","last_fullsized":"2024-09-12T00:23:04.892359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.892143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.673491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.012551+0000","last_change":"2024-09-12T00:23:35.012551+0000","last_active":"2024-09-12T00:23:35.012551+0000","last_peered":"2024-09-12T00:23:35.012551+0000","last_clean":"2024-09-12T00:23:35.012551+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:23:35.012551+0000","last_undegraded":"2024-09-12T00:23:35.012551+0000","last_fullsized":"2024-09-12T00:23:35.012551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.012329+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.415526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:47.985153+0000","last_change":"2024-09-12T00:23:47.985153+0000","last_active":"2024-09-12T00:23:47.985153+0000","last_peered":"2024-09-12T00:23:47.985153+0000","last_clean":"2024-09-12T00:23:47.985153+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:23:47.985153+0000","last_undegraded":"2024-09-12T00:23:47.985153+0000","last_fullsized":"2024-09-12T00:23:47.985153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:47.984943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:47.984943+0000","last_clean_scrub_stamp":"2024-09-12T00:23:47.984943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:50.037110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.235128+0000","last_change":"2024-09-12T00:23:33.235128+0000","last_active":"2024-09-12T00:23:33.235128+0000","last_peered":"2024-09-12T00:23:33.235128+0000","last_clean":"2024-09-12T00:23:33.235128+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:23:33.235128+0000","last_undegraded":"2024-09-12T00:23:33.235128+0000","last_fullsized":"2024-09-12T00:23:33.235128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.234948+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:32.748974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.391150+0000","last_change":"2024-09-12T00:22:51.390965+0000","last_active":"2024-09-12T00:22:51.391150+0000","last_peered":"2024-09-12T00:22:51.391150+0000","last_clean":"2024-09-12T00:22:51.391150+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:51.391150+0000","last_undegraded":"2024-09-12T00:22:51.391150+0000","last_fullsized":"2024-09-12T00:22:51.391150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.390779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:45.398139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.771257+0000","last_change":"2024-09-12T00:22:39.771132+0000","last_active":"2024-09-12T00:22:39.771257+0000","last_peered":"2024-09-12T00:22:39.771257+0000","last_clean":"2024-09-12T00:22:39.771257+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:22:39.771257+0000","last_undegraded":"2024-09-12T00:22:39.771257+0000","last_fullsized":"2024-09-12T00:22:39.771257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.770939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.724696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.712557+0000","last_change":"2024-09-12T00:22:38.712422+0000","last_active":"2024-09-12T00:22:38.712557+0000","last_peered":"2024-09-12T00:22:38.712557+0000","last_clean":"2024-09-12T00:22:38.712557+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:22:38.712557+0000","last_undegraded":"2024-09-12T00:22:38.712557+0000","last_fullsized":"2024-09-12T00:22:38.712557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.712222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:33.915095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.877769+0000","last_change":"2024-09-12T00:23:05.877769+0000","last_active":"2024-09-12T00:23:05.877769+0000","last_peered":"2024-09-12T00:23:05.877769+0000","last_clean":"2024-09-12T00:23:05.877769+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:23:05.877769+0000","last_undegraded":"2024-09-12T00:23:05.877769+0000","last_fullsized":"2024-09-12T00:23:05.877769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.877586+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.254000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'92","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.753759+0000","last_change":"2024-09-12T00:23:16.753759+0000","last_active":"2024-09-12T00:23:16.753759+0000","last_peered":"2024-09-12T00:23:16.753759+0000","last_clean":"2024-09-12T00:23:16.753759+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:23:16.753759+0000","last_undegraded":"2024-09-12T00:23:16.753759+0000","last_fullsized":"2024-09-12T00:23:16.753759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.753506+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.903478+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.804833+0000","last_change":"2024-09-12T00:23:19.804833+0000","last_active":"2024-09-12T00:23:19.804833+0000","last_peered":"2024-09-12T00:23:19.804833+0000","last_clean":"2024-09-12T00:23:19.804833+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:23:19.804833+0000","last_undegraded":"2024-09-12T00:23:19.804833+0000","last_fullsized":"2024-09-12T00:23:19.804833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.804652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:53.743040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.739376+0000","last_change":"2024-09-12T00:23:35.739376+0000","last_active":"2024-09-12T00:23:35.739376+0000","last_peered":"2024-09-12T00:23:35.739376+0000","last_clean":"2024-09-12T00:23:35.739376+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:23:35.739376+0000","last_undegraded":"2024-09-12T00:23:35.739376+0000","last_fullsized":"2024-09-12T00:23:35.739376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.739191+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:30.348394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.727046+0000","last_change":"2024-09-12T00:22:54.726884+0000","last_active":"2024-09-12T00:22:54.727046+0000","last_peered":"2024-09-12T00:22:54.727046+0000","last_clean":"2024-09-12T00:22:54.727046+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:22:54.727046+0000","last_undegraded":"2024-09-12T00:22:54.727046+0000","last_fullsized":"2024-09-12T00:22:54.727046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.726712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:01.342735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.855296+0000","last_change":"2024-09-12T00:22:42.855131+0000","last_active":"2024-09-12T00:22:42.855296+0000","last_peered":"2024-09-12T00:22:42.855296+0000","last_clean":"2024-09-12T00:22:42.855296+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:22:42.855296+0000","last_undegraded":"2024-09-12T00:22:42.855296+0000","last_fullsized":"2024-09-12T00:22:42.855296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.854911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.063391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.050175+0000","last_change":"2024-09-12T00:22:41.050057+0000","last_active":"2024-09-12T00:22:41.050175+0000","last_peered":"2024-09-12T00:22:41.050175+0000","last_clean":"2024-09-12T00:22:41.050175+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:22:41.050175+0000","last_undegraded":"2024-09-12T00:22:41.050175+0000","last_fullsized":"2024-09-12T00:22:41.050175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.049881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:33.601411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.928997+0000","last_change":"2024-09-12T00:23:26.928997+0000","last_active":"2024-09-12T00:23:26.928997+0000","last_peered":"2024-09-12T00:23:26.928997+0000","last_clean":"2024-09-12T00:23:26.928997+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:23:26.928997+0000","last_undegraded":"2024-09-12T00:23:26.928997+0000","last_fullsized":"2024-09-12T00:23:26.928997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.928808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:06.461175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.296031+0000","last_change":"2024-09-12T00:23:19.296031+0000","last_active":"2024-09-12T00:23:19.296031+0000","last_peered":"2024-09-12T00:23:19.296031+0000","last_clean":"2024-09-12T00:23:19.296031+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:23:19.296031+0000","last_undegraded":"2024-09-12T00:23:19.296031+0000","last_fullsized":"2024-09-12T00:23:19.296031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.295840+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.390911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'286","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.131018+0000","last_change":"2024-09-12T00:23:25.131018+0000","last_active":"2024-09-12T00:23:25.131018+0000","last_peered":"2024-09-12T00:23:25.131018+0000","last_clean":"2024-09-12T00:23:25.131018+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:23:25.131018+0000","last_undegraded":"2024-09-12T00:23:25.131018+0000","last_fullsized":"2024-09-12T00:23:25.131018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.130835+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:22.948498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:54.860254+0000","last_change":"2024-09-12T00:23:54.860254+0000","last_active":"2024-09-12T00:23:54.860254+0000","last_peered":"2024-09-12T00:23:54.860254+0000","last_clean":"2024-09-12T00:23:54.860254+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:23:54.860254+0000","last_undegraded":"2024-09-12T00:23:54.860254+0000","last_fullsized":"2024-09-12T00:23:54.860254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:54.860049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:54.860049+0000","last_clean_scrub_stamp":"2024-09-12T00:23:54.860049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:03.083609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.162564+0000","last_change":"2024-09-12T00:23:05.162564+0000","last_active":"2024-09-12T00:23:05.162564+0000","last_peered":"2024-09-12T00:23:05.162564+0000","last_clean":"2024-09-12T00:23:05.162564+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:23:05.162564+0000","last_undegraded":"2024-09-12T00:23:05.162564+0000","last_fullsized":"2024-09-12T00:23:05.162564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.162392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:00.470991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.058734+0000","last_change":"2024-09-12T00:22:44.058569+0000","last_active":"2024-09-12T00:22:44.058734+0000","last_peered":"2024-09-12T00:22:44.058734+0000","last_clean":"2024-09-12T00:22:44.058734+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:44.058734+0000","last_undegraded":"2024-09-12T00:22:44.058734+0000","last_fullsized":"2024-09-12T00:22:44.058734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.058384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.669388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.675883+0000","last_change":"2024-09-12T00:22:37.675755+0000","last_active":"2024-09-12T00:22:37.675883+0000","last_peered":"2024-09-12T00:22:37.675883+0000","last_clean":"2024-09-12T00:22:37.675883+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:22:37.675883+0000","last_undegraded":"2024-09-12T00:22:37.675883+0000","last_fullsized":"2024-09-12T00:22:37.675883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.675639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:18.021676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.900291+0000","last_change":"2024-09-12T00:23:25.900291+0000","last_active":"2024-09-12T00:23:25.900291+0000","last_peered":"2024-09-12T00:23:25.900291+0000","last_clean":"2024-09-12T00:23:25.900291+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:23:25.900291+0000","last_undegraded":"2024-09-12T00:23:25.900291+0000","last_fullsized":"2024-09-12T00:23:25.900291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.900079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.980753+0000","last_change":"2024-09-12T00:23:33.980753+0000","last_active":"2024-09-12T00:23:33.980753+0000","last_peered":"2024-09-12T00:23:33.980753+0000","last_clean":"2024-09-12T00:23:33.980753+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:23:33.980753+0000","last_undegraded":"2024-09-12T00:23:33.980753+0000","last_fullsized":"2024-09-12T00:23:33.980753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.980516+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:23.601865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'286","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.693953+0000","last_change":"2024-09-12T00:23:19.693953+0000","last_active":"2024-09-12T00:23:19.693953+0000","last_peered":"2024-09-12T00:23:19.693953+0000","last_clean":"2024-09-12T00:23:19.693953+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:23:19.693953+0000","last_undegraded":"2024-09-12T00:23:19.693953+0000","last_fullsized":"2024-09-12T00:23:19.693953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.693733+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.161540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.250239+0000","last_change":"2024-09-12T00:23:35.250239+0000","last_active":"2024-09-12T00:23:35.250239+0000","last_peered":"2024-09-12T00:23:35.250239+0000","last_clean":"2024-09-12T00:23:35.250239+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:23:35.250239+0000","last_undegraded":"2024-09-12T00:23:35.250239+0000","last_fullsized":"2024-09-12T00:23:35.250239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.249999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:43.231307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.751001+0000","last_change":"2024-09-12T00:22:52.750826+0000","last_active":"2024-09-12T00:22:52.751001+0000","last_peered":"2024-09-12T00:22:52.751001+0000","last_clean":"2024-09-12T00:22:52.751001+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:52.751001+0000","last_undegraded":"2024-09-12T00:22:52.751001+0000","last_fullsized":"2024-09-12T00:22:52.751001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.750640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:43.087670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.284791+0000","last_change":"2024-09-12T00:22:37.284618+0000","last_active":"2024-09-12T00:22:37.284791+0000","last_peered":"2024-09-12T00:22:37.284791+0000","last_clean":"2024-09-12T00:22:37.284791+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:22:37.284791+0000","last_undegraded":"2024-09-12T00:22:37.284791+0000","last_fullsized":"2024-09-12T00:22:37.284791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.284374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:35.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.021196+0000","last_change":"2024-09-12T00:22:42.021039+0000","last_active":"2024-09-12T00:22:42.021196+0000","last_peered":"2024-09-12T00:22:42.021196+0000","last_clean":"2024-09-12T00:22:42.021196+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:22:42.021196+0000","last_undegraded":"2024-09-12T00:22:42.021196+0000","last_fullsized":"2024-09-12T00:22:42.021196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.020861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:34.147473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'5","reported_seq":239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.878785+0000","last_change":"2024-09-12T00:23:24.878785+0000","last_active":"2024-09-12T00:23:24.878785+0000","last_peered":"2024-09-12T00:23:24.878785+0000","last_clean":"2024-09-12T00:23:24.878785+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:23:24.878785+0000","last_undegraded":"2024-09-12T00:23:24.878785+0000","last_fullsized":"2024-09-12T00:23:24.878785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.878599+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:51.060676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'107","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.815851+0000","last_change":"2024-09-12T00:23:12.815851+0000","last_active":"2024-09-12T00:23:12.815851+0000","last_peered":"2024-09-12T00:23:12.815851+0000","last_clean":"2024-09-12T00:23:12.815851+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:23:12.815851+0000","last_undegraded":"2024-09-12T00:23:12.815851+0000","last_fullsized":"2024-09-12T00:23:12.815851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'107","last_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_deep_scrub":"33'107","last_deep_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.815651+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:02.753655+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.715268+0000","last_change":"2024-09-12T00:23:17.715268+0000","last_active":"2024-09-12T00:23:17.715268+0000","last_peered":"2024-09-12T00:23:17.715268+0000","last_clean":"2024-09-12T00:23:17.715268+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:23:17.715268+0000","last_undegraded":"2024-09-12T00:23:17.715268+0000","last_fullsized":"2024-09-12T00:23:17.715268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.715091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:21.810163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.762359+0000","last_change":"2024-09-12T00:23:29.762359+0000","last_active":"2024-09-12T00:23:29.762359+0000","last_peered":"2024-09-12T00:23:29.762359+0000","last_clean":"2024-09-12T00:23:29.762359+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:23:29.762359+0000","last_undegraded":"2024-09-12T00:23:29.762359+0000","last_fullsized":"2024-09-12T00:23:29.762359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.762179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:07.284762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.727111+0000","last_change":"2024-09-12T00:23:31.727111+0000","last_active":"2024-09-12T00:23:31.727111+0000","last_peered":"2024-09-12T00:23:31.727111+0000","last_clean":"2024-09-12T00:23:31.727111+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:23:31.727111+0000","last_undegraded":"2024-09-12T00:23:31.727111+0000","last_fullsized":"2024-09-12T00:23:31.727111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.726920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:28.958312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.736232+0000","last_change":"2024-09-12T00:22:58.736086+0000","last_active":"2024-09-12T00:22:58.736232+0000","last_peered":"2024-09-12T00:22:58.736232+0000","last_clean":"2024-09-12T00:22:58.736232+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:58.736232+0000","last_undegraded":"2024-09-12T00:22:58.736232+0000","last_fullsized":"2024-09-12T00:22:58.736232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.735904+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.200548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.010021+0000","last_change":"2024-09-12T00:22:52.009865+0000","last_active":"2024-09-12T00:22:52.010021+0000","last_peered":"2024-09-12T00:22:52.010021+0000","last_clean":"2024-09-12T00:22:52.010021+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:22:52.010021+0000","last_undegraded":"2024-09-12T00:22:52.010021+0000","last_fullsized":"2024-09-12T00:22:52.010021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.009684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.867922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.391648+0000","last_change":"2024-09-12T00:23:13.391496+0000","last_active":"2024-09-12T00:23:13.391648+0000","last_peered":"2024-09-12T00:23:13.391648+0000","last_clean":"2024-09-12T00:23:13.391648+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:23:13.391648+0000","last_undegraded":"2024-09-12T00:23:13.391648+0000","last_fullsized":"2024-09-12T00:23:13.391648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.391315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:03.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:39.983811+0000","last_change":"2024-09-12T00:23:39.983811+0000","last_active":"2024-09-12T00:23:39.983811+0000","last_peered":"2024-09-12T00:23:39.983811+0000","last_clean":"2024-09-12T00:23:39.983811+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:23:39.983811+0000","last_undegraded":"2024-09-12T00:23:39.983811+0000","last_fullsized":"2024-09-12T00:23:39.983811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:39.983623+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:39.983623+0000","last_clean_scrub_stamp":"2024-09-12T00:23:39.983623+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:35.039199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:49.946010+0000","last_change":"2024-09-12T00:23:49.946010+0000","last_active":"2024-09-12T00:23:49.946010+0000","last_peered":"2024-09-12T00:23:49.946010+0000","last_clean":"2024-09-12T00:23:49.946010+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:23:49.946010+0000","last_undegraded":"2024-09-12T00:23:49.946010+0000","last_fullsized":"2024-09-12T00:23:49.946010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:49.945832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:49.945832+0000","last_clean_scrub_stamp":"2024-09-12T00:23:49.945832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.743364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.781322+0000","last_change":"2024-09-12T00:23:36.781322+0000","last_active":"2024-09-12T00:23:36.781322+0000","last_peered":"2024-09-12T00:23:36.781322+0000","last_clean":"2024-09-12T00:23:36.781322+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:23:36.781322+0000","last_undegraded":"2024-09-12T00:23:36.781322+0000","last_fullsized":"2024-09-12T00:23:36.781322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.781142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:38.074240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.391756+0000","last_change":"2024-09-12T00:22:58.391625+0000","last_active":"2024-09-12T00:22:58.391756+0000","last_peered":"2024-09-12T00:22:58.391756+0000","last_clean":"2024-09-12T00:22:58.391756+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:58.391756+0000","last_undegraded":"2024-09-12T00:22:58.391756+0000","last_fullsized":"2024-09-12T00:22:58.391756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.391445+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.604030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.779442+0000","last_change":"2024-09-12T00:22:42.779281+0000","last_active":"2024-09-12T00:22:42.779442+0000","last_peered":"2024-09-12T00:22:42.779442+0000","last_clean":"2024-09-12T00:22:42.779442+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:22:42.779442+0000","last_undegraded":"2024-09-12T00:22:42.779442+0000","last_fullsized":"2024-09-12T00:22:42.779442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.779092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.713311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.990753+0000","last_change":"2024-09-12T00:23:30.990753+0000","last_active":"2024-09-12T00:23:30.990753+0000","last_peered":"2024-09-12T00:23:30.990753+0000","last_clean":"2024-09-12T00:23:30.990753+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:23:30.990753+0000","last_undegraded":"2024-09-12T00:23:30.990753+0000","last_fullsized":"2024-09-12T00:23:30.990753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.990569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.843256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.690110+0000","last_change":"2024-09-12T00:23:20.689939+0000","last_active":"2024-09-12T00:23:20.690110+0000","last_peered":"2024-09-12T00:23:20.690110+0000","last_clean":"2024-09-12T00:23:20.690110+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:23:20.690110+0000","last_undegraded":"2024-09-12T00:23:20.690110+0000","last_fullsized":"2024-09-12T00:23:20.690110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.689752+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:32.818163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.846425+0000","last_change":"2024-09-12T00:23:20.846280+0000","last_active":"2024-09-12T00:23:20.846425+0000","last_peered":"2024-09-12T00:23:20.846425+0000","last_clean":"2024-09-12T00:23:20.846425+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:23:20.846425+0000","last_undegraded":"2024-09-12T00:23:20.846425+0000","last_fullsized":"2024-09-12T00:23:20.846425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.846099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:42.175845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.750335+0000","last_change":"2024-09-12T00:23:38.750189+0000","last_active":"2024-09-12T00:23:38.750335+0000","last_peered":"2024-09-12T00:23:38.750335+0000","last_clean":"2024-09-12T00:23:38.750335+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:23:38.750335+0000","last_undegraded":"2024-09-12T00:23:38.750335+0000","last_fullsized":"2024-09-12T00:23:38.750335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:38.750002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:38.750002+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.750002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:47.845320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.942888+0000","last_change":"2024-09-12T00:22:54.942747+0000","last_active":"2024-09-12T00:22:54.942888+0000","last_peered":"2024-09-12T00:22:54.942888+0000","last_clean":"2024-09-12T00:22:54.942888+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:54.942888+0000","last_undegraded":"2024-09-12T00:22:54.942888+0000","last_fullsized":"2024-09-12T00:22:54.942888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.942553+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:15.834853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.806447+0000","last_change":"2024-09-12T00:22:44.806286+0000","last_active":"2024-09-12T00:22:44.806447+0000","last_peered":"2024-09-12T00:22:44.806447+0000","last_clean":"2024-09-12T00:22:44.806447+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:22:44.806447+0000","last_undegraded":"2024-09-12T00:22:44.806447+0000","last_fullsized":"2024-09-12T00:22:44.806447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.806101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.067872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.696548+0000","last_change":"2024-09-12T00:23:08.696289+0000","last_active":"2024-09-12T00:23:08.696548+0000","last_peered":"2024-09-12T00:23:08.696548+0000","last_clean":"2024-09-12T00:23:08.696548+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:23:08.696548+0000","last_undegraded":"2024-09-12T00:23:08.696548+0000","last_fullsized":"2024-09-12T00:23:08.696548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.696055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'51","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.851527+0000","last_change":"2024-09-12T00:23:12.851378+0000","last_active":"2024-09-12T00:23:12.851527+0000","last_peered":"2024-09-12T00:23:12.851527+0000","last_clean":"2024-09-12T00:23:12.851527+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:23:12.851527+0000","last_undegraded":"2024-09-12T00:23:12.851527+0000","last_fullsized":"2024-09-12T00:23:12.851527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.851186+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:10.082578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.120229+0000","last_change":"2024-09-12T00:23:27.120097+0000","last_active":"2024-09-12T00:23:27.120229+0000","last_peered":"2024-09-12T00:23:27.120229+0000","last_clean":"2024-09-12T00:23:27.120229+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:23:27.120229+0000","last_undegraded":"2024-09-12T00:23:27.120229+0000","last_fullsized":"2024-09-12T00:23:27.120229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.119923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.850332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:27.614501+0000","last_change":"2024-09-12T00:18:54.285039+0000","last_active":"2024-09-12T00:21:27.614501+0000","last_peered":"2024-09-12T00:21:27.614501+0000","last_clean":"2024-09-12T00:21:27.614501+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:21:27.614501+0000","last_undegraded":"2024-09-12T00:21:27.614501+0000","last_fullsized":"2024-09-12T00:21:27.614501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.990198+0000","last_change":"2024-09-12T00:23:10.990006+0000","last_active":"2024-09-12T00:23:10.990198+0000","last_peered":"2024-09-12T00:23:10.990198+0000","last_clean":"2024-09-12T00:23:10.990198+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:23:10.990198+0000","last_undegraded":"2024-09-12T00:23:10.990198+0000","last_fullsized":"2024-09-12T00:23:10.990198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.989822+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:55.630091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.300825+0000","last_change":"2024-09-12T00:22:39.300694+0000","last_active":"2024-09-12T00:22:39.300825+0000","last_peered":"2024-09-12T00:22:39.300825+0000","last_clean":"2024-09-12T00:22:39.300825+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:39.300825+0000","last_undegraded":"2024-09-12T00:22:39.300825+0000","last_fullsized":"2024-09-12T00:22:39.300825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.300502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:21.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.987296+0000","last_change":"2024-09-12T00:23:28.987296+0000","last_active":"2024-09-12T00:23:28.987296+0000","last_peered":"2024-09-12T00:23:28.987296+0000","last_clean":"2024-09-12T00:23:28.987296+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:23:28.987296+0000","last_undegraded":"2024-09-12T00:23:28.987296+0000","last_fullsized":"2024-09-12T00:23:28.987296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.987116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.128553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.718980+0000","last_change":"2024-09-12T00:23:16.718828+0000","last_active":"2024-09-12T00:23:16.718980+0000","last_peered":"2024-09-12T00:23:16.718980+0000","last_clean":"2024-09-12T00:23:16.718980+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:23:16.718980+0000","last_undegraded":"2024-09-12T00:23:16.718980+0000","last_fullsized":"2024-09-12T00:23:16.718980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.718625+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.155804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.756383+0000","last_change":"2024-09-12T00:23:23.756222+0000","last_active":"2024-09-12T00:23:23.756383+0000","last_peered":"2024-09-12T00:23:23.756383+0000","last_clean":"2024-09-12T00:23:23.756383+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:23:23.756383+0000","last_undegraded":"2024-09-12T00:23:23.756383+0000","last_fullsized":"2024-09-12T00:23:23.756383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.756031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.537379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.925830+0000","last_change":"2024-09-12T00:23:15.925830+0000","last_active":"2024-09-12T00:23:15.925830+0000","last_peered":"2024-09-12T00:23:15.925830+0000","last_clean":"2024-09-12T00:23:15.925830+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:23:15.925830+0000","last_undegraded":"2024-09-12T00:23:15.925830+0000","last_fullsized":"2024-09-12T00:23:15.925830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.925622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.066023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.035250+0000","last_change":"2024-09-12T00:22:53.034956+0000","last_active":"2024-09-12T00:22:53.035250+0000","last_peered":"2024-09-12T00:22:53.035250+0000","last_clean":"2024-09-12T00:22:53.035250+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:22:53.035250+0000","last_undegraded":"2024-09-12T00:22:53.035250+0000","last_fullsized":"2024-09-12T00:22:53.035250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.034651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:57.265344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.726656+0000","last_change":"2024-09-12T00:23:18.726656+0000","last_active":"2024-09-12T00:23:18.726656+0000","last_peered":"2024-09-12T00:23:18.726656+0000","last_clean":"2024-09-12T00:23:18.726656+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:23:18.726656+0000","last_undegraded":"2024-09-12T00:23:18.726656+0000","last_fullsized":"2024-09-12T00:23:18.726656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.726384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:15.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'72","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.816302+0000","last_change":"2024-09-12T00:23:13.815989+0000","last_active":"2024-09-12T00:23:13.816302+0000","last_peered":"2024-09-12T00:23:13.816302+0000","last_clean":"2024-09-12T00:23:13.816302+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:23:13.816302+0000","last_undegraded":"2024-09-12T00:23:13.816302+0000","last_fullsized":"2024-09-12T00:23:13.816302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.815744+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:18.956083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.773675+0000","last_change":"2024-09-12T00:23:25.773527+0000","last_active":"2024-09-12T00:23:25.773675+0000","last_peered":"2024-09-12T00:23:25.773675+0000","last_clean":"2024-09-12T00:23:25.773675+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:23:25.773675+0000","last_undegraded":"2024-09-12T00:23:25.773675+0000","last_fullsized":"2024-09-12T00:23:25.773675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.773341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.853684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.767983+0000","last_change":"2024-09-12T00:23:31.767728+0000","last_active":"2024-09-12T00:23:31.767983+0000","last_peered":"2024-09-12T00:23:31.767983+0000","last_clean":"2024-09-12T00:23:31.767983+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:23:31.767983+0000","last_undegraded":"2024-09-12T00:23:31.767983+0000","last_fullsized":"2024-09-12T00:23:31.767983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.767491+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:31.281516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'16","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.878714+0000","last_change":"2024-09-12T00:23:03.878714+0000","last_active":"2024-09-12T00:23:03.878714+0000","last_peered":"2024-09-12T00:23:03.878714+0000","last_clean":"2024-09-12T00:23:03.878714+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:23:03.878714+0000","last_undegraded":"2024-09-12T00:23:03.878714+0000","last_fullsized":"2024-09-12T00:23:03.878714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.878512+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:25.214968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.306296+0000","last_change":"2024-09-12T00:22:40.306113+0000","last_active":"2024-09-12T00:22:40.306296+0000","last_peered":"2024-09-12T00:22:40.306296+0000","last_clean":"2024-09-12T00:22:40.306296+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:22:40.306296+0000","last_undegraded":"2024-09-12T00:22:40.306296+0000","last_fullsized":"2024-09-12T00:22:40.306296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.305907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.508780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.794996+0000","last_change":"2024-09-12T00:23:11.794996+0000","last_active":"2024-09-12T00:23:11.794996+0000","last_peered":"2024-09-12T00:23:11.794996+0000","last_clean":"2024-09-12T00:23:11.794996+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:23:11.794996+0000","last_undegraded":"2024-09-12T00:23:11.794996+0000","last_fullsized":"2024-09-12T00:23:11.794996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.794802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.268181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:42.956627+0000","last_change":"2024-09-12T00:23:42.956461+0000","last_active":"2024-09-12T00:23:42.956627+0000","last_peered":"2024-09-12T00:23:42.956627+0000","last_clean":"2024-09-12T00:23:42.956627+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:23:42.956627+0000","last_undegraded":"2024-09-12T00:23:42.956627+0000","last_fullsized":"2024-09-12T00:23:42.956627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:42.956256+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:42.956256+0000","last_clean_scrub_stamp":"2024-09-12T00:23:42.956256+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.069611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.218317+0000","last_change":"2024-09-12T00:23:30.218191+0000","last_active":"2024-09-12T00:23:30.218317+0000","last_peered":"2024-09-12T00:23:30.218317+0000","last_clean":"2024-09-12T00:23:30.218317+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:23:30.218317+0000","last_undegraded":"2024-09-12T00:23:30.218317+0000","last_fullsized":"2024-09-12T00:23:30.218317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.218010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:35.490956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.611972+0000","last_change":"2024-09-12T00:18:54.266390+0000","last_active":"2024-09-12T00:21:17.611972+0000","last_peered":"2024-09-12T00:21:17.611972+0000","last_clean":"2024-09-12T00:21:17.611972+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:21:17.611972+0000","last_undegraded":"2024-09-12T00:21:17.611972+0000","last_fullsized":"2024-09-12T00:21:17.611972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.923017+0000","last_change":"2024-09-12T00:23:14.922836+0000","last_active":"2024-09-12T00:23:14.923017+0000","last_peered":"2024-09-12T00:23:14.923017+0000","last_clean":"2024-09-12T00:23:14.923017+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:23:14.923017+0000","last_undegraded":"2024-09-12T00:23:14.923017+0000","last_fullsized":"2024-09-12T00:23:14.923017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.922649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:06.834122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.386150+0000","last_change":"2024-09-12T00:22:42.385967+0000","last_active":"2024-09-12T00:22:42.386150+0000","last_peered":"2024-09-12T00:22:42.386150+0000","last_clean":"2024-09-12T00:22:42.386150+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:22:42.386150+0000","last_undegraded":"2024-09-12T00:22:42.386150+0000","last_fullsized":"2024-09-12T00:22:42.386150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.385774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:36.864966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.762576+0000","last_change":"2024-09-12T00:23:10.762434+0000","last_active":"2024-09-12T00:23:10.762576+0000","last_peered":"2024-09-12T00:23:10.762576+0000","last_clean":"2024-09-12T00:23:10.762576+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:23:10.762576+0000","last_undegraded":"2024-09-12T00:23:10.762576+0000","last_fullsized":"2024-09-12T00:23:10.762576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.762259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:08.326149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.850131+0000","last_change":"2024-09-12T00:23:11.850131+0000","last_active":"2024-09-12T00:23:11.850131+0000","last_peered":"2024-09-12T00:23:11.850131+0000","last_clean":"2024-09-12T00:23:11.850131+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:23:11.850131+0000","last_undegraded":"2024-09-12T00:23:11.850131+0000","last_fullsized":"2024-09-12T00:23:11.850131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.849946+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.522162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.733709+0000","last_change":"2024-09-12T00:23:30.733709+0000","last_active":"2024-09-12T00:23:30.733709+0000","last_peered":"2024-09-12T00:23:30.733709+0000","last_clean":"2024-09-12T00:23:30.733709+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:23:30.733709+0000","last_undegraded":"2024-09-12T00:23:30.733709+0000","last_fullsized":"2024-09-12T00:23:30.733709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.733523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:25.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:55.860397+0000","last_change":"2024-09-12T00:23:55.860397+0000","last_active":"2024-09-12T00:23:55.860397+0000","last_peered":"2024-09-12T00:23:55.860397+0000","last_clean":"2024-09-12T00:23:55.860397+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:23:55.860397+0000","last_undegraded":"2024-09-12T00:23:55.860397+0000","last_fullsized":"2024-09-12T00:23:55.860397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:55.860149+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:55.860149+0000","last_clean_scrub_stamp":"2024-09-12T00:23:55.860149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:48.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.937126+0000","last_change":"2024-09-12T00:22:55.936957+0000","last_active":"2024-09-12T00:22:55.937126+0000","last_peered":"2024-09-12T00:22:55.937126+0000","last_clean":"2024-09-12T00:22:55.937126+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:55.937126+0000","last_undegraded":"2024-09-12T00:22:55.937126+0000","last_fullsized":"2024-09-12T00:22:55.937126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.936751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.262382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.067615+0000","last_change":"2024-09-12T00:22:54.067458+0000","last_active":"2024-09-12T00:22:54.067615+0000","last_peered":"2024-09-12T00:22:54.067615+0000","last_clean":"2024-09-12T00:22:54.067615+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:22:54.067615+0000","last_undegraded":"2024-09-12T00:22:54.067615+0000","last_fullsized":"2024-09-12T00:22:54.067615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.067268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:29.961955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.295716+0000","last_change":"2024-09-12T00:23:18.295563+0000","last_active":"2024-09-12T00:23:18.295716+0000","last_peered":"2024-09-12T00:23:18.295716+0000","last_clean":"2024-09-12T00:23:18.295716+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:23:18.295716+0000","last_undegraded":"2024-09-12T00:23:18.295716+0000","last_fullsized":"2024-09-12T00:23:18.295716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.295354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:33.445325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:45.990923+0000","last_change":"2024-09-12T00:23:45.990923+0000","last_active":"2024-09-12T00:23:45.990923+0000","last_peered":"2024-09-12T00:23:45.990923+0000","last_clean":"2024-09-12T00:23:45.990923+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:23:45.990923+0000","last_undegraded":"2024-09-12T00:23:45.990923+0000","last_fullsized":"2024-09-12T00:23:45.990923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:45.990711+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:45.990711+0000","last_clean_scrub_stamp":"2024-09-12T00:23:45.990711+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:27.243594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'286","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.742825+0000","last_change":"2024-09-12T00:23:24.742825+0000","last_active":"2024-09-12T00:23:24.742825+0000","last_peered":"2024-09-12T00:23:24.742825+0000","last_clean":"2024-09-12T00:23:24.742825+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:23:24.742825+0000","last_undegraded":"2024-09-12T00:23:24.742825+0000","last_fullsized":"2024-09-12T00:23:24.742825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.742581+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:14.118995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:56.835246+0000","last_change":"2024-09-12T00:23:56.835246+0000","last_active":"2024-09-12T00:23:56.835246+0000","last_peered":"2024-09-12T00:23:56.835246+0000","last_clean":"2024-09-12T00:23:56.835246+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:23:56.835246+0000","last_undegraded":"2024-09-12T00:23:56.835246+0000","last_fullsized":"2024-09-12T00:23:56.835246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:56.835034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:56.835034+0000","last_clean_scrub_stamp":"2024-09-12T00:23:56.835034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.031747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.692151+0000","last_change":"2024-09-12T00:23:01.691998+0000","last_active":"2024-09-12T00:23:01.692151+0000","last_peered":"2024-09-12T00:23:01.692151+0000","last_clean":"2024-09-12T00:23:01.692151+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:23:01.692151+0000","last_undegraded":"2024-09-12T00:23:01.692151+0000","last_fullsized":"2024-09-12T00:23:01.692151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.691825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.900305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.393313+0000","last_change":"2024-09-12T00:22:43.393154+0000","last_active":"2024-09-12T00:22:43.393313+0000","last_peered":"2024-09-12T00:22:43.393313+0000","last_clean":"2024-09-12T00:22:43.393313+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:22:43.393313+0000","last_undegraded":"2024-09-12T00:22:43.393313+0000","last_fullsized":"2024-09-12T00:22:43.393313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.392968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:10.459069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.295089+0000","last_change":"2024-09-12T00:23:17.294939+0000","last_active":"2024-09-12T00:23:17.295089+0000","last_peered":"2024-09-12T00:23:17.295089+0000","last_clean":"2024-09-12T00:23:17.295089+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:23:17.295089+0000","last_undegraded":"2024-09-12T00:23:17.295089+0000","last_fullsized":"2024-09-12T00:23:17.295089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.294701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.708016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'77","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.149596+0000","last_change":"2024-09-12T00:23:24.149463+0000","last_active":"2024-09-12T00:23:24.149596+0000","last_peered":"2024-09-12T00:23:24.149596+0000","last_clean":"2024-09-12T00:23:24.149596+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:23:24.149596+0000","last_undegraded":"2024-09-12T00:23:24.149596+0000","last_fullsized":"2024-09-12T00:23:24.149596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'77","last_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_deep_scrub":"33'77","last_deep_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.149240+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:59.010159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.735509+0000","last_change":"2024-09-12T00:23:26.735232+0000","last_active":"2024-09-12T00:23:26.735509+0000","last_peered":"2024-09-12T00:23:26.735509+0000","last_clean":"2024-09-12T00:23:26.735509+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:23:26.735509+0000","last_undegraded":"2024-09-12T00:23:26.735509+0000","last_fullsized":"2024-09-12T00:23:26.735509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.735014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:59.610604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.278119+0000","last_change":"2024-09-12T00:23:36.277960+0000","last_active":"2024-09-12T00:23:36.278119+0000","last_peered":"2024-09-12T00:23:36.278119+0000","last_clean":"2024-09-12T00:23:36.278119+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:23:36.278119+0000","last_undegraded":"2024-09-12T00:23:36.278119+0000","last_fullsized":"2024-09-12T00:23:36.278119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.277772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:33.069312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.686706+0000","last_change":"2024-09-12T00:23:00.686548+0000","last_active":"2024-09-12T00:23:00.686706+0000","last_peered":"2024-09-12T00:23:00.686706+0000","last_clean":"2024-09-12T00:23:00.686706+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:23:00.686706+0000","last_undegraded":"2024-09-12T00:23:00.686706+0000","last_fullsized":"2024-09-12T00:23:00.686706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.686366+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:12.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.088956+0000","last_change":"2024-09-12T00:22:55.088790+0000","last_active":"2024-09-12T00:22:55.088956+0000","last_peered":"2024-09-12T00:22:55.088956+0000","last_clean":"2024-09-12T00:22:55.088956+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:55.088956+0000","last_undegraded":"2024-09-12T00:22:55.088956+0000","last_fullsized":"2024-09-12T00:22:55.088956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.088613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:30.497345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.719573+0000","last_change":"2024-09-12T00:23:09.719313+0000","last_active":"2024-09-12T00:23:09.719573+0000","last_peered":"2024-09-12T00:23:09.719573+0000","last_clean":"2024-09-12T00:23:09.719573+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:23:09.719573+0000","last_undegraded":"2024-09-12T00:23:09.719573+0000","last_fullsized":"2024-09-12T00:23:09.719573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.719094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.163316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'45","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.713801+0000","last_change":"2024-09-12T00:23:22.713647+0000","last_active":"2024-09-12T00:23:22.713801+0000","last_peered":"2024-09-12T00:23:22.713801+0000","last_clean":"2024-09-12T00:23:22.713801+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:23:22.713801+0000","last_undegraded":"2024-09-12T00:23:22.713801+0000","last_fullsized":"2024-09-12T00:23:22.713801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.713460+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:57.574379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:51.867674+0000","last_change":"2024-09-12T00:23:51.867674+0000","last_active":"2024-09-12T00:23:51.867674+0000","last_peered":"2024-09-12T00:23:51.867674+0000","last_clean":"2024-09-12T00:23:51.867674+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:23:51.867674+0000","last_undegraded":"2024-09-12T00:23:51.867674+0000","last_fullsized":"2024-09-12T00:23:51.867674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:51.867500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:51.867500+0000","last_clean_scrub_stamp":"2024-09-12T00:23:51.867500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.243666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:22.613426+0000","last_change":"2024-09-12T00:18:54.283038+0000","last_active":"2024-09-12T00:21:22.613426+0000","last_peered":"2024-09-12T00:21:22.613426+0000","last_clean":"2024-09-12T00:21:22.613426+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:21:22.613426+0000","last_undegraded":"2024-09-12T00:21:22.613426+0000","last_fullsized":"2024-09-12T00:21:22.613426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.976506+0000","last_change":"2024-09-12T00:23:11.976316+0000","last_active":"2024-09-12T00:23:11.976506+0000","last_peered":"2024-09-12T00:23:11.976506+0000","last_clean":"2024-09-12T00:23:11.976506+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:23:11.976506+0000","last_undegraded":"2024-09-12T00:23:11.976506+0000","last_fullsized":"2024-09-12T00:23:11.976506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.976131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:32.650876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.782465+0000","last_change":"2024-09-12T00:22:40.782298+0000","last_active":"2024-09-12T00:22:40.782465+0000","last_peered":"2024-09-12T00:22:40.782465+0000","last_clean":"2024-09-12T00:22:40.782465+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:22:40.782465+0000","last_undegraded":"2024-09-12T00:22:40.782465+0000","last_fullsized":"2024-09-12T00:22:40.782465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.782108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.669423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.332073+0000","last_change":"2024-09-12T00:23:15.331937+0000","last_active":"2024-09-12T00:23:15.332073+0000","last_peered":"2024-09-12T00:23:15.332073+0000","last_clean":"2024-09-12T00:23:15.332073+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:23:15.332073+0000","last_undegraded":"2024-09-12T00:23:15.332073+0000","last_fullsized":"2024-09-12T00:23:15.332073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.331763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:20.472102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'38","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:43.999901+0000","last_change":"2024-09-12T00:23:43.999764+0000","last_active":"2024-09-12T00:23:43.999901+0000","last_peered":"2024-09-12T00:23:43.999901+0000","last_clean":"2024-09-12T00:23:43.999901+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:23:43.999901+0000","last_undegraded":"2024-09-12T00:23:43.999901+0000","last_fullsized":"2024-09-12T00:23:43.999901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-12T00:23:43.999565+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-12T00:23:43.999565+0000","last_clean_scrub_stamp":"2024-09-12T00:23:43.999565+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:18.775778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:53.901619+0000","last_change":"2024-09-12T00:23:53.901619+0000","last_active":"2024-09-12T00:23:53.901619+0000","last_peered":"2024-09-12T00:23:53.901619+0000","last_clean":"2024-09-12T00:23:53.901619+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:23:53.901619+0000","last_undegraded":"2024-09-12T00:23:53.901619+0000","last_fullsized":"2024-09-12T00:23:53.901619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:53.901391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:53.901391+0000","last_clean_scrub_stamp":"2024-09-12T00:23:53.901391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:57.638214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:01.537145+0000","last_change":"2024-09-12T00:18:54.282328+0000","last_active":"2024-09-12T00:22:01.537145+0000","last_peered":"2024-09-12T00:22:01.537145+0000","last_clean":"2024-09-12T00:22:01.537145+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:22:01.537145+0000","last_undegraded":"2024-09-12T00:22:01.537145+0000","last_fullsized":"2024-09-12T00:22:01.537145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.718868+0000","last_change":"2024-09-12T00:22:59.718700+0000","last_active":"2024-09-12T00:22:59.718868+0000","last_peered":"2024-09-12T00:22:59.718868+0000","last_clean":"2024-09-12T00:22:59.718868+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:59.718868+0000","last_undegraded":"2024-09-12T00:22:59.718868+0000","last_fullsized":"2024-09-12T00:22:59.718868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.718519+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:09.605835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.419905+0000","last_change":"2024-09-12T00:22:44.419775+0000","last_active":"2024-09-12T00:22:44.419905+0000","last_peered":"2024-09-12T00:22:44.419905+0000","last_clean":"2024-09-12T00:22:44.419905+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:22:44.419905+0000","last_undegraded":"2024-09-12T00:22:44.419905+0000","last_fullsized":"2024-09-12T00:22:44.419905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.419592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:33.207405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.321004+0000","last_change":"2024-09-12T00:23:16.320735+0000","last_active":"2024-09-12T00:23:16.321004+0000","last_peered":"2024-09-12T00:23:16.321004+0000","last_clean":"2024-09-12T00:23:16.321004+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:23:16.321004+0000","last_undegraded":"2024-09-12T00:23:16.321004+0000","last_fullsized":"2024-09-12T00:23:16.321004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.320511+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:44.404081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'54","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:41.989314+0000","last_change":"2024-09-12T00:23:41.989133+0000","last_active":"2024-09-12T00:23:41.989314+0000","last_peered":"2024-09-12T00:23:41.989314+0000","last_clean":"2024-09-12T00:23:41.989314+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:23:41.989314+0000","last_undegraded":"2024-09-12T00:23:41.989314+0000","last_fullsized":"2024-09-12T00:23:41.989314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'54","last_scrub_stamp":"2024-09-12T00:23:41.988920+0000","last_deep_scrub":"33'54","last_deep_scrub_stamp":"2024-09-12T00:23:41.988920+0000","last_clean_scrub_stamp":"2024-09-12T00:23:41.988920+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:00.613451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.716517+0000","last_change":"2024-09-12T00:23:27.716235+0000","last_active":"2024-09-12T00:23:27.716517+0000","last_peered":"2024-09-12T00:23:27.716517+0000","last_clean":"2024-09-12T00:23:27.716517+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:23:27.716517+0000","last_undegraded":"2024-09-12T00:23:27.716517+0000","last_fullsized":"2024-09-12T00:23:27.716517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.716028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:24.562308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:21:17.612115+0000","last_change":"2024-09-12T00:18:54.283055+0000","last_active":"2024-09-12T00:21:17.612115+0000","last_peered":"2024-09-12T00:21:17.612115+0000","last_clean":"2024-09-12T00:21:17.612115+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:21:17.612115+0000","last_undegraded":"2024-09-12T00:21:17.612115+0000","last_fullsized":"2024-09-12T00:21:17.612115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:53.216529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:53.216529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.364318+0000","last_change":"2024-09-12T00:22:56.364160+0000","last_active":"2024-09-12T00:22:56.364318+0000","last_peered":"2024-09-12T00:22:56.364318+0000","last_clean":"2024-09-12T00:22:56.364318+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:22:56.364318+0000","last_undegraded":"2024-09-12T00:22:56.364318+0000","last_fullsized":"2024-09-12T00:22:56.364318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.363976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.256275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.797911+0000","last_change":"2024-09-12T00:22:45.797737+0000","last_active":"2024-09-12T00:22:45.797911+0000","last_peered":"2024-09-12T00:22:45.797911+0000","last_clean":"2024-09-12T00:22:45.797911+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:22:45.797911+0000","last_undegraded":"2024-09-12T00:22:45.797911+0000","last_fullsized":"2024-09-12T00:22:45.797911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.797484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:00.294956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.808574+0000","last_change":"2024-09-12T00:23:07.808574+0000","last_active":"2024-09-12T00:23:07.808574+0000","last_peered":"2024-09-12T00:23:07.808574+0000","last_clean":"2024-09-12T00:23:07.808574+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:23:07.808574+0000","last_undegraded":"2024-09-12T00:23:07.808574+0000","last_fullsized":"2024-09-12T00:23:07.808574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.808393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.826760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.857883+0000","last_change":"2024-09-12T00:22:44.857717+0000","last_active":"2024-09-12T00:22:44.857883+0000","last_peered":"2024-09-12T00:22:44.857883+0000","last_clean":"2024-09-12T00:22:44.857883+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:22:44.857883+0000","last_undegraded":"2024-09-12T00:22:44.857883+0000","last_fullsized":"2024-09-12T00:22:44.857883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.857528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:34.268174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.885038+0000","last_change":"2024-09-12T00:23:16.885038+0000","last_active":"2024-09-12T00:23:16.885038+0000","last_peered":"2024-09-12T00:23:16.885038+0000","last_clean":"2024-09-12T00:23:16.885038+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:23:16.885038+0000","last_undegraded":"2024-09-12T00:23:16.885038+0000","last_fullsized":"2024-09-12T00:23:16.885038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.884827+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.406267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.064313+0000","last_change":"2024-09-12T00:22:56.064142+0000","last_active":"2024-09-12T00:22:56.064313+0000","last_peered":"2024-09-12T00:22:56.064313+0000","last_clean":"2024-09-12T00:22:56.064313+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:22:56.064313+0000","last_undegraded":"2024-09-12T00:22:56.064313+0000","last_fullsized":"2024-09-12T00:22:56.064313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.063956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.325584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.875973+0000","last_change":"2024-09-12T00:23:02.875774+0000","last_active":"2024-09-12T00:23:02.875973+0000","last_peered":"2024-09-12T00:23:02.875973+0000","last_clean":"2024-09-12T00:23:02.875973+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:23:02.875973+0000","last_undegraded":"2024-09-12T00:23:02.875973+0000","last_fullsized":"2024-09-12T00:23:02.875973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.875589+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.470261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.951519+0000","last_change":"2024-09-12T00:22:51.951351+0000","last_active":"2024-09-12T00:22:51.951519+0000","last_peered":"2024-09-12T00:22:51.951519+0000","last_clean":"2024-09-12T00:22:51.951519+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:22:51.951519+0000","last_undegraded":"2024-09-12T00:22:51.951519+0000","last_fullsized":"2024-09-12T00:22:51.951519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.951154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:49.515044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.882172+0000","last_change":"2024-09-12T00:22:58.882172+0000","last_active":"2024-09-12T00:22:58.882172+0000","last_peered":"2024-09-12T00:22:58.882172+0000","last_clean":"2024-09-12T00:22:58.882172+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:58.882172+0000","last_undegraded":"2024-09-12T00:22:58.882172+0000","last_fullsized":"2024-09-12T00:22:58.882172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.881909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:59.881831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.860676+0000","last_change":"2024-09-12T00:22:47.860535+0000","last_active":"2024-09-12T00:22:47.860676+0000","last_peered":"2024-09-12T00:22:47.860676+0000","last_clean":"2024-09-12T00:22:47.860676+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:22:47.860676+0000","last_undegraded":"2024-09-12T00:22:47.860676+0000","last_fullsized":"2024-09-12T00:22:47.860676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.860353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.356404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.351486+0000","last_change":"2024-09-12T00:22:57.351196+0000","last_active":"2024-09-12T00:22:57.351486+0000","last_peered":"2024-09-12T00:22:57.351486+0000","last_clean":"2024-09-12T00:22:57.351486+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:57.351486+0000","last_undegraded":"2024-09-12T00:22:57.351486+0000","last_fullsized":"2024-09-12T00:22:57.351486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.350978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:29.676609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.419200+0000","last_change":"2024-09-12T00:22:45.418904+0000","last_active":"2024-09-12T00:22:45.419200+0000","last_peered":"2024-09-12T00:22:45.419200+0000","last_clean":"2024-09-12T00:22:45.419200+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:22:45.419200+0000","last_undegraded":"2024-09-12T00:22:45.419200+0000","last_fullsized":"2024-09-12T00:22:45.419200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.418677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:28.543265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.889052+0000","last_change":"2024-09-12T00:23:01.889052+0000","last_active":"2024-09-12T00:23:01.889052+0000","last_peered":"2024-09-12T00:23:01.889052+0000","last_clean":"2024-09-12T00:23:01.889052+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:23:01.889052+0000","last_undegraded":"2024-09-12T00:23:01.889052+0000","last_fullsized":"2024-09-12T00:23:01.889052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.888826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:23.218572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.761030+0000","last_change":"2024-09-12T00:22:46.760728+0000","last_active":"2024-09-12T00:22:46.761030+0000","last_peered":"2024-09-12T00:22:46.761030+0000","last_clean":"2024-09-12T00:22:46.761030+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:22:46.761030+0000","last_undegraded":"2024-09-12T00:22:46.761030+0000","last_fullsized":"2024-09-12T00:22:46.761030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.760505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:03.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.411438+0000","last_change":"2024-09-12T00:22:55.411268+0000","last_active":"2024-09-12T00:22:55.411438+0000","last_peered":"2024-09-12T00:22:55.411438+0000","last_clean":"2024-09-12T00:22:55.411438+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:55.411438+0000","last_undegraded":"2024-09-12T00:22:55.411438+0000","last_fullsized":"2024-09-12T00:22:55.411438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.411085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.955659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.837988+0000","last_change":"2024-09-12T00:22:43.837801+0000","last_active":"2024-09-12T00:22:43.837988+0000","last_peered":"2024-09-12T00:22:43.837988+0000","last_clean":"2024-09-12T00:22:43.837988+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:22:43.837988+0000","last_undegraded":"2024-09-12T00:22:43.837988+0000","last_fullsized":"2024-09-12T00:22:43.837988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.837619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:26.962207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.433588+0000","last_change":"2024-09-12T00:23:04.433443+0000","last_active":"2024-09-12T00:23:04.433588+0000","last_peered":"2024-09-12T00:23:04.433588+0000","last_clean":"2024-09-12T00:23:04.433588+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:23:04.433588+0000","last_undegraded":"2024-09-12T00:23:04.433588+0000","last_fullsized":"2024-09-12T00:23:04.433588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.433267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:39.027939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.127791+0000","last_change":"2024-09-12T00:22:58.127664+0000","last_active":"2024-09-12T00:22:58.127791+0000","last_peered":"2024-09-12T00:22:58.127791+0000","last_clean":"2024-09-12T00:22:58.127791+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:22:58.127791+0000","last_undegraded":"2024-09-12T00:22:58.127791+0000","last_fullsized":"2024-09-12T00:22:58.127791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.127465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.328805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.895060+0000","last_change":"2024-09-12T00:23:18.894878+0000","last_active":"2024-09-12T00:23:18.895060+0000","last_peered":"2024-09-12T00:23:18.895060+0000","last_clean":"2024-09-12T00:23:18.895060+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:23:18.895060+0000","last_undegraded":"2024-09-12T00:23:18.895060+0000","last_fullsized":"2024-09-12T00:23:18.895060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.894667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.737541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.829130+0000","last_change":"2024-09-12T00:22:45.828950+0000","last_active":"2024-09-12T00:22:45.829130+0000","last_peered":"2024-09-12T00:22:45.829130+0000","last_clean":"2024-09-12T00:22:45.829130+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:22:45.829130+0000","last_undegraded":"2024-09-12T00:22:45.829130+0000","last_fullsized":"2024-09-12T00:22:45.829130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.828769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.446702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.843813+0000","last_change":"2024-09-12T00:22:57.843671+0000","last_active":"2024-09-12T00:22:57.843813+0000","last_peered":"2024-09-12T00:22:57.843813+0000","last_clean":"2024-09-12T00:22:57.843813+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:22:57.843813+0000","last_undegraded":"2024-09-12T00:22:57.843813+0000","last_fullsized":"2024-09-12T00:22:57.843813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.843490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:06.187761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.388924+0000","last_change":"2024-09-12T00:22:46.388768+0000","last_active":"2024-09-12T00:22:46.388924+0000","last_peered":"2024-09-12T00:22:46.388924+0000","last_clean":"2024-09-12T00:22:46.388924+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:22:46.388924+0000","last_undegraded":"2024-09-12T00:22:46.388924+0000","last_fullsized":"2024-09-12T00:22:46.388924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.388580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:18.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.374312+0000","last_change":"2024-09-12T00:23:01.374170+0000","last_active":"2024-09-12T00:23:01.374312+0000","last_peered":"2024-09-12T00:23:01.374312+0000","last_clean":"2024-09-12T00:23:01.374312+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:23:01.374312+0000","last_undegraded":"2024-09-12T00:23:01.374312+0000","last_fullsized":"2024-09-12T00:23:01.374312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.373987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:05.846953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.405470+0000","last_change":"2024-09-12T00:22:47.405301+0000","last_active":"2024-09-12T00:22:47.405470+0000","last_peered":"2024-09-12T00:22:47.405470+0000","last_clean":"2024-09-12T00:22:47.405470+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:22:47.405470+0000","last_undegraded":"2024-09-12T00:22:47.405470+0000","last_fullsized":"2024-09-12T00:22:47.405470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.405108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:56.440895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.408318+0000","last_change":"2024-09-12T00:22:59.408156+0000","last_active":"2024-09-12T00:22:59.408318+0000","last_peered":"2024-09-12T00:22:59.408318+0000","last_clean":"2024-09-12T00:22:59.408318+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:59.408318+0000","last_undegraded":"2024-09-12T00:22:59.408318+0000","last_fullsized":"2024-09-12T00:22:59.408318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.407970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.085566+0000","last_change":"2024-09-12T00:22:57.085427+0000","last_active":"2024-09-12T00:22:57.085566+0000","last_peered":"2024-09-12T00:22:57.085566+0000","last_clean":"2024-09-12T00:22:57.085566+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:22:57.085566+0000","last_undegraded":"2024-09-12T00:22:57.085566+0000","last_fullsized":"2024-09-12T00:22:57.085566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.085239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.771180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.421285+0000","last_change":"2024-09-12T00:23:02.421145+0000","last_active":"2024-09-12T00:23:02.421285+0000","last_peered":"2024-09-12T00:23:02.421285+0000","last_clean":"2024-09-12T00:23:02.421285+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:23:02.421285+0000","last_undegraded":"2024-09-12T00:23:02.421285+0000","last_fullsized":"2024-09-12T00:23:02.421285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.420954+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:36.359342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.165740+0000","last_change":"2024-09-12T00:22:59.165563+0000","last_active":"2024-09-12T00:22:59.165740+0000","last_peered":"2024-09-12T00:22:59.165740+0000","last_clean":"2024-09-12T00:22:59.165740+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:22:59.165740+0000","last_undegraded":"2024-09-12T00:22:59.165740+0000","last_fullsized":"2024-09-12T00:22:59.165740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.165334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:16.298385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.857582+0000","last_change":"2024-09-12T00:23:17.857582+0000","last_active":"2024-09-12T00:23:17.857582+0000","last_peered":"2024-09-12T00:23:17.857582+0000","last_clean":"2024-09-12T00:23:17.857582+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:23:17.857582+0000","last_undegraded":"2024-09-12T00:23:17.857582+0000","last_fullsized":"2024-09-12T00:23:17.857582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.857414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:48.868003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.779705+0000","last_change":"2024-09-12T00:22:47.779560+0000","last_active":"2024-09-12T00:22:47.779705+0000","last_peered":"2024-09-12T00:22:47.779705+0000","last_clean":"2024-09-12T00:22:47.779705+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:22:47.779705+0000","last_undegraded":"2024-09-12T00:22:47.779705+0000","last_fullsized":"2024-09-12T00:22:47.779705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.779379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.921779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.368579+0000","last_change":"2024-09-12T00:23:00.368297+0000","last_active":"2024-09-12T00:23:00.368579+0000","last_peered":"2024-09-12T00:23:00.368579+0000","last_clean":"2024-09-12T00:23:00.368579+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:23:00.368579+0000","last_undegraded":"2024-09-12T00:23:00.368579+0000","last_fullsized":"2024-09-12T00:23:00.368579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.368084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:01.368006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.123443+0000","last_change":"2024-09-12T00:23:00.123271+0000","last_active":"2024-09-12T00:23:00.123443+0000","last_peered":"2024-09-12T00:23:00.123443+0000","last_clean":"2024-09-12T00:23:00.123443+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:23:00.123443+0000","last_undegraded":"2024-09-12T00:23:00.123443+0000","last_fullsized":"2024-09-12T00:23:00.123443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.123089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:30.766748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.162155+0000","last_change":"2024-09-12T00:23:01.161909+0000","last_active":"2024-09-12T00:23:01.162155+0000","last_peered":"2024-09-12T00:23:01.162155+0000","last_clean":"2024-09-12T00:23:01.162155+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:23:01.162155+0000","last_undegraded":"2024-09-12T00:23:01.162155+0000","last_fullsized":"2024-09-12T00:23:01.162155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.161644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:33.787276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.851646+0000","last_change":"2024-09-12T00:23:00.851387+0000","last_active":"2024-09-12T00:23:00.851646+0000","last_peered":"2024-09-12T00:23:00.851646+0000","last_clean":"2024-09-12T00:23:00.851646+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:23:00.851646+0000","last_undegraded":"2024-09-12T00:23:00.851646+0000","last_fullsized":"2024-09-12T00:23:00.851646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.851152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:34.789540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.888144+0000","last_change":"2024-09-12T00:22:49.887896+0000","last_active":"2024-09-12T00:22:49.888144+0000","last_peered":"2024-09-12T00:22:49.888144+0000","last_clean":"2024-09-12T00:22:49.888144+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:22:49.888144+0000","last_undegraded":"2024-09-12T00:22:49.888144+0000","last_fullsized":"2024-09-12T00:22:49.888144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.887620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.362152+0000","last_change":"2024-09-12T00:23:07.361953+0000","last_active":"2024-09-12T00:23:07.362152+0000","last_peered":"2024-09-12T00:23:07.362152+0000","last_clean":"2024-09-12T00:23:07.362152+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:23:07.362152+0000","last_undegraded":"2024-09-12T00:23:07.362152+0000","last_fullsized":"2024-09-12T00:23:07.362152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.361766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:56.738180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1786,"ondisk_log_size":1786,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705733,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":150916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":737144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705734,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":737488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":149912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:24:00.139 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.140 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.140 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.140 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.141 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.141 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:53.216529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=22, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:24:00.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:24:20.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:24:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51ba509640 1 Processor -- start 2024-09-12T00:24:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51ba509640 1 -- start start 2024-09-12T00:24:20.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51ba509640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51b4110da0 0x7f51b4111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51ba509640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b4073a90 con 0x7f51b41116c0 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51ba509640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f51b40696e0 con 0x7f51b4110da0 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51b4110da0 0x7f51b4111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51b4110da0 0x7f51b4111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55294/0 (socket says 172.21.15.31:55294) 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 -- 172.21.15.31:0/4076746023 learned_addr learned my addr 172.21.15.31:0/4076746023 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 -- 172.21.15.31:0/4076746023 >> v1:172.21.15.31:6789/0 conn(0x7f51b41116c0 legacy=0x7f51b41231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:24:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 -- 172.21.15.31:0/4076746023 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b406dd50 con 0x7f51b4110da0 2024-09-12T00:24:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b3fff640 1 --2- 172.21.15.31:0/4076746023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4111180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097f0 tx=0x7f51a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5658760539f84d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b37fe640 1 -- 172.21.15.31:0/4076746023 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a40b0070 con 0x7f51b4110da0 2024-09-12T00:24:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b37fe640 1 -- 172.21.15.31:0/4076746023 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a40ab530 con 0x7f51b4110da0 2024-09-12T00:24:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.282+0000 7f51b37fe640 1 -- 172.21.15.31:0/4076746023 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a40ab830 con 0x7f51b4110da0 2024-09-12T00:24:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/4076746023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 msgr2=0x7f51b4111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 --2- 172.21.15.31:0/4076746023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4111180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097f0 tx=0x7f51a401c430 comp rx=0 tx=0).stop 2024-09-12T00:24:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/4076746023 shutdown_connections 2024-09-12T00:24:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 --2- 172.21.15.31:0/4076746023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4111180 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/4076746023 >> 172.21.15.31:0/4076746023 conn(0x7f51b4070900 msgr2=0x7f51b4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:24:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/4076746023 shutdown_connections 2024-09-12T00:24:20.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/4076746023 wait complete. 2024-09-12T00:24:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 Processor -- start 2024-09-12T00:24:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- start start 2024-09-12T00:24:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4135470 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55306/0 (socket says 172.21.15.31:55306) 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b3fff640 1 -- 172.21.15.31:0/2515546814 learned_addr learned my addr 172.21.15.31:0/2515546814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b3fff640 1 -- 172.21.15.31:0/2515546814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b4115270 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b3fff640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f51a401aae0 tx=0x7f51a401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a40ba020 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a40b6550 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b41156b0 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51a40b0040 con 0x7f51b4110da0 2024-09-12T00:24:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b4130c70 con 0x7f51b4110da0 2024-09-12T00:24:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b4111180 con 0x7f51b4110da0 2024-09-12T00:24:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.286+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f51a40bd020 con 0x7f51b4110da0 2024-09-12T00:24:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.290+0000 7f51b17fa640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 0x7f519403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.290+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7f51a40e9c60 con 0x7f51b4110da0 2024-09-12T00:24:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.290+0000 7f51abfff640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 0x7f519403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.290+0000 7f51abfff640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 0x7f519403d6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f519c003d00 tx=0x7f519c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.294+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f51a40c4030 con 0x7f51b4110da0 2024-09-12T00:24:20.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.462+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 --> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51b4127610 con 0x7f519403b200 2024-09-12T00:24:20.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.490+0000 7f51b17fa640 1 -- 172.21.15.31:0/2515546814 <== mgr.4101 v2:172.21.15.66:6824/2854630610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666234 (secure 0 0 0) 0x7f519c0baa90 con 0x7f519403b200 2024-09-12T00:24:20.499 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-12T00:24:20.507 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-12T00:24:20.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 msgr2=0x7f519403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 0x7f519403d6c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f519c003d00 tx=0x7f519c007a40 comp rx=0 tx=0).stop 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 msgr2=0x7f51b4130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f51a401aae0 tx=0x7f51a401ac70 comp rx=0 tx=0).stop 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 shutdown_connections 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7f519403b200 0x7f519403d6c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 --2- 172.21.15.31:0/2515546814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51b4110da0 0x7f51b4130730 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 >> 172.21.15.31:0/2515546814 conn(0x7f51b4070900 msgr2=0x7f51b4129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 shutdown_connections 2024-09-12T00:24:20.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.498+0000 7f51ba509640 1 -- 172.21.15.31:0/2515546814 wait complete. 2024-09-12T00:24:20.517 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-12T00:24:18.672840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":5401,"num_read_kb":4955,"num_write":2315,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5016,"ondisk_log_size":5016,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165056,"kb_used_data":2880,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322304,"statfs":{"total":386547056640,"available":386378039296,"internally_reserved":0,"allocated":2949120,"data_stored":1775460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6375,"internal_metadata":165996313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006185"},"pg_stats":[{"pgid":"3.3f","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.776360+0000","last_change":"2024-09-12T00:22:51.776190+0000","last_active":"2024-09-12T00:22:51.776360+0000","last_peered":"2024-09-12T00:22:51.776360+0000","last_clean":"2024-09-12T00:22:51.776360+0000","last_became_active":"2024-09-12T00:18:44.201379+0000","last_became_peered":"2024-09-12T00:18:44.201379+0000","last_unstale":"2024-09-12T00:22:51.776360+0000","last_undegraded":"2024-09-12T00:22:51.776360+0000","last_fullsized":"2024-09-12T00:22:51.776360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.776007+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.776007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.205681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.318733+0000","last_change":"2024-09-12T00:23:08.318599+0000","last_active":"2024-09-12T00:23:08.318733+0000","last_peered":"2024-09-12T00:23:08.318733+0000","last_clean":"2024-09-12T00:23:08.318733+0000","last_became_active":"2024-09-12T00:18:46.210499+0000","last_became_peered":"2024-09-12T00:18:46.210499+0000","last_unstale":"2024-09-12T00:23:08.318733+0000","last_undegraded":"2024-09-12T00:23:08.318733+0000","last_fullsized":"2024-09-12T00:23:08.318733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.318428+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.318428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:11.398771+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.963190+0000","last_change":"2024-09-12T00:22:53.963022+0000","last_active":"2024-09-12T00:22:53.963190+0000","last_peered":"2024-09-12T00:22:53.963190+0000","last_clean":"2024-09-12T00:22:53.963190+0000","last_became_active":"2024-09-12T00:18:44.197268+0000","last_became_peered":"2024-09-12T00:18:44.197268+0000","last_unstale":"2024-09-12T00:22:53.963190+0000","last_undegraded":"2024-09-12T00:22:53.963190+0000","last_fullsized":"2024-09-12T00:22:53.963190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.962810+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.962810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:20.507384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.886927+0000","last_change":"2024-09-12T00:23:20.886670+0000","last_active":"2024-09-12T00:23:20.886927+0000","last_peered":"2024-09-12T00:23:20.886927+0000","last_clean":"2024-09-12T00:23:20.886927+0000","last_became_active":"2024-09-12T00:18:46.196076+0000","last_became_peered":"2024-09-12T00:18:46.196076+0000","last_unstale":"2024-09-12T00:23:20.886927+0000","last_undegraded":"2024-09-12T00:23:20.886927+0000","last_fullsized":"2024-09-12T00:23:20.886927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:20.886463+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.886463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:38.609500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.128441+0000","last_change":"2024-09-12T00:23:06.128441+0000","last_active":"2024-09-12T00:23:06.128441+0000","last_peered":"2024-09-12T00:23:06.128441+0000","last_clean":"2024-09-12T00:23:06.128441+0000","last_became_active":"2024-09-12T00:18:44.204449+0000","last_became_peered":"2024-09-12T00:18:44.204449+0000","last_unstale":"2024-09-12T00:23:06.128441+0000","last_undegraded":"2024-09-12T00:23:06.128441+0000","last_fullsized":"2024-09-12T00:23:06.128441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.128258+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.128258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.765425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.868976+0000","last_change":"2024-09-12T00:23:21.868830+0000","last_active":"2024-09-12T00:23:21.868976+0000","last_peered":"2024-09-12T00:23:21.868976+0000","last_clean":"2024-09-12T00:23:21.868976+0000","last_became_active":"2024-09-12T00:18:46.183253+0000","last_became_peered":"2024-09-12T00:18:46.183253+0000","last_unstale":"2024-09-12T00:23:21.868976+0000","last_undegraded":"2024-09-12T00:23:21.868976+0000","last_fullsized":"2024-09-12T00:23:21.868976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.868648+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.868648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:48.574200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.765815+0000","last_change":"2024-09-12T00:22:50.765815+0000","last_active":"2024-09-12T00:22:50.765815+0000","last_peered":"2024-09-12T00:22:50.765815+0000","last_clean":"2024-09-12T00:22:50.765815+0000","last_became_active":"2024-09-12T00:18:44.191535+0000","last_became_peered":"2024-09-12T00:18:44.191535+0000","last_unstale":"2024-09-12T00:22:50.765815+0000","last_undegraded":"2024-09-12T00:22:50.765815+0000","last_fullsized":"2024-09-12T00:22:50.765815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:50.765631+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.765631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:43.898814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.859098+0000","last_change":"2024-09-12T00:23:23.858938+0000","last_active":"2024-09-12T00:23:23.859098+0000","last_peered":"2024-09-12T00:23:23.859098+0000","last_clean":"2024-09-12T00:23:23.859098+0000","last_became_active":"2024-09-12T00:18:46.183379+0000","last_became_peered":"2024-09-12T00:18:46.183379+0000","last_unstale":"2024-09-12T00:23:23.859098+0000","last_undegraded":"2024-09-12T00:23:23.859098+0000","last_fullsized":"2024-09-12T00:23:23.859098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:23.858738+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.858738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:32.992380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.118092+0000","last_change":"2024-09-12T00:23:04.117840+0000","last_active":"2024-09-12T00:23:04.118092+0000","last_peered":"2024-09-12T00:23:04.118092+0000","last_clean":"2024-09-12T00:23:04.118092+0000","last_became_active":"2024-09-12T00:18:44.203407+0000","last_became_peered":"2024-09-12T00:18:44.203407+0000","last_unstale":"2024-09-12T00:23:04.118092+0000","last_undegraded":"2024-09-12T00:23:04.118092+0000","last_fullsized":"2024-09-12T00:23:04.118092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.117631+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.117631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.338073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.365803+0000","last_change":"2024-09-12T00:23:09.365803+0000","last_active":"2024-09-12T00:23:09.365803+0000","last_peered":"2024-09-12T00:23:09.365803+0000","last_clean":"2024-09-12T00:23:09.365803+0000","last_became_active":"2024-09-12T00:18:46.204018+0000","last_became_peered":"2024-09-12T00:18:46.204018+0000","last_unstale":"2024-09-12T00:23:09.365803+0000","last_undegraded":"2024-09-12T00:23:09.365803+0000","last_fullsized":"2024-09-12T00:23:09.365803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:09.365625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.365625+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:02.383992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.751844+0000","last_change":"2024-09-12T00:22:49.751719+0000","last_active":"2024-09-12T00:22:49.751844+0000","last_peered":"2024-09-12T00:22:49.751844+0000","last_clean":"2024-09-12T00:22:49.751844+0000","last_became_active":"2024-09-12T00:18:44.218282+0000","last_became_peered":"2024-09-12T00:18:44.218282+0000","last_unstale":"2024-09-12T00:22:49.751844+0000","last_undegraded":"2024-09-12T00:22:49.751844+0000","last_fullsized":"2024-09-12T00:22:49.751844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.751527+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.751527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.037605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.837158+0000","last_change":"2024-09-12T00:23:22.837158+0000","last_active":"2024-09-12T00:23:22.837158+0000","last_peered":"2024-09-12T00:23:22.837158+0000","last_clean":"2024-09-12T00:23:22.837158+0000","last_became_active":"2024-09-12T00:18:46.208852+0000","last_became_peered":"2024-09-12T00:18:46.208852+0000","last_unstale":"2024-09-12T00:23:22.837158+0000","last_undegraded":"2024-09-12T00:23:22.837158+0000","last_fullsized":"2024-09-12T00:23:22.837158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:22.836976+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.836976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:54.939860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.155580+0000","last_change":"2024-09-12T00:23:03.155399+0000","last_active":"2024-09-12T00:23:03.155580+0000","last_peered":"2024-09-12T00:23:03.155580+0000","last_clean":"2024-09-12T00:23:03.155580+0000","last_became_active":"2024-09-12T00:18:44.193318+0000","last_became_peered":"2024-09-12T00:18:44.193318+0000","last_unstale":"2024-09-12T00:23:03.155580+0000","last_undegraded":"2024-09-12T00:23:03.155580+0000","last_fullsized":"2024-09-12T00:23:03.155580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.155222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.155222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:47.560452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.684984+0000","last_change":"2024-09-12T00:23:03.684984+0000","last_active":"2024-09-12T00:23:03.684984+0000","last_peered":"2024-09-12T00:23:03.684984+0000","last_clean":"2024-09-12T00:23:03.684984+0000","last_became_active":"2024-09-12T00:18:46.207104+0000","last_became_peered":"2024-09-12T00:18:46.207104+0000","last_unstale":"2024-09-12T00:23:03.684984+0000","last_undegraded":"2024-09-12T00:23:03.684984+0000","last_fullsized":"2024-09-12T00:23:03.684984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:03.684709+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.684709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.095355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.894006+0000","last_change":"2024-09-12T00:22:48.893869+0000","last_active":"2024-09-12T00:22:48.894006+0000","last_peered":"2024-09-12T00:22:48.894006+0000","last_clean":"2024-09-12T00:22:48.894006+0000","last_became_active":"2024-09-12T00:18:44.216004+0000","last_became_peered":"2024-09-12T00:18:44.216004+0000","last_unstale":"2024-09-12T00:22:48.894006+0000","last_undegraded":"2024-09-12T00:22:48.894006+0000","last_fullsized":"2024-09-12T00:22:48.894006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:48.893683+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.893683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:04.252868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.700907+0000","last_change":"2024-09-12T00:23:04.700907+0000","last_active":"2024-09-12T00:23:04.700907+0000","last_peered":"2024-09-12T00:23:04.700907+0000","last_clean":"2024-09-12T00:23:04.700907+0000","last_became_active":"2024-09-12T00:18:46.186236+0000","last_became_peered":"2024-09-12T00:18:46.186236+0000","last_unstale":"2024-09-12T00:23:04.700907+0000","last_undegraded":"2024-09-12T00:23:04.700907+0000","last_fullsized":"2024-09-12T00:23:04.700907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:04.700730+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.700730+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:30.318663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'8","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.896857+0000","last_change":"2024-09-12T00:23:19.896568+0000","last_active":"2024-09-12T00:23:19.896857+0000","last_peered":"2024-09-12T00:23:19.896857+0000","last_clean":"2024-09-12T00:23:19.896857+0000","last_became_active":"2024-09-12T00:18:46.196190+0000","last_became_peered":"2024-09-12T00:18:46.196190+0000","last_unstale":"2024-09-12T00:23:19.896857+0000","last_undegraded":"2024-09-12T00:23:19.896857+0000","last_fullsized":"2024-09-12T00:23:19.896857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:19.896281+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.896281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:30.170323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.381401+0000","last_change":"2024-09-12T00:22:50.381220+0000","last_active":"2024-09-12T00:22:50.381401+0000","last_peered":"2024-09-12T00:22:50.381401+0000","last_clean":"2024-09-12T00:22:50.381401+0000","last_became_active":"2024-09-12T00:18:44.212397+0000","last_became_peered":"2024-09-12T00:18:44.212397+0000","last_unstale":"2024-09-12T00:22:50.381401+0000","last_undegraded":"2024-09-12T00:22:50.381401+0000","last_fullsized":"2024-09-12T00:22:50.381401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.381031+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:05.740216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.395208+0000","last_change":"2024-09-12T00:23:03.395067+0000","last_active":"2024-09-12T00:23:03.395208+0000","last_peered":"2024-09-12T00:23:03.395208+0000","last_clean":"2024-09-12T00:23:03.395208+0000","last_became_active":"2024-09-12T00:18:46.194234+0000","last_became_peered":"2024-09-12T00:18:46.194234+0000","last_unstale":"2024-09-12T00:23:03.395208+0000","last_undegraded":"2024-09-12T00:23:03.395208+0000","last_fullsized":"2024-09-12T00:23:03.395208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:03.394885+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.394885+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:09.804874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.797760+0000","last_change":"2024-09-12T00:22:48.797589+0000","last_active":"2024-09-12T00:22:48.797760+0000","last_peered":"2024-09-12T00:22:48.797760+0000","last_clean":"2024-09-12T00:22:48.797760+0000","last_became_active":"2024-09-12T00:18:44.202045+0000","last_became_peered":"2024-09-12T00:18:44.202045+0000","last_unstale":"2024-09-12T00:22:48.797760+0000","last_undegraded":"2024-09-12T00:22:48.797760+0000","last_fullsized":"2024-09-12T00:22:48.797760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.797378+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.797378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:43.134132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'20","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.439269+0000","last_change":"2024-09-12T00:23:05.439096+0000","last_active":"2024-09-12T00:23:05.439269+0000","last_peered":"2024-09-12T00:23:05.439269+0000","last_clean":"2024-09-12T00:23:05.439269+0000","last_became_active":"2024-09-12T00:18:46.202867+0000","last_became_peered":"2024-09-12T00:18:46.202867+0000","last_unstale":"2024-09-12T00:23:05.439269+0000","last_undegraded":"2024-09-12T00:23:05.439269+0000","last_fullsized":"2024-09-12T00:23:05.439269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:05.438924+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.438924+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:26.775381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.390245+0000","last_change":"2024-09-12T00:22:48.390120+0000","last_active":"2024-09-12T00:22:48.390245+0000","last_peered":"2024-09-12T00:22:48.390245+0000","last_clean":"2024-09-12T00:22:48.390245+0000","last_became_active":"2024-09-12T00:18:44.213166+0000","last_became_peered":"2024-09-12T00:18:44.213166+0000","last_unstale":"2024-09-12T00:22:48.390245+0000","last_undegraded":"2024-09-12T00:22:48.390245+0000","last_fullsized":"2024-09-12T00:22:48.390245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.389942+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.389942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:27.548963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'14","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.829942+0000","last_change":"2024-09-12T00:23:06.829700+0000","last_active":"2024-09-12T00:23:06.829942+0000","last_peered":"2024-09-12T00:23:06.829942+0000","last_clean":"2024-09-12T00:23:06.829942+0000","last_became_active":"2024-09-12T00:18:46.195844+0000","last_became_peered":"2024-09-12T00:18:46.195844+0000","last_unstale":"2024-09-12T00:23:06.829942+0000","last_undegraded":"2024-09-12T00:23:06.829942+0000","last_fullsized":"2024-09-12T00:23:06.829942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-12T00:23:06.829458+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.829458+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:09.909801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.394001+0000","last_change":"2024-09-12T00:22:49.393858+0000","last_active":"2024-09-12T00:22:49.394001+0000","last_peered":"2024-09-12T00:22:49.394001+0000","last_clean":"2024-09-12T00:22:49.394001+0000","last_became_active":"2024-09-12T00:18:44.197439+0000","last_became_peered":"2024-09-12T00:18:44.197439+0000","last_unstale":"2024-09-12T00:22:49.394001+0000","last_undegraded":"2024-09-12T00:22:49.394001+0000","last_fullsized":"2024-09-12T00:22:49.394001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.393664+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.393664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.905345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.724991+0000","last_change":"2024-09-12T00:23:02.724818+0000","last_active":"2024-09-12T00:23:02.724991+0000","last_peered":"2024-09-12T00:23:02.724991+0000","last_clean":"2024-09-12T00:23:02.724991+0000","last_became_active":"2024-09-12T00:18:46.189220+0000","last_became_peered":"2024-09-12T00:18:46.189220+0000","last_unstale":"2024-09-12T00:23:02.724991+0000","last_undegraded":"2024-09-12T00:23:02.724991+0000","last_fullsized":"2024-09-12T00:23:02.724991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:02.724643+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.724643+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:13.949257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.985602+0000","last_change":"2024-09-12T00:22:52.985430+0000","last_active":"2024-09-12T00:22:52.985602+0000","last_peered":"2024-09-12T00:22:52.985602+0000","last_clean":"2024-09-12T00:22:52.985602+0000","last_became_active":"2024-09-12T00:18:44.215289+0000","last_became_peered":"2024-09-12T00:18:44.215289+0000","last_unstale":"2024-09-12T00:22:52.985602+0000","last_undegraded":"2024-09-12T00:22:52.985602+0000","last_fullsized":"2024-09-12T00:22:52.985602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.985239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:11.458618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'6","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.399827+0000","last_change":"2024-09-12T00:23:06.399553+0000","last_active":"2024-09-12T00:23:06.399827+0000","last_peered":"2024-09-12T00:23:06.399827+0000","last_clean":"2024-09-12T00:23:06.399827+0000","last_became_active":"2024-09-12T00:18:46.186405+0000","last_became_peered":"2024-09-12T00:18:46.186405+0000","last_unstale":"2024-09-12T00:23:06.399827+0000","last_undegraded":"2024-09-12T00:23:06.399827+0000","last_fullsized":"2024-09-12T00:23:06.399827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:06.399335+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.399335+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:58.180682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.129041+0000","last_change":"2024-09-12T00:23:02.128899+0000","last_active":"2024-09-12T00:23:02.129041+0000","last_peered":"2024-09-12T00:23:02.129041+0000","last_clean":"2024-09-12T00:23:02.129041+0000","last_became_active":"2024-09-12T00:18:44.194296+0000","last_became_peered":"2024-09-12T00:18:44.194296+0000","last_unstale":"2024-09-12T00:23:02.129041+0000","last_undegraded":"2024-09-12T00:23:02.129041+0000","last_fullsized":"2024-09-12T00:23:02.129041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:02.128715+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.128715+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:26.580947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.270013+0000","last_change":"2024-09-12T00:23:37.269763+0000","last_active":"2024-09-12T00:23:37.270013+0000","last_peered":"2024-09-12T00:23:37.270013+0000","last_clean":"2024-09-12T00:23:37.270013+0000","last_became_active":"2024-09-12T00:18:54.264282+0000","last_became_peered":"2024-09-12T00:18:54.264282+0000","last_unstale":"2024-09-12T00:23:37.270013+0000","last_undegraded":"2024-09-12T00:23:37.270013+0000","last_fullsized":"2024-09-12T00:23:37.270013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-12T00:23:37.269540+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.269540+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:31.878743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.016722+0000","last_change":"2024-09-12T00:23:09.016573+0000","last_active":"2024-09-12T00:23:09.016722+0000","last_peered":"2024-09-12T00:23:09.016722+0000","last_clean":"2024-09-12T00:23:09.016722+0000","last_became_active":"2024-09-12T00:18:46.181375+0000","last_became_peered":"2024-09-12T00:18:46.181375+0000","last_unstale":"2024-09-12T00:23:09.016722+0000","last_undegraded":"2024-09-12T00:23:09.016722+0000","last_fullsized":"2024-09-12T00:23:09.016722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:09.016364+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.016364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:43.015238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.017023+0000","last_change":"2024-09-12T00:22:51.016861+0000","last_active":"2024-09-12T00:22:51.017023+0000","last_peered":"2024-09-12T00:22:51.017023+0000","last_clean":"2024-09-12T00:22:51.017023+0000","last_became_active":"2024-09-12T00:18:44.202954+0000","last_became_peered":"2024-09-12T00:18:44.202954+0000","last_unstale":"2024-09-12T00:22:51.017023+0000","last_undegraded":"2024-09-12T00:22:51.017023+0000","last_fullsized":"2024-09-12T00:22:51.017023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:51.016681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.016681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.831893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.962090+0000","last_change":"2024-09-12T00:23:31.961933+0000","last_active":"2024-09-12T00:23:31.962090+0000","last_peered":"2024-09-12T00:23:31.962090+0000","last_clean":"2024-09-12T00:23:31.962090+0000","last_became_active":"2024-09-12T00:18:48.222939+0000","last_became_peered":"2024-09-12T00:18:48.222939+0000","last_unstale":"2024-09-12T00:23:31.962090+0000","last_undegraded":"2024-09-12T00:23:31.962090+0000","last_fullsized":"2024-09-12T00:23:31.962090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:31.961757+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.961757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:47.635223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'51","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:44.969812+0000","last_change":"2024-09-12T00:23:44.969812+0000","last_active":"2024-09-12T00:23:44.969812+0000","last_peered":"2024-09-12T00:23:44.969812+0000","last_clean":"2024-09-12T00:23:44.969812+0000","last_became_active":"2024-09-12T00:18:50.243295+0000","last_became_peered":"2024-09-12T00:18:50.243295+0000","last_unstale":"2024-09-12T00:23:44.969812+0000","last_undegraded":"2024-09-12T00:23:44.969812+0000","last_fullsized":"2024-09-12T00:23:44.969812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:44.969606+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:44.969606+0000","last_clean_scrub_stamp":"2024-09-12T00:23:44.969606+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:35.419284+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.203037+0000","last_change":"2024-09-12T00:23:29.202904+0000","last_active":"2024-09-12T00:23:29.203037+0000","last_peered":"2024-09-12T00:23:29.203037+0000","last_clean":"2024-09-12T00:23:29.203037+0000","last_became_active":"2024-09-12T00:18:52.240032+0000","last_became_peered":"2024-09-12T00:18:52.240032+0000","last_unstale":"2024-09-12T00:23:29.203037+0000","last_undegraded":"2024-09-12T00:23:29.203037+0000","last_fullsized":"2024-09-12T00:23:29.203037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.202735+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.202735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:26.049014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.229286+0000","last_change":"2024-09-12T00:23:38.229130+0000","last_active":"2024-09-12T00:23:38.229286+0000","last_peered":"2024-09-12T00:23:38.229286+0000","last_clean":"2024-09-12T00:23:38.229286+0000","last_became_active":"2024-09-12T00:18:54.268745+0000","last_became_peered":"2024-09-12T00:18:54.268745+0000","last_unstale":"2024-09-12T00:23:38.229286+0000","last_undegraded":"2024-09-12T00:23:38.229286+0000","last_fullsized":"2024-09-12T00:23:38.229286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-12T00:23:38.228909+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-12T00:23:38.228909+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.228909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:39.522007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.962017+0000","last_change":"2024-09-12T00:23:13.961891+0000","last_active":"2024-09-12T00:23:13.962017+0000","last_peered":"2024-09-12T00:23:13.962017+0000","last_clean":"2024-09-12T00:23:13.962017+0000","last_became_active":"2024-09-12T00:18:46.191988+0000","last_became_peered":"2024-09-12T00:18:46.191988+0000","last_unstale":"2024-09-12T00:23:13.962017+0000","last_undegraded":"2024-09-12T00:23:13.962017+0000","last_fullsized":"2024-09-12T00:23:13.962017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:13.961704+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.961704+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:07.483381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.797176+0000","last_change":"2024-09-12T00:22:43.797026+0000","last_active":"2024-09-12T00:22:43.797176+0000","last_peered":"2024-09-12T00:22:43.797176+0000","last_clean":"2024-09-12T00:22:43.797176+0000","last_became_active":"2024-09-12T00:18:44.207101+0000","last_became_peered":"2024-09-12T00:18:44.207101+0000","last_unstale":"2024-09-12T00:22:43.797176+0000","last_undegraded":"2024-09-12T00:22:43.797176+0000","last_fullsized":"2024-09-12T00:22:43.797176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.796840+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.796840+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:32.300041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.369884+0000","last_change":"2024-09-12T00:23:14.369745+0000","last_active":"2024-09-12T00:23:14.369884+0000","last_peered":"2024-09-12T00:23:14.369884+0000","last_clean":"2024-09-12T00:23:14.369884+0000","last_became_active":"2024-09-12T00:19:24.286281+0000","last_became_peered":"2024-09-12T00:19:24.286281+0000","last_unstale":"2024-09-12T00:23:14.369884+0000","last_undegraded":"2024-09-12T00:23:14.369884+0000","last_fullsized":"2024-09-12T00:23:14.369884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.369579+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.369579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.600971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.155307+0000","last_change":"2024-09-12T00:23:23.155034+0000","last_active":"2024-09-12T00:23:23.155307+0000","last_peered":"2024-09-12T00:23:23.155307+0000","last_clean":"2024-09-12T00:23:23.155307+0000","last_became_active":"2024-09-12T00:18:50.233953+0000","last_became_peered":"2024-09-12T00:18:50.233953+0000","last_unstale":"2024-09-12T00:23:23.155307+0000","last_undegraded":"2024-09-12T00:23:23.155307+0000","last_fullsized":"2024-09-12T00:23:23.155307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-12T00:23:23.154802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.154802+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:07.955527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.162091+0000","last_change":"2024-09-12T00:23:28.161930+0000","last_active":"2024-09-12T00:23:28.162091+0000","last_peered":"2024-09-12T00:23:28.162091+0000","last_clean":"2024-09-12T00:23:28.162091+0000","last_became_active":"2024-09-12T00:18:52.236128+0000","last_became_peered":"2024-09-12T00:18:52.236128+0000","last_unstale":"2024-09-12T00:23:28.162091+0000","last_undegraded":"2024-09-12T00:23:28.162091+0000","last_fullsized":"2024-09-12T00:23:28.162091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.161717+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.161717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:01.037307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.708595+0000","last_change":"2024-09-12T00:23:33.708440+0000","last_active":"2024-09-12T00:23:33.708595+0000","last_peered":"2024-09-12T00:23:33.708595+0000","last_clean":"2024-09-12T00:23:33.708595+0000","last_became_active":"2024-09-12T00:18:54.258244+0000","last_became_peered":"2024-09-12T00:18:54.258244+0000","last_unstale":"2024-09-12T00:23:33.708595+0000","last_undegraded":"2024-09-12T00:23:33.708595+0000","last_fullsized":"2024-09-12T00:23:33.708595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.708253+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.708253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.689561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.939814+0000","last_change":"2024-09-12T00:23:12.939642+0000","last_active":"2024-09-12T00:23:12.939814+0000","last_peered":"2024-09-12T00:23:12.939814+0000","last_clean":"2024-09-12T00:23:12.939814+0000","last_became_active":"2024-09-12T00:18:46.188760+0000","last_became_peered":"2024-09-12T00:18:46.188760+0000","last_unstale":"2024-09-12T00:23:12.939814+0000","last_undegraded":"2024-09-12T00:23:12.939814+0000","last_fullsized":"2024-09-12T00:23:12.939814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:12.939457+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.939457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.805086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.061676+0000","last_change":"2024-09-12T00:22:50.061542+0000","last_active":"2024-09-12T00:22:50.061676+0000","last_peered":"2024-09-12T00:22:50.061676+0000","last_clean":"2024-09-12T00:22:50.061676+0000","last_became_active":"2024-09-12T00:18:44.203234+0000","last_became_peered":"2024-09-12T00:18:44.203234+0000","last_unstale":"2024-09-12T00:22:50.061676+0000","last_undegraded":"2024-09-12T00:22:50.061676+0000","last_fullsized":"2024-09-12T00:22:50.061676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:50.061348+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.061348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:59.156666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.840770+0000","last_change":"2024-09-12T00:23:09.840652+0000","last_active":"2024-09-12T00:23:09.840770+0000","last_peered":"2024-09-12T00:23:09.840770+0000","last_clean":"2024-09-12T00:23:09.840770+0000","last_became_active":"2024-09-12T00:18:48.217774+0000","last_became_peered":"2024-09-12T00:18:48.217774+0000","last_unstale":"2024-09-12T00:23:09.840770+0000","last_undegraded":"2024-09-12T00:23:09.840770+0000","last_fullsized":"2024-09-12T00:23:09.840770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.840470+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.840470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:18.847901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'31","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.759568+0000","last_change":"2024-09-12T00:23:17.759391+0000","last_active":"2024-09-12T00:23:17.759568+0000","last_peered":"2024-09-12T00:23:17.759568+0000","last_clean":"2024-09-12T00:23:17.759568+0000","last_became_active":"2024-09-12T00:18:50.215824+0000","last_became_peered":"2024-09-12T00:18:50.215824+0000","last_unstale":"2024-09-12T00:23:17.759568+0000","last_undegraded":"2024-09-12T00:23:17.759568+0000","last_fullsized":"2024-09-12T00:23:17.759568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-12T00:23:17.759194+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.759194+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:15.514131+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'286","reported_seq":396,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:50.915646+0000","last_change":"2024-09-12T00:23:50.915646+0000","last_active":"2024-09-12T00:23:50.915646+0000","last_peered":"2024-09-12T00:23:50.915646+0000","last_clean":"2024-09-12T00:23:50.915646+0000","last_became_active":"2024-09-12T00:18:52.256294+0000","last_became_peered":"2024-09-12T00:18:52.256294+0000","last_unstale":"2024-09-12T00:23:50.915646+0000","last_undegraded":"2024-09-12T00:23:50.915646+0000","last_fullsized":"2024-09-12T00:23:50.915646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:50.915463+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:50.915463+0000","last_clean_scrub_stamp":"2024-09-12T00:23:50.915463+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:52.689437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.732365+0000","last_change":"2024-09-12T00:23:30.732233+0000","last_active":"2024-09-12T00:23:30.732365+0000","last_peered":"2024-09-12T00:23:30.732365+0000","last_clean":"2024-09-12T00:23:30.732365+0000","last_became_active":"2024-09-12T00:18:54.259908+0000","last_became_peered":"2024-09-12T00:18:54.259908+0000","last_unstale":"2024-09-12T00:23:30.732365+0000","last_undegraded":"2024-09-12T00:23:30.732365+0000","last_fullsized":"2024-09-12T00:23:30.732365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.732049+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.732049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:20.404264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'8","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.837234+0000","last_change":"2024-09-12T00:22:59.837098+0000","last_active":"2024-09-12T00:22:59.837234+0000","last_peered":"2024-09-12T00:22:59.837234+0000","last_clean":"2024-09-12T00:22:59.837234+0000","last_became_active":"2024-09-12T00:18:46.210002+0000","last_became_peered":"2024-09-12T00:18:46.210002+0000","last_unstale":"2024-09-12T00:22:59.837234+0000","last_undegraded":"2024-09-12T00:22:59.837234+0000","last_fullsized":"2024-09-12T00:22:59.837234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:59.836918+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.836918+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.309884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.345876+0000","last_change":"2024-09-12T00:22:41.345748+0000","last_active":"2024-09-12T00:22:41.345876+0000","last_peered":"2024-09-12T00:22:41.345876+0000","last_clean":"2024-09-12T00:22:41.345876+0000","last_became_active":"2024-09-12T00:18:44.189999+0000","last_became_peered":"2024-09-12T00:18:44.189999+0000","last_unstale":"2024-09-12T00:22:41.345876+0000","last_undegraded":"2024-09-12T00:22:41.345876+0000","last_fullsized":"2024-09-12T00:22:41.345876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.345566+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.345566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:36.735410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"33'2","reported_seq":231,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.000677+0000","last_change":"2024-09-12T00:23:33.000372+0000","last_active":"2024-09-12T00:23:33.000677+0000","last_peered":"2024-09-12T00:23:33.000677+0000","last_clean":"2024-09-12T00:23:33.000677+0000","last_became_active":"2024-09-12T00:18:48.223271+0000","last_became_peered":"2024-09-12T00:18:48.223271+0000","last_unstale":"2024-09-12T00:23:33.000677+0000","last_undegraded":"2024-09-12T00:23:33.000677+0000","last_fullsized":"2024-09-12T00:23:33.000677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:33.000090+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.000090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:12.347397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.781974+0000","last_change":"2024-09-12T00:23:18.781836+0000","last_active":"2024-09-12T00:23:18.781974+0000","last_peered":"2024-09-12T00:23:18.781974+0000","last_clean":"2024-09-12T00:23:18.781974+0000","last_became_active":"2024-09-12T00:18:50.214360+0000","last_became_peered":"2024-09-12T00:18:50.214360+0000","last_unstale":"2024-09-12T00:23:18.781974+0000","last_undegraded":"2024-09-12T00:23:18.781974+0000","last_fullsized":"2024-09-12T00:23:18.781974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-12T00:23:18.781614+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.781614+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:45.399468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'286","reported_seq":456,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.761859+0000","last_change":"2024-09-12T00:23:25.761580+0000","last_active":"2024-09-12T00:23:25.761859+0000","last_peered":"2024-09-12T00:23:25.761859+0000","last_clean":"2024-09-12T00:23:25.761859+0000","last_became_active":"2024-09-12T00:18:52.238781+0000","last_became_peered":"2024-09-12T00:18:52.238781+0000","last_unstale":"2024-09-12T00:23:25.761859+0000","last_undegraded":"2024-09-12T00:23:25.761859+0000","last_fullsized":"2024-09-12T00:23:25.761859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.761356+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.761356+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:04.491765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.085218+0000","last_change":"2024-09-12T00:23:07.084961+0000","last_active":"2024-09-12T00:23:07.085218+0000","last_peered":"2024-09-12T00:23:07.085218+0000","last_clean":"2024-09-12T00:23:07.085218+0000","last_became_active":"2024-09-12T00:18:46.213730+0000","last_became_peered":"2024-09-12T00:18:46.213730+0000","last_unstale":"2024-09-12T00:23:07.085218+0000","last_undegraded":"2024-09-12T00:23:07.085218+0000","last_fullsized":"2024-09-12T00:23:07.085218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.084724+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.084724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.811716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.772738+0000","last_change":"2024-09-12T00:22:41.772590+0000","last_active":"2024-09-12T00:22:41.772738+0000","last_peered":"2024-09-12T00:22:41.772738+0000","last_clean":"2024-09-12T00:22:41.772738+0000","last_became_active":"2024-09-12T00:18:44.201883+0000","last_became_peered":"2024-09-12T00:18:44.201883+0000","last_unstale":"2024-09-12T00:22:41.772738+0000","last_undegraded":"2024-09-12T00:22:41.772738+0000","last_fullsized":"2024-09-12T00:22:41.772738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:41.772363+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.772363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.380735+0000","last_change":"2024-09-12T00:23:11.380735+0000","last_active":"2024-09-12T00:23:11.380735+0000","last_peered":"2024-09-12T00:23:11.380735+0000","last_clean":"2024-09-12T00:23:11.380735+0000","last_became_active":"2024-09-12T00:18:48.202402+0000","last_became_peered":"2024-09-12T00:18:48.202402+0000","last_unstale":"2024-09-12T00:23:11.380735+0000","last_undegraded":"2024-09-12T00:23:11.380735+0000","last_fullsized":"2024-09-12T00:23:11.380735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.380468+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.380468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:20.387899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'62","reported_seq":129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.763583+0000","last_change":"2024-09-12T00:23:14.763583+0000","last_active":"2024-09-12T00:23:14.763583+0000","last_peered":"2024-09-12T00:23:14.763583+0000","last_clean":"2024-09-12T00:23:14.763583+0000","last_became_active":"2024-09-12T00:18:50.230323+0000","last_became_peered":"2024-09-12T00:18:50.230323+0000","last_unstale":"2024-09-12T00:23:14.763583+0000","last_undegraded":"2024-09-12T00:23:14.763583+0000","last_fullsized":"2024-09-12T00:23:14.763583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'62","last_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_deep_scrub":"33'62","last_deep_scrub_stamp":"2024-09-12T00:23:14.763365+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.763365+0000","objects_scrubbed":10,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:39.983068+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.755117+0000","last_change":"2024-09-12T00:23:24.755117+0000","last_active":"2024-09-12T00:23:24.755117+0000","last_peered":"2024-09-12T00:23:24.755117+0000","last_clean":"2024-09-12T00:23:24.755117+0000","last_became_active":"2024-09-12T00:18:52.238572+0000","last_became_peered":"2024-09-12T00:18:52.238572+0000","last_unstale":"2024-09-12T00:23:24.755117+0000","last_undegraded":"2024-09-12T00:23:24.755117+0000","last_fullsized":"2024-09-12T00:23:24.755117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:24.754908+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.754908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:00.095135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.754381+0000","last_change":"2024-09-12T00:23:27.754381+0000","last_active":"2024-09-12T00:23:27.754381+0000","last_peered":"2024-09-12T00:23:27.754381+0000","last_clean":"2024-09-12T00:23:27.754381+0000","last_became_active":"2024-09-12T00:18:54.277432+0000","last_became_peered":"2024-09-12T00:18:54.277432+0000","last_unstale":"2024-09-12T00:23:27.754381+0000","last_undegraded":"2024-09-12T00:23:27.754381+0000","last_fullsized":"2024-09-12T00:23:27.754381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:27.754200+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.754200+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:53.666701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.432243+0000","last_change":"2024-09-12T00:22:52.432048+0000","last_active":"2024-09-12T00:22:52.432243+0000","last_peered":"2024-09-12T00:22:52.432243+0000","last_clean":"2024-09-12T00:22:52.432243+0000","last_became_active":"2024-09-12T00:18:46.194230+0000","last_became_peered":"2024-09-12T00:18:46.194230+0000","last_unstale":"2024-09-12T00:22:52.432243+0000","last_undegraded":"2024-09-12T00:22:52.432243+0000","last_fullsized":"2024-09-12T00:22:52.432243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:52.431871+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.431871+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.876093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.795646+0000","last_change":"2024-09-12T00:22:40.795499+0000","last_active":"2024-09-12T00:22:40.795646+0000","last_peered":"2024-09-12T00:22:40.795646+0000","last_clean":"2024-09-12T00:22:40.795646+0000","last_became_active":"2024-09-12T00:18:44.195065+0000","last_became_peered":"2024-09-12T00:18:44.195065+0000","last_unstale":"2024-09-12T00:22:40.795646+0000","last_undegraded":"2024-09-12T00:22:40.795646+0000","last_fullsized":"2024-09-12T00:22:40.795646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:40.795325+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.795325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:29.485413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.766513+0000","last_change":"2024-09-12T00:23:14.766513+0000","last_active":"2024-09-12T00:23:14.766513+0000","last_peered":"2024-09-12T00:23:14.766513+0000","last_clean":"2024-09-12T00:23:14.766513+0000","last_became_active":"2024-09-12T00:18:48.205033+0000","last_became_peered":"2024-09-12T00:18:48.205033+0000","last_unstale":"2024-09-12T00:23:14.766513+0000","last_undegraded":"2024-09-12T00:23:14.766513+0000","last_fullsized":"2024-09-12T00:23:14.766513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:14.766308+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.766308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:42.849877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'44","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.945468+0000","last_change":"2024-09-12T00:23:38.945468+0000","last_active":"2024-09-12T00:23:38.945468+0000","last_peered":"2024-09-12T00:23:38.945468+0000","last_clean":"2024-09-12T00:23:38.945468+0000","last_became_active":"2024-09-12T00:18:50.238172+0000","last_became_peered":"2024-09-12T00:18:50.238172+0000","last_unstale":"2024-09-12T00:23:38.945468+0000","last_undegraded":"2024-09-12T00:23:38.945468+0000","last_fullsized":"2024-09-12T00:23:38.945468+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-12T00:23:38.945282+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-12T00:23:38.945282+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.945282+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.103782+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.753618+0000","last_change":"2024-09-12T00:23:37.753618+0000","last_active":"2024-09-12T00:23:37.753618+0000","last_peered":"2024-09-12T00:23:37.753618+0000","last_clean":"2024-09-12T00:23:37.753618+0000","last_became_active":"2024-09-12T00:18:52.242491+0000","last_became_peered":"2024-09-12T00:18:52.242491+0000","last_unstale":"2024-09-12T00:23:37.753618+0000","last_undegraded":"2024-09-12T00:23:37.753618+0000","last_fullsized":"2024-09-12T00:23:37.753618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:37.753439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:37.753439+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.753439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:24.147808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'6","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.237461+0000","last_change":"2024-09-12T00:23:32.237461+0000","last_active":"2024-09-12T00:23:32.237461+0000","last_peered":"2024-09-12T00:23:32.237461+0000","last_clean":"2024-09-12T00:23:32.237461+0000","last_became_active":"2024-09-12T00:18:54.257806+0000","last_became_peered":"2024-09-12T00:18:54.257806+0000","last_unstale":"2024-09-12T00:23:32.237461+0000","last_undegraded":"2024-09-12T00:23:32.237461+0000","last_fullsized":"2024-09-12T00:23:32.237461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:32.237272+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.237272+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:27.360129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'18","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.652375+0000","last_change":"2024-09-12T00:22:56.652212+0000","last_active":"2024-09-12T00:22:56.652375+0000","last_peered":"2024-09-12T00:22:56.652375+0000","last_clean":"2024-09-12T00:22:56.652375+0000","last_became_active":"2024-09-12T00:18:46.189973+0000","last_became_peered":"2024-09-12T00:18:46.189973+0000","last_unstale":"2024-09-12T00:22:56.652375+0000","last_undegraded":"2024-09-12T00:22:56.652375+0000","last_fullsized":"2024-09-12T00:22:56.652375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-12T00:22:56.652038+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.652038+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.998075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":100,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.097480+0000","last_change":"2024-09-12T00:22:49.097322+0000","last_active":"2024-09-12T00:22:49.097480+0000","last_peered":"2024-09-12T00:22:49.097480+0000","last_clean":"2024-09-12T00:22:49.097480+0000","last_became_active":"2024-09-12T00:18:44.211881+0000","last_became_peered":"2024-09-12T00:18:44.211881+0000","last_unstale":"2024-09-12T00:22:49.097480+0000","last_undegraded":"2024-09-12T00:22:49.097480+0000","last_fullsized":"2024-09-12T00:22:49.097480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:49.097141+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.097141+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:19.046570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.793060+0000","last_change":"2024-09-12T00:23:08.792927+0000","last_active":"2024-09-12T00:23:08.793060+0000","last_peered":"2024-09-12T00:23:08.793060+0000","last_clean":"2024-09-12T00:23:08.793060+0000","last_became_active":"2024-09-12T00:18:48.204163+0000","last_became_peered":"2024-09-12T00:18:48.204163+0000","last_unstale":"2024-09-12T00:23:08.793060+0000","last_undegraded":"2024-09-12T00:23:08.793060+0000","last_fullsized":"2024-09-12T00:23:08.793060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.792752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.792752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:34.705253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'61","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.965661+0000","last_change":"2024-09-12T00:23:36.965661+0000","last_active":"2024-09-12T00:23:36.965661+0000","last_peered":"2024-09-12T00:23:36.965661+0000","last_clean":"2024-09-12T00:23:36.965661+0000","last_became_active":"2024-09-12T00:18:50.217859+0000","last_became_peered":"2024-09-12T00:18:50.217859+0000","last_unstale":"2024-09-12T00:23:36.965661+0000","last_undegraded":"2024-09-12T00:23:36.965661+0000","last_fullsized":"2024-09-12T00:23:36.965661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-09-12T00:23:36.965454+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.965454+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.860037+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'286","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.706053+0000","last_change":"2024-09-12T00:23:29.706053+0000","last_active":"2024-09-12T00:23:29.706053+0000","last_peered":"2024-09-12T00:23:29.706053+0000","last_clean":"2024-09-12T00:23:29.706053+0000","last_became_active":"2024-09-12T00:18:52.243066+0000","last_became_peered":"2024-09-12T00:18:52.243066+0000","last_unstale":"2024-09-12T00:23:29.706053+0000","last_undegraded":"2024-09-12T00:23:29.706053+0000","last_fullsized":"2024-09-12T00:23:29.706053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:29.705871+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.705871+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:17.737412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.745194+0000","last_change":"2024-09-12T00:23:34.745194+0000","last_active":"2024-09-12T00:23:34.745194+0000","last_peered":"2024-09-12T00:23:34.745194+0000","last_clean":"2024-09-12T00:23:34.745194+0000","last_became_active":"2024-09-12T00:18:54.267240+0000","last_became_peered":"2024-09-12T00:18:54.267240+0000","last_unstale":"2024-09-12T00:23:34.745194+0000","last_undegraded":"2024-09-12T00:23:34.745194+0000","last_fullsized":"2024-09-12T00:23:34.745194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:34.745014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.745014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:31.536554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.683417+0000","last_change":"2024-09-12T00:22:55.683235+0000","last_active":"2024-09-12T00:22:55.683417+0000","last_peered":"2024-09-12T00:22:55.683417+0000","last_clean":"2024-09-12T00:22:55.683417+0000","last_became_active":"2024-09-12T00:18:46.182511+0000","last_became_peered":"2024-09-12T00:18:46.182511+0000","last_unstale":"2024-09-12T00:22:55.683417+0000","last_undegraded":"2024-09-12T00:22:55.683417+0000","last_fullsized":"2024-09-12T00:22:55.683417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.683049+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.683049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:38.119930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.023749+0000","last_change":"2024-09-12T00:22:47.023618+0000","last_active":"2024-09-12T00:22:47.023749+0000","last_peered":"2024-09-12T00:22:47.023749+0000","last_clean":"2024-09-12T00:22:47.023749+0000","last_became_active":"2024-09-12T00:18:44.204822+0000","last_became_peered":"2024-09-12T00:18:44.204822+0000","last_unstale":"2024-09-12T00:22:47.023749+0000","last_undegraded":"2024-09-12T00:22:47.023749+0000","last_fullsized":"2024-09-12T00:22:47.023749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.023424+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.023424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:59.258309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.726263+0000","last_change":"2024-09-12T00:23:05.726024+0000","last_active":"2024-09-12T00:23:05.726263+0000","last_peered":"2024-09-12T00:23:05.726263+0000","last_clean":"2024-09-12T00:23:05.726263+0000","last_became_active":"2024-09-12T00:19:24.274622+0000","last_became_peered":"2024-09-12T00:19:24.274622+0000","last_unstale":"2024-09-12T00:23:05.726263+0000","last_undegraded":"2024-09-12T00:23:05.726263+0000","last_fullsized":"2024-09-12T00:23:05.726263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:05.725828+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.725828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:35.191271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'79","reported_seq":165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:37.915758+0000","last_change":"2024-09-12T00:23:37.915758+0000","last_active":"2024-09-12T00:23:37.915758+0000","last_peered":"2024-09-12T00:23:37.915758+0000","last_clean":"2024-09-12T00:23:37.915758+0000","last_became_active":"2024-09-12T00:18:50.240994+0000","last_became_peered":"2024-09-12T00:18:50.240994+0000","last_unstale":"2024-09-12T00:23:37.915758+0000","last_undegraded":"2024-09-12T00:23:37.915758+0000","last_fullsized":"2024-09-12T00:23:37.915758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'79","last_scrub_stamp":"2024-09-12T00:23:37.915538+0000","last_deep_scrub":"33'79","last_deep_scrub_stamp":"2024-09-12T00:23:37.915538+0000","last_clean_scrub_stamp":"2024-09-12T00:23:37.915538+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:25.317336+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.721415+0000","last_change":"2024-09-12T00:23:23.721415+0000","last_active":"2024-09-12T00:23:23.721415+0000","last_peered":"2024-09-12T00:23:23.721415+0000","last_clean":"2024-09-12T00:23:23.721415+0000","last_became_active":"2024-09-12T00:18:52.232305+0000","last_became_peered":"2024-09-12T00:18:52.232305+0000","last_unstale":"2024-09-12T00:23:23.721415+0000","last_undegraded":"2024-09-12T00:23:23.721415+0000","last_fullsized":"2024-09-12T00:23:23.721415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.721237+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.721237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.538900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'26","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.707322+0000","last_change":"2024-09-12T00:23:28.707322+0000","last_active":"2024-09-12T00:23:28.707322+0000","last_peered":"2024-09-12T00:23:28.707322+0000","last_clean":"2024-09-12T00:23:28.707322+0000","last_became_active":"2024-09-12T00:18:54.268835+0000","last_became_peered":"2024-09-12T00:18:54.268835+0000","last_unstale":"2024-09-12T00:23:28.707322+0000","last_undegraded":"2024-09-12T00:23:28.707322+0000","last_fullsized":"2024-09-12T00:23:28.707322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-12T00:23:28.707119+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.707119+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:33.980065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1325,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":44,"num_read_kb":43,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.393141+0000","last_change":"2024-09-12T00:22:54.392952+0000","last_active":"2024-09-12T00:22:54.393141+0000","last_peered":"2024-09-12T00:22:54.393141+0000","last_clean":"2024-09-12T00:22:54.393141+0000","last_became_active":"2024-09-12T00:19:24.293217+0000","last_became_peered":"2024-09-12T00:19:24.293217+0000","last_unstale":"2024-09-12T00:22:54.393141+0000","last_undegraded":"2024-09-12T00:22:54.393141+0000","last_fullsized":"2024-09-12T00:22:54.393141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:54.392767+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.392767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:12.866147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.874156+0000","last_change":"2024-09-12T00:22:46.874023+0000","last_active":"2024-09-12T00:22:46.874156+0000","last_peered":"2024-09-12T00:22:46.874156+0000","last_clean":"2024-09-12T00:22:46.874156+0000","last_became_active":"2024-09-12T00:18:44.181131+0000","last_became_peered":"2024-09-12T00:18:44.181131+0000","last_unstale":"2024-09-12T00:22:46.874156+0000","last_undegraded":"2024-09-12T00:22:46.874156+0000","last_fullsized":"2024-09-12T00:22:46.874156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.873837+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.873837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:16.339279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.705078+0000","last_change":"2024-09-12T00:23:07.704869+0000","last_active":"2024-09-12T00:23:07.705078+0000","last_peered":"2024-09-12T00:23:07.705078+0000","last_clean":"2024-09-12T00:23:07.705078+0000","last_became_active":"2024-09-12T00:18:48.204557+0000","last_became_peered":"2024-09-12T00:18:48.204557+0000","last_unstale":"2024-09-12T00:23:07.705078+0000","last_undegraded":"2024-09-12T00:23:07.705078+0000","last_fullsized":"2024-09-12T00:23:07.705078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:07.704656+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.704656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:23.063840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'48","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.176520+0000","last_change":"2024-09-12T00:23:22.176363+0000","last_active":"2024-09-12T00:23:22.176520+0000","last_peered":"2024-09-12T00:23:22.176520+0000","last_clean":"2024-09-12T00:23:22.176520+0000","last_became_active":"2024-09-12T00:18:50.216097+0000","last_became_peered":"2024-09-12T00:18:50.216097+0000","last_unstale":"2024-09-12T00:23:22.176520+0000","last_undegraded":"2024-09-12T00:23:22.176520+0000","last_fullsized":"2024-09-12T00:23:22.176520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-12T00:23:22.176164+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.176164+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:34.304576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:48.994938+0000","last_change":"2024-09-12T00:23:48.994938+0000","last_active":"2024-09-12T00:23:48.994938+0000","last_peered":"2024-09-12T00:23:48.994938+0000","last_clean":"2024-09-12T00:23:48.994938+0000","last_became_active":"2024-09-12T00:18:52.256107+0000","last_became_peered":"2024-09-12T00:18:52.256107+0000","last_unstale":"2024-09-12T00:23:48.994938+0000","last_undegraded":"2024-09-12T00:23:48.994938+0000","last_fullsized":"2024-09-12T00:23:48.994938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:48.994751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:48.994751+0000","last_clean_scrub_stamp":"2024-09-12T00:23:48.994751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:59.438963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:52.892253+0000","last_change":"2024-09-12T00:23:52.892253+0000","last_active":"2024-09-12T00:23:52.892253+0000","last_peered":"2024-09-12T00:23:52.892253+0000","last_clean":"2024-09-12T00:23:52.892253+0000","last_became_active":"2024-09-12T00:18:54.276014+0000","last_became_peered":"2024-09-12T00:18:54.276014+0000","last_unstale":"2024-09-12T00:23:52.892253+0000","last_undegraded":"2024-09-12T00:23:52.892253+0000","last_fullsized":"2024-09-12T00:23:52.892253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:52.892008+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:52.892008+0000","last_clean_scrub_stamp":"2024-09-12T00:23:52.892008+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.074728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'8","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.003649+0000","last_change":"2024-09-12T00:23:10.003493+0000","last_active":"2024-09-12T00:23:10.003649+0000","last_peered":"2024-09-12T00:23:10.003649+0000","last_clean":"2024-09-12T00:23:10.003649+0000","last_became_active":"2024-09-12T00:18:46.213646+0000","last_became_peered":"2024-09-12T00:18:46.213646+0000","last_unstale":"2024-09-12T00:23:10.003649+0000","last_undegraded":"2024-09-12T00:23:10.003649+0000","last_fullsized":"2024-09-12T00:23:10.003649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.003307+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.003307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:46.132710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.991804+0000","last_change":"2024-09-12T00:22:45.991549+0000","last_active":"2024-09-12T00:22:45.991804+0000","last_peered":"2024-09-12T00:22:45.991804+0000","last_clean":"2024-09-12T00:22:45.991804+0000","last_became_active":"2024-09-12T00:18:44.195267+0000","last_became_peered":"2024-09-12T00:18:44.195267+0000","last_unstale":"2024-09-12T00:22:45.991804+0000","last_undegraded":"2024-09-12T00:22:45.991804+0000","last_fullsized":"2024-09-12T00:22:45.991804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:45.991336+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.991336+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:42.782875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.823994+0000","last_change":"2024-09-12T00:23:10.823854+0000","last_active":"2024-09-12T00:23:10.823994+0000","last_peered":"2024-09-12T00:23:10.823994+0000","last_clean":"2024-09-12T00:23:10.823994+0000","last_became_active":"2024-09-12T00:18:48.205263+0000","last_became_peered":"2024-09-12T00:18:48.205263+0000","last_unstale":"2024-09-12T00:23:10.823994+0000","last_undegraded":"2024-09-12T00:23:10.823994+0000","last_fullsized":"2024-09-12T00:23:10.823994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.823673+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.823673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:48.346256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.712773+0000","last_change":"2024-09-12T00:23:15.712629+0000","last_active":"2024-09-12T00:23:15.712773+0000","last_peered":"2024-09-12T00:23:15.712773+0000","last_clean":"2024-09-12T00:23:15.712773+0000","last_became_active":"2024-09-12T00:18:50.205147+0000","last_became_peered":"2024-09-12T00:18:50.205147+0000","last_unstale":"2024-09-12T00:23:15.712773+0000","last_undegraded":"2024-09-12T00:23:15.712773+0000","last_fullsized":"2024-09-12T00:23:15.712773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:15.712426+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.712426+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:44.227558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'286","reported_seq":446,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.834812+0000","last_change":"2024-09-12T00:23:21.834664+0000","last_active":"2024-09-12T00:23:21.834812+0000","last_peered":"2024-09-12T00:23:21.834812+0000","last_clean":"2024-09-12T00:23:21.834812+0000","last_became_active":"2024-09-12T00:18:52.246006+0000","last_became_peered":"2024-09-12T00:18:52.246006+0000","last_unstale":"2024-09-12T00:23:21.834812+0000","last_undegraded":"2024-09-12T00:23:21.834812+0000","last_fullsized":"2024-09-12T00:23:21.834812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:21.834474+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.834474+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.429146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:32.724078+0000","last_change":"2024-09-12T00:23:32.724078+0000","last_active":"2024-09-12T00:23:32.724078+0000","last_peered":"2024-09-12T00:23:32.724078+0000","last_clean":"2024-09-12T00:23:32.724078+0000","last_became_active":"2024-09-12T00:18:54.260757+0000","last_became_peered":"2024-09-12T00:18:54.260757+0000","last_unstale":"2024-09-12T00:23:32.724078+0000","last_undegraded":"2024-09-12T00:23:32.724078+0000","last_fullsized":"2024-09-12T00:23:32.724078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-12T00:23:32.723839+0000","last_clean_scrub_stamp":"2024-09-12T00:23:32.723839+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.576755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'12","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.687472+0000","last_change":"2024-09-12T00:22:57.687239+0000","last_active":"2024-09-12T00:22:57.687472+0000","last_peered":"2024-09-12T00:22:57.687472+0000","last_clean":"2024-09-12T00:22:57.687472+0000","last_became_active":"2024-09-12T00:18:46.190442+0000","last_became_peered":"2024-09-12T00:18:46.190442+0000","last_unstale":"2024-09-12T00:22:57.687472+0000","last_undegraded":"2024-09-12T00:22:57.687472+0000","last_fullsized":"2024-09-12T00:22:57.687472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:57.687015+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.687015+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:52.889888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:48.055380+0000","last_change":"2024-09-12T00:22:48.055242+0000","last_active":"2024-09-12T00:22:48.055380+0000","last_peered":"2024-09-12T00:22:48.055380+0000","last_clean":"2024-09-12T00:22:48.055380+0000","last_became_active":"2024-09-12T00:18:44.204633+0000","last_became_peered":"2024-09-12T00:18:44.204633+0000","last_unstale":"2024-09-12T00:22:48.055380+0000","last_undegraded":"2024-09-12T00:22:48.055380+0000","last_fullsized":"2024-09-12T00:22:48.055380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:48.055065+0000","last_clean_scrub_stamp":"2024-09-12T00:22:48.055065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:08.979877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.389518+0000","last_change":"2024-09-12T00:23:12.389268+0000","last_active":"2024-09-12T00:23:12.389518+0000","last_peered":"2024-09-12T00:23:12.389518+0000","last_clean":"2024-09-12T00:23:12.389518+0000","last_became_active":"2024-09-12T00:18:48.202656+0000","last_became_peered":"2024-09-12T00:18:48.202656+0000","last_unstale":"2024-09-12T00:23:12.389518+0000","last_undegraded":"2024-09-12T00:23:12.389518+0000","last_fullsized":"2024-09-12T00:23:12.389518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:12.389028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.389028+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.911611+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:40.976487+0000","last_change":"2024-09-12T00:23:40.976487+0000","last_active":"2024-09-12T00:23:40.976487+0000","last_peered":"2024-09-12T00:23:40.976487+0000","last_clean":"2024-09-12T00:23:40.976487+0000","last_became_active":"2024-09-12T00:18:50.242244+0000","last_became_peered":"2024-09-12T00:18:50.242244+0000","last_unstale":"2024-09-12T00:23:40.976487+0000","last_undegraded":"2024-09-12T00:23:40.976487+0000","last_fullsized":"2024-09-12T00:23:40.976487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-12T00:23:40.976251+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-12T00:23:40.976251+0000","last_clean_scrub_stamp":"2024-09-12T00:23:40.976251+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:04.768070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'286","reported_seq":483,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.117161+0000","last_change":"2024-09-12T00:23:26.117161+0000","last_active":"2024-09-12T00:23:26.117161+0000","last_peered":"2024-09-12T00:23:26.117161+0000","last_clean":"2024-09-12T00:23:26.117161+0000","last_became_active":"2024-09-12T00:18:52.238109+0000","last_became_peered":"2024-09-12T00:18:52.238109+0000","last_unstale":"2024-09-12T00:23:26.117161+0000","last_undegraded":"2024-09-12T00:23:26.117161+0000","last_fullsized":"2024-09-12T00:23:26.117161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:26.116977+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.116977+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:01.457204+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.774401+0000","last_change":"2024-09-12T00:23:26.774401+0000","last_active":"2024-09-12T00:23:26.774401+0000","last_peered":"2024-09-12T00:23:26.774401+0000","last_clean":"2024-09-12T00:23:26.774401+0000","last_became_active":"2024-09-12T00:18:54.252468+0000","last_became_peered":"2024-09-12T00:18:54.252468+0000","last_unstale":"2024-09-12T00:23:26.774401+0000","last_undegraded":"2024-09-12T00:23:26.774401+0000","last_fullsized":"2024-09-12T00:23:26.774401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:26.774216+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.774216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:19.792583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.426031+0000","last_change":"2024-09-12T00:22:53.425858+0000","last_active":"2024-09-12T00:22:53.426031+0000","last_peered":"2024-09-12T00:22:53.426031+0000","last_clean":"2024-09-12T00:22:53.426031+0000","last_became_active":"2024-09-12T00:18:46.211302+0000","last_became_peered":"2024-09-12T00:18:46.211302+0000","last_unstale":"2024-09-12T00:22:53.426031+0000","last_undegraded":"2024-09-12T00:22:53.426031+0000","last_fullsized":"2024-09-12T00:22:53.426031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:53.425681+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.425681+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:50.989571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.037177+0000","last_change":"2024-09-12T00:22:45.037018+0000","last_active":"2024-09-12T00:22:45.037177+0000","last_peered":"2024-09-12T00:22:45.037177+0000","last_clean":"2024-09-12T00:22:45.037177+0000","last_became_active":"2024-09-12T00:18:44.202285+0000","last_became_peered":"2024-09-12T00:18:44.202285+0000","last_unstale":"2024-09-12T00:22:45.037177+0000","last_undegraded":"2024-09-12T00:22:45.037177+0000","last_fullsized":"2024-09-12T00:22:45.037177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.036831+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.036831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:05.107642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.973980+0000","last_change":"2024-09-12T00:23:29.973980+0000","last_active":"2024-09-12T00:23:29.973980+0000","last_peered":"2024-09-12T00:23:29.973980+0000","last_clean":"2024-09-12T00:23:29.973980+0000","last_became_active":"2024-09-12T00:18:48.223387+0000","last_became_peered":"2024-09-12T00:18:48.223387+0000","last_unstale":"2024-09-12T00:23:29.973980+0000","last_undegraded":"2024-09-12T00:23:29.973980+0000","last_fullsized":"2024-09-12T00:23:29.973980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.973764+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.973764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:26.938202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.225959+0000","last_change":"2024-09-12T00:23:21.225814+0000","last_active":"2024-09-12T00:23:21.225959+0000","last_peered":"2024-09-12T00:23:21.225959+0000","last_clean":"2024-09-12T00:23:21.225959+0000","last_became_active":"2024-09-12T00:18:50.228854+0000","last_became_peered":"2024-09-12T00:18:50.228854+0000","last_unstale":"2024-09-12T00:23:21.225959+0000","last_undegraded":"2024-09-12T00:23:21.225959+0000","last_fullsized":"2024-09-12T00:23:21.225959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-12T00:23:21.225622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.225622+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.693429+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.787743+0000","last_change":"2024-09-12T00:23:22.787743+0000","last_active":"2024-09-12T00:23:22.787743+0000","last_peered":"2024-09-12T00:23:22.787743+0000","last_clean":"2024-09-12T00:23:22.787743+0000","last_became_active":"2024-09-12T00:18:52.263657+0000","last_became_peered":"2024-09-12T00:18:52.263657+0000","last_unstale":"2024-09-12T00:23:22.787743+0000","last_undegraded":"2024-09-12T00:23:22.787743+0000","last_fullsized":"2024-09-12T00:23:22.787743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:22.787566+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.787566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:44.124023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.267444+0000","last_change":"2024-09-12T00:23:31.267444+0000","last_active":"2024-09-12T00:23:31.267444+0000","last_peered":"2024-09-12T00:23:31.267444+0000","last_clean":"2024-09-12T00:23:31.267444+0000","last_became_active":"2024-09-12T00:18:54.249155+0000","last_became_peered":"2024-09-12T00:18:54.249155+0000","last_unstale":"2024-09-12T00:23:31.267444+0000","last_undegraded":"2024-09-12T00:23:31.267444+0000","last_fullsized":"2024-09-12T00:23:31.267444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-12T00:23:31.267222+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.267222+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:19.298763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.741818+0000","last_change":"2024-09-12T00:22:53.741667+0000","last_active":"2024-09-12T00:22:53.741818+0000","last_peered":"2024-09-12T00:22:53.741818+0000","last_clean":"2024-09-12T00:22:53.741818+0000","last_became_active":"2024-09-12T00:19:24.277794+0000","last_became_peered":"2024-09-12T00:19:24.277794+0000","last_unstale":"2024-09-12T00:22:53.741818+0000","last_undegraded":"2024-09-12T00:22:53.741818+0000","last_fullsized":"2024-09-12T00:22:53.741818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:53.741481+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.741481+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:54.588986+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":157,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.330431+0000","last_change":"2024-09-12T00:22:38.330431+0000","last_active":"2024-09-12T00:22:38.330431+0000","last_peered":"2024-09-12T00:22:38.330431+0000","last_clean":"2024-09-12T00:22:38.330431+0000","last_became_active":"2024-09-12T00:18:30.030694+0000","last_became_peered":"2024-09-12T00:18:30.030694+0000","last_unstale":"2024-09-12T00:22:38.330431+0000","last_undegraded":"2024-09-12T00:22:38.330431+0000","last_fullsized":"2024-09-12T00:22:38.330431+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-12T00:22:38.330231+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.330231+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:47.818803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.088492+0000","last_change":"2024-09-12T00:22:40.088223+0000","last_active":"2024-09-12T00:22:40.088492+0000","last_peered":"2024-09-12T00:22:40.088492+0000","last_clean":"2024-09-12T00:22:40.088492+0000","last_became_active":"2024-09-12T00:18:34.617302+0000","last_became_peered":"2024-09-12T00:18:34.617302+0000","last_unstale":"2024-09-12T00:22:40.088492+0000","last_undegraded":"2024-09-12T00:22:40.088492+0000","last_fullsized":"2024-09-12T00:22:40.088492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:40.087970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.087970+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:17.489548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012541399999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.015916+0000","last_change":"2024-09-12T00:22:43.015652+0000","last_active":"2024-09-12T00:22:43.015916+0000","last_peered":"2024-09-12T00:22:43.015916+0000","last_clean":"2024-09-12T00:22:43.015916+0000","last_became_active":"2024-09-12T00:18:44.210565+0000","last_became_peered":"2024-09-12T00:18:44.210565+0000","last_unstale":"2024-09-12T00:22:43.015916+0000","last_undegraded":"2024-09-12T00:22:43.015916+0000","last_fullsized":"2024-09-12T00:22:43.015916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:43.015422+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.015422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:23.844048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.395580+0000","last_change":"2024-09-12T00:23:10.395580+0000","last_active":"2024-09-12T00:23:10.395580+0000","last_peered":"2024-09-12T00:23:10.395580+0000","last_clean":"2024-09-12T00:23:10.395580+0000","last_became_active":"2024-09-12T00:18:48.211431+0000","last_became_peered":"2024-09-12T00:18:48.211431+0000","last_unstale":"2024-09-12T00:23:10.395580+0000","last_undegraded":"2024-09-12T00:23:10.395580+0000","last_fullsized":"2024-09-12T00:23:10.395580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.395395+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.395395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.307896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'97","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.996724+0000","last_change":"2024-09-12T00:23:35.996724+0000","last_active":"2024-09-12T00:23:35.996724+0000","last_peered":"2024-09-12T00:23:35.996724+0000","last_clean":"2024-09-12T00:23:35.996724+0000","last_became_active":"2024-09-12T00:18:50.244288+0000","last_became_peered":"2024-09-12T00:18:50.244288+0000","last_unstale":"2024-09-12T00:23:35.996724+0000","last_undegraded":"2024-09-12T00:23:35.996724+0000","last_fullsized":"2024-09-12T00:23:35.996724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-12T00:23:35.996525+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.996525+0000","objects_scrubbed":6,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:04.788244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.785001+0000","last_change":"2024-09-12T00:23:15.785001+0000","last_active":"2024-09-12T00:23:15.785001+0000","last_peered":"2024-09-12T00:23:15.785001+0000","last_clean":"2024-09-12T00:23:15.785001+0000","last_became_active":"2024-09-12T00:18:52.244186+0000","last_became_peered":"2024-09-12T00:18:52.244186+0000","last_unstale":"2024-09-12T00:23:15.785001+0000","last_undegraded":"2024-09-12T00:23:15.785001+0000","last_fullsized":"2024-09-12T00:23:15.785001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.784792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.784792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:05.198107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'82","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.727983+0000","last_change":"2024-09-12T00:23:28.727983+0000","last_active":"2024-09-12T00:23:28.727983+0000","last_peered":"2024-09-12T00:23:28.727983+0000","last_clean":"2024-09-12T00:23:28.727983+0000","last_became_active":"2024-09-12T00:18:54.251283+0000","last_became_peered":"2024-09-12T00:18:54.251283+0000","last_unstale":"2024-09-12T00:23:28.727983+0000","last_undegraded":"2024-09-12T00:23:28.727983+0000","last_fullsized":"2024-09-12T00:23:28.727983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'82","last_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_deep_scrub":"33'82","last_deep_scrub_stamp":"2024-09-12T00:23:28.727807+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.727807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:37.735238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.038978+0000","last_change":"2024-09-12T00:23:08.038978+0000","last_active":"2024-09-12T00:23:08.038978+0000","last_peered":"2024-09-12T00:23:08.038978+0000","last_clean":"2024-09-12T00:23:08.038978+0000","last_became_active":"2024-09-12T00:18:46.187599+0000","last_became_peered":"2024-09-12T00:18:46.187599+0000","last_unstale":"2024-09-12T00:23:08.038978+0000","last_undegraded":"2024-09-12T00:23:08.038978+0000","last_fullsized":"2024-09-12T00:23:08.038978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:08.038792+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.038792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:47.713400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.101143+0000","last_change":"2024-09-12T00:22:38.101143+0000","last_active":"2024-09-12T00:22:38.101143+0000","last_peered":"2024-09-12T00:22:38.101143+0000","last_clean":"2024-09-12T00:22:38.101143+0000","last_became_active":"2024-09-12T00:18:34.623042+0000","last_became_peered":"2024-09-12T00:18:34.623042+0000","last_unstale":"2024-09-12T00:22:38.101143+0000","last_undegraded":"2024-09-12T00:22:38.101143+0000","last_fullsized":"2024-09-12T00:22:38.101143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.100967+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.100967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:57.104038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013420800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'3","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.819521+0000","last_change":"2024-09-12T00:22:41.819357+0000","last_active":"2024-09-12T00:22:41.819521+0000","last_peered":"2024-09-12T00:22:41.819521+0000","last_clean":"2024-09-12T00:22:41.819521+0000","last_became_active":"2024-09-12T00:18:44.197379+0000","last_became_peered":"2024-09-12T00:18:44.197379+0000","last_unstale":"2024-09-12T00:22:41.819521+0000","last_undegraded":"2024-09-12T00:22:41.819521+0000","last_fullsized":"2024-09-12T00:22:41.819521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:41.819171+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.819171+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.252502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.975236+0000","last_change":"2024-09-12T00:23:27.975236+0000","last_active":"2024-09-12T00:23:27.975236+0000","last_peered":"2024-09-12T00:23:27.975236+0000","last_clean":"2024-09-12T00:23:27.975236+0000","last_became_active":"2024-09-12T00:18:48.222115+0000","last_became_peered":"2024-09-12T00:18:48.222115+0000","last_unstale":"2024-09-12T00:23:27.975236+0000","last_undegraded":"2024-09-12T00:23:27.975236+0000","last_fullsized":"2024-09-12T00:23:27.975236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.975054+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.975054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.142602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'301","reported_seq":534,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.254372+0000","last_change":"2024-09-12T00:23:20.254372+0000","last_active":"2024-09-12T00:23:20.254372+0000","last_peered":"2024-09-12T00:23:20.254372+0000","last_clean":"2024-09-12T00:23:20.254372+0000","last_became_active":"2024-09-12T00:18:50.227869+0000","last_became_peered":"2024-09-12T00:18:50.227869+0000","last_unstale":"2024-09-12T00:23:20.254372+0000","last_undegraded":"2024-09-12T00:23:20.254372+0000","last_fullsized":"2024-09-12T00:23:20.254372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'301","last_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_deep_scrub":"33'301","last_deep_scrub_stamp":"2024-09-12T00:23:20.254181+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.254181+0000","objects_scrubbed":11,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.785930+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:46.989824+0000","last_change":"2024-09-12T00:23:46.989824+0000","last_active":"2024-09-12T00:23:46.989824+0000","last_peered":"2024-09-12T00:23:46.989824+0000","last_clean":"2024-09-12T00:23:46.989824+0000","last_became_active":"2024-09-12T00:18:52.254884+0000","last_became_peered":"2024-09-12T00:18:52.254884+0000","last_unstale":"2024-09-12T00:23:46.989824+0000","last_undegraded":"2024-09-12T00:23:46.989824+0000","last_fullsized":"2024-09-12T00:23:46.989824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:46.989642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:46.989642+0000","last_clean_scrub_stamp":"2024-09-12T00:23:46.989642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:54.258889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:34.274760+0000","last_change":"2024-09-12T00:23:34.274760+0000","last_active":"2024-09-12T00:23:34.274760+0000","last_peered":"2024-09-12T00:23:34.274760+0000","last_clean":"2024-09-12T00:23:34.274760+0000","last_became_active":"2024-09-12T00:18:54.257442+0000","last_became_peered":"2024-09-12T00:18:54.257442+0000","last_unstale":"2024-09-12T00:23:34.274760+0000","last_undegraded":"2024-09-12T00:23:34.274760+0000","last_fullsized":"2024-09-12T00:23:34.274760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:34.274531+0000","last_clean_scrub_stamp":"2024-09-12T00:23:34.274531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.127447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.892856+0000","last_change":"2024-09-12T00:22:56.892682+0000","last_active":"2024-09-12T00:22:56.892856+0000","last_peered":"2024-09-12T00:22:56.892856+0000","last_clean":"2024-09-12T00:22:56.892856+0000","last_became_active":"2024-09-12T00:18:46.210027+0000","last_became_peered":"2024-09-12T00:18:46.210027+0000","last_unstale":"2024-09-12T00:22:56.892856+0000","last_undegraded":"2024-09-12T00:22:56.892856+0000","last_fullsized":"2024-09-12T00:22:56.892856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:56.892476+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.892476+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:41.105061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":37,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.794403+0000","last_change":"2024-09-12T00:22:38.794195+0000","last_active":"2024-09-12T00:22:38.794403+0000","last_peered":"2024-09-12T00:22:38.794403+0000","last_clean":"2024-09-12T00:22:38.794403+0000","last_became_active":"2024-09-12T00:18:34.623153+0000","last_became_peered":"2024-09-12T00:18:34.623153+0000","last_unstale":"2024-09-12T00:22:38.794403+0000","last_undegraded":"2024-09-12T00:22:38.794403+0000","last_fullsized":"2024-09-12T00:22:38.794403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.794009+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.794009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:39.382664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093827600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.745657+0000","last_change":"2024-09-12T00:22:39.745499+0000","last_active":"2024-09-12T00:22:39.745657+0000","last_peered":"2024-09-12T00:22:39.745657+0000","last_clean":"2024-09-12T00:22:39.745657+0000","last_became_active":"2024-09-12T00:18:44.197017+0000","last_became_peered":"2024-09-12T00:18:44.197017+0000","last_unstale":"2024-09-12T00:22:39.745657+0000","last_undegraded":"2024-09-12T00:22:39.745657+0000","last_fullsized":"2024-09-12T00:22:39.745657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:39.745298+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.745298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.209943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:06.757419+0000","last_change":"2024-09-12T00:23:06.757280+0000","last_active":"2024-09-12T00:23:06.757419+0000","last_peered":"2024-09-12T00:23:06.757419+0000","last_clean":"2024-09-12T00:23:06.757419+0000","last_became_active":"2024-09-12T00:18:48.196629+0000","last_became_peered":"2024-09-12T00:18:48.196629+0000","last_unstale":"2024-09-12T00:23:06.757419+0000","last_undegraded":"2024-09-12T00:23:06.757419+0000","last_fullsized":"2024-09-12T00:23:06.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:06.757101+0000","last_clean_scrub_stamp":"2024-09-12T00:23:06.757101+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:36.253152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.804413+0000","last_change":"2024-09-12T00:23:13.804413+0000","last_active":"2024-09-12T00:23:13.804413+0000","last_peered":"2024-09-12T00:23:13.804413+0000","last_clean":"2024-09-12T00:23:13.804413+0000","last_became_active":"2024-09-12T00:18:50.235238+0000","last_became_peered":"2024-09-12T00:18:50.235238+0000","last_unstale":"2024-09-12T00:23:13.804413+0000","last_undegraded":"2024-09-12T00:23:13.804413+0000","last_fullsized":"2024-09-12T00:23:13.804413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-12T00:23:13.804104+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.804104+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.235994+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:21.731479+0000","last_change":"2024-09-12T00:23:21.731479+0000","last_active":"2024-09-12T00:23:21.731479+0000","last_peered":"2024-09-12T00:23:21.731479+0000","last_clean":"2024-09-12T00:23:21.731479+0000","last_became_active":"2024-09-12T00:18:52.244418+0000","last_became_peered":"2024-09-12T00:18:52.244418+0000","last_unstale":"2024-09-12T00:23:21.731479+0000","last_undegraded":"2024-09-12T00:23:21.731479+0000","last_fullsized":"2024-09-12T00:23:21.731479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:21.731300+0000","last_clean_scrub_stamp":"2024-09-12T00:23:21.731300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:06.532025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:24:01.814366+0000","last_change":"2024-09-12T00:24:01.814366+0000","last_active":"2024-09-12T00:24:01.814366+0000","last_peered":"2024-09-12T00:24:01.814366+0000","last_clean":"2024-09-12T00:24:01.814366+0000","last_became_active":"2024-09-12T00:18:54.264563+0000","last_became_peered":"2024-09-12T00:18:54.264563+0000","last_unstale":"2024-09-12T00:24:01.814366+0000","last_undegraded":"2024-09-12T00:24:01.814366+0000","last_fullsized":"2024-09-12T00:24:01.814366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:24:01.814188+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:24:01.814188+0000","last_clean_scrub_stamp":"2024-09-12T00:24:01.814188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:19.880301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:50.935849+0000","last_change":"2024-09-12T00:22:50.935612+0000","last_active":"2024-09-12T00:22:50.935849+0000","last_peered":"2024-09-12T00:22:50.935849+0000","last_clean":"2024-09-12T00:22:50.935849+0000","last_became_active":"2024-09-12T00:18:46.200204+0000","last_became_peered":"2024-09-12T00:18:46.200204+0000","last_unstale":"2024-09-12T00:22:50.935849+0000","last_undegraded":"2024-09-12T00:22:50.935849+0000","last_fullsized":"2024-09-12T00:22:50.935849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:50.935377+0000","last_clean_scrub_stamp":"2024-09-12T00:22:50.935377+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:27.379599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.123005+0000","last_change":"2024-09-12T00:22:39.122842+0000","last_active":"2024-09-12T00:22:39.123005+0000","last_peered":"2024-09-12T00:22:39.123005+0000","last_clean":"2024-09-12T00:22:39.123005+0000","last_became_active":"2024-09-12T00:18:34.621894+0000","last_became_peered":"2024-09-12T00:18:34.621894+0000","last_unstale":"2024-09-12T00:22:39.123005+0000","last_undegraded":"2024-09-12T00:22:39.123005+0000","last_fullsized":"2024-09-12T00:22:39.123005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:22:39.122671+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.122671+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:40.081831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026510539999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.755968+0000","last_change":"2024-09-12T00:22:37.755805+0000","last_active":"2024-09-12T00:22:37.755968+0000","last_peered":"2024-09-12T00:22:37.755968+0000","last_clean":"2024-09-12T00:22:37.755968+0000","last_became_active":"2024-09-12T00:18:44.210377+0000","last_became_peered":"2024-09-12T00:18:44.210377+0000","last_unstale":"2024-09-12T00:22:37.755968+0000","last_undegraded":"2024-09-12T00:22:37.755968+0000","last_fullsized":"2024-09-12T00:22:37.755968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:37.755556+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.755556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:00.374036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.892359+0000","last_change":"2024-09-12T00:23:04.892359+0000","last_active":"2024-09-12T00:23:04.892359+0000","last_peered":"2024-09-12T00:23:04.892359+0000","last_clean":"2024-09-12T00:23:04.892359+0000","last_became_active":"2024-09-12T00:18:48.208277+0000","last_became_peered":"2024-09-12T00:18:48.208277+0000","last_unstale":"2024-09-12T00:23:04.892359+0000","last_undegraded":"2024-09-12T00:23:04.892359+0000","last_fullsized":"2024-09-12T00:23:04.892359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:04.892143+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.892143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.673491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.012551+0000","last_change":"2024-09-12T00:23:35.012551+0000","last_active":"2024-09-12T00:23:35.012551+0000","last_peered":"2024-09-12T00:23:35.012551+0000","last_clean":"2024-09-12T00:23:35.012551+0000","last_became_active":"2024-09-12T00:18:50.244088+0000","last_became_peered":"2024-09-12T00:18:50.244088+0000","last_unstale":"2024-09-12T00:23:35.012551+0000","last_undegraded":"2024-09-12T00:23:35.012551+0000","last_fullsized":"2024-09-12T00:23:35.012551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-12T00:23:35.012329+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.012329+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:29.415526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:47.985153+0000","last_change":"2024-09-12T00:23:47.985153+0000","last_active":"2024-09-12T00:23:47.985153+0000","last_peered":"2024-09-12T00:23:47.985153+0000","last_clean":"2024-09-12T00:23:47.985153+0000","last_became_active":"2024-09-12T00:18:52.260288+0000","last_became_peered":"2024-09-12T00:18:52.260288+0000","last_unstale":"2024-09-12T00:23:47.985153+0000","last_undegraded":"2024-09-12T00:23:47.985153+0000","last_fullsized":"2024-09-12T00:23:47.985153+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:47.984943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:47.984943+0000","last_clean_scrub_stamp":"2024-09-12T00:23:47.984943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:50.037110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.235128+0000","last_change":"2024-09-12T00:23:33.235128+0000","last_active":"2024-09-12T00:23:33.235128+0000","last_peered":"2024-09-12T00:23:33.235128+0000","last_clean":"2024-09-12T00:23:33.235128+0000","last_became_active":"2024-09-12T00:18:54.265169+0000","last_became_peered":"2024-09-12T00:18:54.265169+0000","last_unstale":"2024-09-12T00:23:33.235128+0000","last_undegraded":"2024-09-12T00:23:33.235128+0000","last_fullsized":"2024-09-12T00:23:33.235128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:33.234948+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.234948+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:32.748974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.391150+0000","last_change":"2024-09-12T00:22:51.390965+0000","last_active":"2024-09-12T00:22:51.391150+0000","last_peered":"2024-09-12T00:22:51.391150+0000","last_clean":"2024-09-12T00:22:51.391150+0000","last_became_active":"2024-09-12T00:18:46.212805+0000","last_became_peered":"2024-09-12T00:18:46.212805+0000","last_unstale":"2024-09-12T00:22:51.391150+0000","last_undegraded":"2024-09-12T00:22:51.391150+0000","last_fullsized":"2024-09-12T00:22:51.391150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:51.390779+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.390779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:45.398139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.771257+0000","last_change":"2024-09-12T00:22:39.771132+0000","last_active":"2024-09-12T00:22:39.771257+0000","last_peered":"2024-09-12T00:22:39.771257+0000","last_clean":"2024-09-12T00:22:39.771257+0000","last_became_active":"2024-09-12T00:18:44.194191+0000","last_became_peered":"2024-09-12T00:18:44.194191+0000","last_unstale":"2024-09-12T00:22:39.771257+0000","last_undegraded":"2024-09-12T00:22:39.771257+0000","last_fullsized":"2024-09-12T00:22:39.771257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:39.770939+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.770939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.724696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:38.712557+0000","last_change":"2024-09-12T00:22:38.712422+0000","last_active":"2024-09-12T00:22:38.712557+0000","last_peered":"2024-09-12T00:22:38.712557+0000","last_clean":"2024-09-12T00:22:38.712557+0000","last_became_active":"2024-09-12T00:18:34.624381+0000","last_became_peered":"2024-09-12T00:18:34.624381+0000","last_unstale":"2024-09-12T00:22:38.712557+0000","last_undegraded":"2024-09-12T00:22:38.712557+0000","last_fullsized":"2024-09-12T00:22:38.712557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:38.712222+0000","last_clean_scrub_stamp":"2024-09-12T00:22:38.712222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:33.915095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001049049,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.877769+0000","last_change":"2024-09-12T00:23:05.877769+0000","last_active":"2024-09-12T00:23:05.877769+0000","last_peered":"2024-09-12T00:23:05.877769+0000","last_clean":"2024-09-12T00:23:05.877769+0000","last_became_active":"2024-09-12T00:18:48.206441+0000","last_became_peered":"2024-09-12T00:18:48.206441+0000","last_unstale":"2024-09-12T00:23:05.877769+0000","last_undegraded":"2024-09-12T00:23:05.877769+0000","last_fullsized":"2024-09-12T00:23:05.877769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:05.877586+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.877586+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:55.254000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'92","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.753759+0000","last_change":"2024-09-12T00:23:16.753759+0000","last_active":"2024-09-12T00:23:16.753759+0000","last_peered":"2024-09-12T00:23:16.753759+0000","last_clean":"2024-09-12T00:23:16.753759+0000","last_became_active":"2024-09-12T00:18:50.224024+0000","last_became_peered":"2024-09-12T00:18:50.224024+0000","last_unstale":"2024-09-12T00:23:16.753759+0000","last_undegraded":"2024-09-12T00:23:16.753759+0000","last_fullsized":"2024-09-12T00:23:16.753759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-12T00:23:16.753506+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.753506+0000","objects_scrubbed":11,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.903478+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.804833+0000","last_change":"2024-09-12T00:23:19.804833+0000","last_active":"2024-09-12T00:23:19.804833+0000","last_peered":"2024-09-12T00:23:19.804833+0000","last_clean":"2024-09-12T00:23:19.804833+0000","last_became_active":"2024-09-12T00:18:52.245876+0000","last_became_peered":"2024-09-12T00:18:52.245876+0000","last_unstale":"2024-09-12T00:23:19.804833+0000","last_undegraded":"2024-09-12T00:23:19.804833+0000","last_fullsized":"2024-09-12T00:23:19.804833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:19.804652+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.804652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:53.743040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'11","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.739376+0000","last_change":"2024-09-12T00:23:35.739376+0000","last_active":"2024-09-12T00:23:35.739376+0000","last_peered":"2024-09-12T00:23:35.739376+0000","last_clean":"2024-09-12T00:23:35.739376+0000","last_became_active":"2024-09-12T00:18:54.255986+0000","last_became_peered":"2024-09-12T00:18:54.255986+0000","last_unstale":"2024-09-12T00:23:35.739376+0000","last_undegraded":"2024-09-12T00:23:35.739376+0000","last_fullsized":"2024-09-12T00:23:35.739376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-12T00:23:35.739191+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.739191+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:30.348394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.727046+0000","last_change":"2024-09-12T00:22:54.726884+0000","last_active":"2024-09-12T00:22:54.727046+0000","last_peered":"2024-09-12T00:22:54.727046+0000","last_clean":"2024-09-12T00:22:54.727046+0000","last_became_active":"2024-09-12T00:19:24.289368+0000","last_became_peered":"2024-09-12T00:19:24.289368+0000","last_unstale":"2024-09-12T00:22:54.727046+0000","last_undegraded":"2024-09-12T00:22:54.727046+0000","last_fullsized":"2024-09-12T00:22:54.727046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:54.726712+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.726712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:01.342735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.855296+0000","last_change":"2024-09-12T00:22:42.855131+0000","last_active":"2024-09-12T00:22:42.855296+0000","last_peered":"2024-09-12T00:22:42.855296+0000","last_clean":"2024-09-12T00:22:42.855296+0000","last_became_active":"2024-09-12T00:18:44.198841+0000","last_became_peered":"2024-09-12T00:18:44.198841+0000","last_unstale":"2024-09-12T00:22:42.855296+0000","last_undegraded":"2024-09-12T00:22:42.855296+0000","last_fullsized":"2024-09-12T00:22:42.855296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.854911+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.854911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:10.063391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:41.050175+0000","last_change":"2024-09-12T00:22:41.050057+0000","last_active":"2024-09-12T00:22:41.050175+0000","last_peered":"2024-09-12T00:22:41.050175+0000","last_clean":"2024-09-12T00:22:41.050175+0000","last_became_active":"2024-09-12T00:18:34.622736+0000","last_became_peered":"2024-09-12T00:18:34.622736+0000","last_unstale":"2024-09-12T00:22:41.050175+0000","last_undegraded":"2024-09-12T00:22:41.050175+0000","last_fullsized":"2024-09-12T00:22:41.050175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:41.049881+0000","last_clean_scrub_stamp":"2024-09-12T00:22:41.049881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:33.601411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028700610000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.928997+0000","last_change":"2024-09-12T00:23:26.928997+0000","last_active":"2024-09-12T00:23:26.928997+0000","last_peered":"2024-09-12T00:23:26.928997+0000","last_clean":"2024-09-12T00:23:26.928997+0000","last_became_active":"2024-09-12T00:19:24.301562+0000","last_became_peered":"2024-09-12T00:19:24.301562+0000","last_unstale":"2024-09-12T00:23:26.928997+0000","last_undegraded":"2024-09-12T00:23:26.928997+0000","last_fullsized":"2024-09-12T00:23:26.928997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.928808+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.928808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:06.461175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'28","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.296031+0000","last_change":"2024-09-12T00:23:19.296031+0000","last_active":"2024-09-12T00:23:19.296031+0000","last_peered":"2024-09-12T00:23:19.296031+0000","last_clean":"2024-09-12T00:23:19.296031+0000","last_became_active":"2024-09-12T00:18:50.229356+0000","last_became_peered":"2024-09-12T00:18:50.229356+0000","last_unstale":"2024-09-12T00:23:19.296031+0000","last_undegraded":"2024-09-12T00:23:19.296031+0000","last_fullsized":"2024-09-12T00:23:19.296031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-09-12T00:23:19.295840+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.295840+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:23.390911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'286","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.131018+0000","last_change":"2024-09-12T00:23:25.131018+0000","last_active":"2024-09-12T00:23:25.131018+0000","last_peered":"2024-09-12T00:23:25.131018+0000","last_clean":"2024-09-12T00:23:25.131018+0000","last_became_active":"2024-09-12T00:18:52.230561+0000","last_became_peered":"2024-09-12T00:18:52.230561+0000","last_unstale":"2024-09-12T00:23:25.131018+0000","last_undegraded":"2024-09-12T00:23:25.131018+0000","last_fullsized":"2024-09-12T00:23:25.131018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:25.130835+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.130835+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:22.948498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:54.860254+0000","last_change":"2024-09-12T00:23:54.860254+0000","last_active":"2024-09-12T00:23:54.860254+0000","last_peered":"2024-09-12T00:23:54.860254+0000","last_clean":"2024-09-12T00:23:54.860254+0000","last_became_active":"2024-09-12T00:18:54.267168+0000","last_became_peered":"2024-09-12T00:18:54.267168+0000","last_unstale":"2024-09-12T00:23:54.860254+0000","last_undegraded":"2024-09-12T00:23:54.860254+0000","last_fullsized":"2024-09-12T00:23:54.860254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:54.860049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:54.860049+0000","last_clean_scrub_stamp":"2024-09-12T00:23:54.860049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:03.083609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'12","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:05.162564+0000","last_change":"2024-09-12T00:23:05.162564+0000","last_active":"2024-09-12T00:23:05.162564+0000","last_peered":"2024-09-12T00:23:05.162564+0000","last_clean":"2024-09-12T00:23:05.162564+0000","last_became_active":"2024-09-12T00:18:46.214151+0000","last_became_peered":"2024-09-12T00:18:46.214151+0000","last_unstale":"2024-09-12T00:23:05.162564+0000","last_undegraded":"2024-09-12T00:23:05.162564+0000","last_fullsized":"2024-09-12T00:23:05.162564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:05.162392+0000","last_clean_scrub_stamp":"2024-09-12T00:23:05.162392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:00.470991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.058734+0000","last_change":"2024-09-12T00:22:44.058569+0000","last_active":"2024-09-12T00:22:44.058734+0000","last_peered":"2024-09-12T00:22:44.058734+0000","last_clean":"2024-09-12T00:22:44.058734+0000","last_became_active":"2024-09-12T00:18:44.212016+0000","last_became_peered":"2024-09-12T00:18:44.212016+0000","last_unstale":"2024-09-12T00:22:44.058734+0000","last_undegraded":"2024-09-12T00:22:44.058734+0000","last_fullsized":"2024-09-12T00:22:44.058734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:44.058384+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.058384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.669388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.675883+0000","last_change":"2024-09-12T00:22:37.675755+0000","last_active":"2024-09-12T00:22:37.675883+0000","last_peered":"2024-09-12T00:22:37.675883+0000","last_clean":"2024-09-12T00:22:37.675883+0000","last_became_active":"2024-09-12T00:18:34.625298+0000","last_became_peered":"2024-09-12T00:18:34.625298+0000","last_unstale":"2024-09-12T00:22:37.675883+0000","last_undegraded":"2024-09-12T00:22:37.675883+0000","last_fullsized":"2024-09-12T00:22:37.675883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.675639+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.675639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:18.021676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088909000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.900291+0000","last_change":"2024-09-12T00:23:25.900291+0000","last_active":"2024-09-12T00:23:25.900291+0000","last_peered":"2024-09-12T00:23:25.900291+0000","last_clean":"2024-09-12T00:23:25.900291+0000","last_became_active":"2024-09-12T00:18:48.213630+0000","last_became_peered":"2024-09-12T00:18:48.213630+0000","last_unstale":"2024-09-12T00:23:25.900291+0000","last_undegraded":"2024-09-12T00:23:25.900291+0000","last_fullsized":"2024-09-12T00:23:25.900291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.900079+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.900079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.317937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:33.980753+0000","last_change":"2024-09-12T00:23:33.980753+0000","last_active":"2024-09-12T00:23:33.980753+0000","last_peered":"2024-09-12T00:23:33.980753+0000","last_clean":"2024-09-12T00:23:33.980753+0000","last_became_active":"2024-09-12T00:18:50.226408+0000","last_became_peered":"2024-09-12T00:18:50.226408+0000","last_unstale":"2024-09-12T00:23:33.980753+0000","last_undegraded":"2024-09-12T00:23:33.980753+0000","last_fullsized":"2024-09-12T00:23:33.980753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:33.980516+0000","last_clean_scrub_stamp":"2024-09-12T00:23:33.980516+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:23.601865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'286","reported_seq":414,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:19.693953+0000","last_change":"2024-09-12T00:23:19.693953+0000","last_active":"2024-09-12T00:23:19.693953+0000","last_peered":"2024-09-12T00:23:19.693953+0000","last_clean":"2024-09-12T00:23:19.693953+0000","last_became_active":"2024-09-12T00:18:52.238935+0000","last_became_peered":"2024-09-12T00:18:52.238935+0000","last_unstale":"2024-09-12T00:23:19.693953+0000","last_undegraded":"2024-09-12T00:23:19.693953+0000","last_fullsized":"2024-09-12T00:23:19.693953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:19.693733+0000","last_clean_scrub_stamp":"2024-09-12T00:23:19.693733+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.161540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:35.250239+0000","last_change":"2024-09-12T00:23:35.250239+0000","last_active":"2024-09-12T00:23:35.250239+0000","last_peered":"2024-09-12T00:23:35.250239+0000","last_clean":"2024-09-12T00:23:35.250239+0000","last_became_active":"2024-09-12T00:18:54.264771+0000","last_became_peered":"2024-09-12T00:18:54.264771+0000","last_unstale":"2024-09-12T00:23:35.250239+0000","last_undegraded":"2024-09-12T00:23:35.250239+0000","last_fullsized":"2024-09-12T00:23:35.250239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-09-12T00:23:35.249999+0000","last_clean_scrub_stamp":"2024-09-12T00:23:35.249999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:43.231307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'12","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.751001+0000","last_change":"2024-09-12T00:22:52.750826+0000","last_active":"2024-09-12T00:22:52.751001+0000","last_peered":"2024-09-12T00:22:52.751001+0000","last_clean":"2024-09-12T00:22:52.751001+0000","last_became_active":"2024-09-12T00:18:46.190924+0000","last_became_peered":"2024-09-12T00:18:46.190924+0000","last_unstale":"2024-09-12T00:22:52.751001+0000","last_undegraded":"2024-09-12T00:22:52.751001+0000","last_fullsized":"2024-09-12T00:22:52.751001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:22:52.750640+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.750640+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:43.087670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:37.284791+0000","last_change":"2024-09-12T00:22:37.284618+0000","last_active":"2024-09-12T00:22:37.284791+0000","last_peered":"2024-09-12T00:22:37.284791+0000","last_clean":"2024-09-12T00:22:37.284791+0000","last_became_active":"2024-09-12T00:18:44.208218+0000","last_became_peered":"2024-09-12T00:18:44.208218+0000","last_unstale":"2024-09-12T00:22:37.284791+0000","last_undegraded":"2024-09-12T00:22:37.284791+0000","last_fullsized":"2024-09-12T00:22:37.284791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:37.284374+0000","last_clean_scrub_stamp":"2024-09-12T00:22:37.284374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:35.973047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.021196+0000","last_change":"2024-09-12T00:22:42.021039+0000","last_active":"2024-09-12T00:22:42.021196+0000","last_peered":"2024-09-12T00:22:42.021196+0000","last_clean":"2024-09-12T00:22:42.021196+0000","last_became_active":"2024-09-12T00:18:34.991578+0000","last_became_peered":"2024-09-12T00:18:34.991578+0000","last_unstale":"2024-09-12T00:22:42.021196+0000","last_undegraded":"2024-09-12T00:22:42.021196+0000","last_fullsized":"2024-09-12T00:22:42.021196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.020861+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.020861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:34.147473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0030304590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"33'5","reported_seq":239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.878785+0000","last_change":"2024-09-12T00:23:24.878785+0000","last_active":"2024-09-12T00:23:24.878785+0000","last_peered":"2024-09-12T00:23:24.878785+0000","last_clean":"2024-09-12T00:23:24.878785+0000","last_became_active":"2024-09-12T00:18:48.211123+0000","last_became_peered":"2024-09-12T00:18:48.211123+0000","last_unstale":"2024-09-12T00:23:24.878785+0000","last_undegraded":"2024-09-12T00:23:24.878785+0000","last_fullsized":"2024-09-12T00:23:24.878785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:24.878599+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.878599+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:51.060676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'107","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.815851+0000","last_change":"2024-09-12T00:23:12.815851+0000","last_active":"2024-09-12T00:23:12.815851+0000","last_peered":"2024-09-12T00:23:12.815851+0000","last_clean":"2024-09-12T00:23:12.815851+0000","last_became_active":"2024-09-12T00:18:50.215870+0000","last_became_peered":"2024-09-12T00:18:50.215870+0000","last_unstale":"2024-09-12T00:23:12.815851+0000","last_undegraded":"2024-09-12T00:23:12.815851+0000","last_fullsized":"2024-09-12T00:23:12.815851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'107","last_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_deep_scrub":"33'107","last_deep_scrub_stamp":"2024-09-12T00:23:12.815651+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.815651+0000","objects_scrubbed":9,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:02.753655+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":87,"num_write":40,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.715268+0000","last_change":"2024-09-12T00:23:17.715268+0000","last_active":"2024-09-12T00:23:17.715268+0000","last_peered":"2024-09-12T00:23:17.715268+0000","last_clean":"2024-09-12T00:23:17.715268+0000","last_became_active":"2024-09-12T00:18:52.238345+0000","last_became_peered":"2024-09-12T00:18:52.238345+0000","last_unstale":"2024-09-12T00:23:17.715268+0000","last_undegraded":"2024-09-12T00:23:17.715268+0000","last_fullsized":"2024-09-12T00:23:17.715268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.715091+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.715091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:21.810163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:29.762359+0000","last_change":"2024-09-12T00:23:29.762359+0000","last_active":"2024-09-12T00:23:29.762359+0000","last_peered":"2024-09-12T00:23:29.762359+0000","last_clean":"2024-09-12T00:23:29.762359+0000","last_became_active":"2024-09-12T00:18:54.256957+0000","last_became_peered":"2024-09-12T00:18:54.256957+0000","last_unstale":"2024-09-12T00:23:29.762359+0000","last_undegraded":"2024-09-12T00:23:29.762359+0000","last_fullsized":"2024-09-12T00:23:29.762359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:29.762179+0000","last_clean_scrub_stamp":"2024-09-12T00:23:29.762179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:07.284762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.727111+0000","last_change":"2024-09-12T00:23:31.727111+0000","last_active":"2024-09-12T00:23:31.727111+0000","last_peered":"2024-09-12T00:23:31.727111+0000","last_clean":"2024-09-12T00:23:31.727111+0000","last_became_active":"2024-09-12T00:18:54.273598+0000","last_became_peered":"2024-09-12T00:18:54.273598+0000","last_unstale":"2024-09-12T00:23:31.727111+0000","last_undegraded":"2024-09-12T00:23:31.727111+0000","last_fullsized":"2024-09-12T00:23:31.727111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:31.726920+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.726920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:28.958312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'22","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.736232+0000","last_change":"2024-09-12T00:22:58.736086+0000","last_active":"2024-09-12T00:22:58.736232+0000","last_peered":"2024-09-12T00:22:58.736232+0000","last_clean":"2024-09-12T00:22:58.736232+0000","last_became_active":"2024-09-12T00:18:46.189481+0000","last_became_peered":"2024-09-12T00:18:46.189481+0000","last_unstale":"2024-09-12T00:22:58.736232+0000","last_undegraded":"2024-09-12T00:22:58.736232+0000","last_fullsized":"2024-09-12T00:22:58.736232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:58.735904+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.735904+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:30.200548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":81,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:52.010021+0000","last_change":"2024-09-12T00:22:52.009865+0000","last_active":"2024-09-12T00:22:52.010021+0000","last_peered":"2024-09-12T00:22:52.010021+0000","last_clean":"2024-09-12T00:22:52.010021+0000","last_became_active":"2024-09-12T00:18:44.220446+0000","last_became_peered":"2024-09-12T00:18:44.220446+0000","last_unstale":"2024-09-12T00:22:52.010021+0000","last_undegraded":"2024-09-12T00:22:52.010021+0000","last_fullsized":"2024-09-12T00:22:52.010021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:52.009684+0000","last_clean_scrub_stamp":"2024-09-12T00:22:52.009684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.867922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.391648+0000","last_change":"2024-09-12T00:23:13.391496+0000","last_active":"2024-09-12T00:23:13.391648+0000","last_peered":"2024-09-12T00:23:13.391648+0000","last_clean":"2024-09-12T00:23:13.391648+0000","last_became_active":"2024-09-12T00:18:48.215800+0000","last_became_peered":"2024-09-12T00:18:48.215800+0000","last_unstale":"2024-09-12T00:23:13.391648+0000","last_undegraded":"2024-09-12T00:23:13.391648+0000","last_fullsized":"2024-09-12T00:23:13.391648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:13.391315+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.391315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:03.063530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:39.983811+0000","last_change":"2024-09-12T00:23:39.983811+0000","last_active":"2024-09-12T00:23:39.983811+0000","last_peered":"2024-09-12T00:23:39.983811+0000","last_clean":"2024-09-12T00:23:39.983811+0000","last_became_active":"2024-09-12T00:18:50.238637+0000","last_became_peered":"2024-09-12T00:18:50.238637+0000","last_unstale":"2024-09-12T00:23:39.983811+0000","last_undegraded":"2024-09-12T00:23:39.983811+0000","last_fullsized":"2024-09-12T00:23:39.983811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:39.983623+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:39.983623+0000","last_clean_scrub_stamp":"2024-09-12T00:23:39.983623+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:35.039199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:49.946010+0000","last_change":"2024-09-12T00:23:49.946010+0000","last_active":"2024-09-12T00:23:49.946010+0000","last_peered":"2024-09-12T00:23:49.946010+0000","last_clean":"2024-09-12T00:23:49.946010+0000","last_became_active":"2024-09-12T00:18:52.265818+0000","last_became_peered":"2024-09-12T00:18:52.265818+0000","last_unstale":"2024-09-12T00:23:49.946010+0000","last_undegraded":"2024-09-12T00:23:49.946010+0000","last_fullsized":"2024-09-12T00:23:49.946010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:49.945832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:49.945832+0000","last_clean_scrub_stamp":"2024-09-12T00:23:49.945832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.743364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.781322+0000","last_change":"2024-09-12T00:23:36.781322+0000","last_active":"2024-09-12T00:23:36.781322+0000","last_peered":"2024-09-12T00:23:36.781322+0000","last_clean":"2024-09-12T00:23:36.781322+0000","last_became_active":"2024-09-12T00:18:54.269119+0000","last_became_peered":"2024-09-12T00:18:54.269119+0000","last_unstale":"2024-09-12T00:23:36.781322+0000","last_undegraded":"2024-09-12T00:23:36.781322+0000","last_fullsized":"2024-09-12T00:23:36.781322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:36.781142+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.781142+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:38.074240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'8","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.391756+0000","last_change":"2024-09-12T00:22:58.391625+0000","last_active":"2024-09-12T00:22:58.391756+0000","last_peered":"2024-09-12T00:22:58.391756+0000","last_clean":"2024-09-12T00:22:58.391756+0000","last_became_active":"2024-09-12T00:18:46.217296+0000","last_became_peered":"2024-09-12T00:18:46.217296+0000","last_unstale":"2024-09-12T00:22:58.391756+0000","last_undegraded":"2024-09-12T00:22:58.391756+0000","last_fullsized":"2024-09-12T00:22:58.391756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:22:58.391445+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.391445+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.604030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.779442+0000","last_change":"2024-09-12T00:22:42.779281+0000","last_active":"2024-09-12T00:22:42.779442+0000","last_peered":"2024-09-12T00:22:42.779442+0000","last_clean":"2024-09-12T00:22:42.779442+0000","last_became_active":"2024-09-12T00:18:44.210681+0000","last_became_peered":"2024-09-12T00:18:44.210681+0000","last_unstale":"2024-09-12T00:22:42.779442+0000","last_undegraded":"2024-09-12T00:22:42.779442+0000","last_fullsized":"2024-09-12T00:22:42.779442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:42.779092+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.779092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:31.713311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.990753+0000","last_change":"2024-09-12T00:23:30.990753+0000","last_active":"2024-09-12T00:23:30.990753+0000","last_peered":"2024-09-12T00:23:30.990753+0000","last_clean":"2024-09-12T00:23:30.990753+0000","last_became_active":"2024-09-12T00:18:48.219496+0000","last_became_peered":"2024-09-12T00:18:48.219496+0000","last_unstale":"2024-09-12T00:23:30.990753+0000","last_undegraded":"2024-09-12T00:23:30.990753+0000","last_fullsized":"2024-09-12T00:23:30.990753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.990569+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.990569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.843256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.690110+0000","last_change":"2024-09-12T00:23:20.689939+0000","last_active":"2024-09-12T00:23:20.690110+0000","last_peered":"2024-09-12T00:23:20.690110+0000","last_clean":"2024-09-12T00:23:20.690110+0000","last_became_active":"2024-09-12T00:18:50.214430+0000","last_became_peered":"2024-09-12T00:18:50.214430+0000","last_unstale":"2024-09-12T00:23:20.690110+0000","last_undegraded":"2024-09-12T00:23:20.690110+0000","last_fullsized":"2024-09-12T00:23:20.690110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:20.689752+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.689752+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:32.818163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:20.846425+0000","last_change":"2024-09-12T00:23:20.846280+0000","last_active":"2024-09-12T00:23:20.846425+0000","last_peered":"2024-09-12T00:23:20.846425+0000","last_clean":"2024-09-12T00:23:20.846425+0000","last_became_active":"2024-09-12T00:18:52.263850+0000","last_became_peered":"2024-09-12T00:18:52.263850+0000","last_unstale":"2024-09-12T00:23:20.846425+0000","last_undegraded":"2024-09-12T00:23:20.846425+0000","last_fullsized":"2024-09-12T00:23:20.846425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:20.846099+0000","last_clean_scrub_stamp":"2024-09-12T00:23:20.846099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:42.175845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:38.750335+0000","last_change":"2024-09-12T00:23:38.750189+0000","last_active":"2024-09-12T00:23:38.750335+0000","last_peered":"2024-09-12T00:23:38.750335+0000","last_clean":"2024-09-12T00:23:38.750335+0000","last_became_active":"2024-09-12T00:18:54.267260+0000","last_became_peered":"2024-09-12T00:18:54.267260+0000","last_unstale":"2024-09-12T00:23:38.750335+0000","last_undegraded":"2024-09-12T00:23:38.750335+0000","last_fullsized":"2024-09-12T00:23:38.750335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:38.750002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:38.750002+0000","last_clean_scrub_stamp":"2024-09-12T00:23:38.750002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:47.845320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'22","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.942888+0000","last_change":"2024-09-12T00:22:54.942747+0000","last_active":"2024-09-12T00:22:54.942888+0000","last_peered":"2024-09-12T00:22:54.942888+0000","last_clean":"2024-09-12T00:22:54.942888+0000","last_became_active":"2024-09-12T00:18:46.193098+0000","last_became_peered":"2024-09-12T00:18:46.193098+0000","last_unstale":"2024-09-12T00:22:54.942888+0000","last_undegraded":"2024-09-12T00:22:54.942888+0000","last_fullsized":"2024-09-12T00:22:54.942888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:22:54.942553+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.942553+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:15.834853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":96,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.806447+0000","last_change":"2024-09-12T00:22:44.806286+0000","last_active":"2024-09-12T00:22:44.806447+0000","last_peered":"2024-09-12T00:22:44.806447+0000","last_clean":"2024-09-12T00:22:44.806447+0000","last_became_active":"2024-09-12T00:18:44.194980+0000","last_became_peered":"2024-09-12T00:18:44.194980+0000","last_unstale":"2024-09-12T00:22:44.806447+0000","last_undegraded":"2024-09-12T00:22:44.806447+0000","last_fullsized":"2024-09-12T00:22:44.806447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.806101+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.806101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:21.067872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:08.696548+0000","last_change":"2024-09-12T00:23:08.696289+0000","last_active":"2024-09-12T00:23:08.696548+0000","last_peered":"2024-09-12T00:23:08.696548+0000","last_clean":"2024-09-12T00:23:08.696548+0000","last_became_active":"2024-09-12T00:18:48.199957+0000","last_became_peered":"2024-09-12T00:18:48.199957+0000","last_unstale":"2024-09-12T00:23:08.696548+0000","last_undegraded":"2024-09-12T00:23:08.696548+0000","last_fullsized":"2024-09-12T00:23:08.696548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:08.696055+0000","last_clean_scrub_stamp":"2024-09-12T00:23:08.696055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.543792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'51","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:12.851527+0000","last_change":"2024-09-12T00:23:12.851378+0000","last_active":"2024-09-12T00:23:12.851527+0000","last_peered":"2024-09-12T00:23:12.851527+0000","last_clean":"2024-09-12T00:23:12.851527+0000","last_became_active":"2024-09-12T00:18:50.223498+0000","last_became_peered":"2024-09-12T00:18:50.223498+0000","last_unstale":"2024-09-12T00:23:12.851527+0000","last_undegraded":"2024-09-12T00:23:12.851527+0000","last_fullsized":"2024-09-12T00:23:12.851527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-12T00:23:12.851186+0000","last_clean_scrub_stamp":"2024-09-12T00:23:12.851186+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:10.082578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.120229+0000","last_change":"2024-09-12T00:23:27.120097+0000","last_active":"2024-09-12T00:23:27.120229+0000","last_peered":"2024-09-12T00:23:27.120229+0000","last_clean":"2024-09-12T00:23:27.120229+0000","last_became_active":"2024-09-12T00:18:52.233084+0000","last_became_peered":"2024-09-12T00:18:52.233084+0000","last_unstale":"2024-09-12T00:23:27.120229+0000","last_undegraded":"2024-09-12T00:23:27.120229+0000","last_fullsized":"2024-09-12T00:23:27.120229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.119923+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.119923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.850332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:24:02.830068+0000","last_change":"2024-09-12T00:24:02.830068+0000","last_active":"2024-09-12T00:24:02.830068+0000","last_peered":"2024-09-12T00:24:02.830068+0000","last_clean":"2024-09-12T00:24:02.830068+0000","last_became_active":"2024-09-12T00:18:54.284370+0000","last_became_peered":"2024-09-12T00:18:54.284370+0000","last_unstale":"2024-09-12T00:24:02.830068+0000","last_undegraded":"2024-09-12T00:24:02.830068+0000","last_fullsized":"2024-09-12T00:24:02.830068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:02.829857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:02.829857+0000","last_clean_scrub_stamp":"2024-09-12T00:24:02.829857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:01.373868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.990198+0000","last_change":"2024-09-12T00:23:10.990006+0000","last_active":"2024-09-12T00:23:10.990198+0000","last_peered":"2024-09-12T00:23:10.990198+0000","last_clean":"2024-09-12T00:23:10.990198+0000","last_became_active":"2024-09-12T00:18:46.213917+0000","last_became_peered":"2024-09-12T00:18:46.213917+0000","last_unstale":"2024-09-12T00:23:10.990198+0000","last_undegraded":"2024-09-12T00:23:10.990198+0000","last_fullsized":"2024-09-12T00:23:10.990198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:10.989822+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.989822+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:55.630091+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:39.300825+0000","last_change":"2024-09-12T00:22:39.300694+0000","last_active":"2024-09-12T00:22:39.300825+0000","last_peered":"2024-09-12T00:22:39.300825+0000","last_clean":"2024-09-12T00:22:39.300825+0000","last_became_active":"2024-09-12T00:18:44.192482+0000","last_became_peered":"2024-09-12T00:18:44.192482+0000","last_unstale":"2024-09-12T00:22:39.300825+0000","last_undegraded":"2024-09-12T00:22:39.300825+0000","last_fullsized":"2024-09-12T00:22:39.300825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:39.300502+0000","last_clean_scrub_stamp":"2024-09-12T00:22:39.300502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:21.737383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:28.987296+0000","last_change":"2024-09-12T00:23:28.987296+0000","last_active":"2024-09-12T00:23:28.987296+0000","last_peered":"2024-09-12T00:23:28.987296+0000","last_clean":"2024-09-12T00:23:28.987296+0000","last_became_active":"2024-09-12T00:18:48.214746+0000","last_became_peered":"2024-09-12T00:18:48.214746+0000","last_unstale":"2024-09-12T00:23:28.987296+0000","last_undegraded":"2024-09-12T00:23:28.987296+0000","last_fullsized":"2024-09-12T00:23:28.987296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:28.987116+0000","last_clean_scrub_stamp":"2024-09-12T00:23:28.987116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.128553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'37","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.718980+0000","last_change":"2024-09-12T00:23:16.718828+0000","last_active":"2024-09-12T00:23:16.718980+0000","last_peered":"2024-09-12T00:23:16.718980+0000","last_clean":"2024-09-12T00:23:16.718980+0000","last_became_active":"2024-09-12T00:18:50.204300+0000","last_became_peered":"2024-09-12T00:18:50.204300+0000","last_unstale":"2024-09-12T00:23:16.718980+0000","last_undegraded":"2024-09-12T00:23:16.718980+0000","last_fullsized":"2024-09-12T00:23:16.718980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2024-09-12T00:23:16.718625+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.718625+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:12.155804+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:23.756383+0000","last_change":"2024-09-12T00:23:23.756222+0000","last_active":"2024-09-12T00:23:23.756383+0000","last_peered":"2024-09-12T00:23:23.756383+0000","last_clean":"2024-09-12T00:23:23.756383+0000","last_became_active":"2024-09-12T00:18:52.248428+0000","last_became_peered":"2024-09-12T00:18:52.248428+0000","last_unstale":"2024-09-12T00:23:23.756383+0000","last_undegraded":"2024-09-12T00:23:23.756383+0000","last_fullsized":"2024-09-12T00:23:23.756383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:23.756031+0000","last_clean_scrub_stamp":"2024-09-12T00:23:23.756031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:15.537379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.925830+0000","last_change":"2024-09-12T00:23:15.925830+0000","last_active":"2024-09-12T00:23:15.925830+0000","last_peered":"2024-09-12T00:23:15.925830+0000","last_clean":"2024-09-12T00:23:15.925830+0000","last_became_active":"2024-09-12T00:18:46.191021+0000","last_became_peered":"2024-09-12T00:18:46.191021+0000","last_unstale":"2024-09-12T00:23:15.925830+0000","last_undegraded":"2024-09-12T00:23:15.925830+0000","last_fullsized":"2024-09-12T00:23:15.925830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:15.925622+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.925622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.066023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:53.035250+0000","last_change":"2024-09-12T00:22:53.034956+0000","last_active":"2024-09-12T00:22:53.035250+0000","last_peered":"2024-09-12T00:22:53.035250+0000","last_clean":"2024-09-12T00:22:53.035250+0000","last_became_active":"2024-09-12T00:18:44.216411+0000","last_became_peered":"2024-09-12T00:18:44.216411+0000","last_unstale":"2024-09-12T00:22:53.035250+0000","last_undegraded":"2024-09-12T00:22:53.035250+0000","last_fullsized":"2024-09-12T00:22:53.035250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:53.034651+0000","last_clean_scrub_stamp":"2024-09-12T00:22:53.034651+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:57.265344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.726656+0000","last_change":"2024-09-12T00:23:18.726656+0000","last_active":"2024-09-12T00:23:18.726656+0000","last_peered":"2024-09-12T00:23:18.726656+0000","last_clean":"2024-09-12T00:23:18.726656+0000","last_became_active":"2024-09-12T00:18:48.208302+0000","last_became_peered":"2024-09-12T00:18:48.208302+0000","last_unstale":"2024-09-12T00:23:18.726656+0000","last_undegraded":"2024-09-12T00:23:18.726656+0000","last_fullsized":"2024-09-12T00:23:18.726656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.726384+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.726384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:15.258133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'72","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:13.816302+0000","last_change":"2024-09-12T00:23:13.815989+0000","last_active":"2024-09-12T00:23:13.816302+0000","last_peered":"2024-09-12T00:23:13.816302+0000","last_clean":"2024-09-12T00:23:13.816302+0000","last_became_active":"2024-09-12T00:18:50.215681+0000","last_became_peered":"2024-09-12T00:18:50.215681+0000","last_unstale":"2024-09-12T00:23:13.816302+0000","last_undegraded":"2024-09-12T00:23:13.816302+0000","last_fullsized":"2024-09-12T00:23:13.816302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2024-09-12T00:23:13.815744+0000","last_clean_scrub_stamp":"2024-09-12T00:23:13.815744+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:18.956083+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:25.773675+0000","last_change":"2024-09-12T00:23:25.773527+0000","last_active":"2024-09-12T00:23:25.773675+0000","last_peered":"2024-09-12T00:23:25.773675+0000","last_clean":"2024-09-12T00:23:25.773675+0000","last_became_active":"2024-09-12T00:18:52.251402+0000","last_became_peered":"2024-09-12T00:18:52.251402+0000","last_unstale":"2024-09-12T00:23:25.773675+0000","last_undegraded":"2024-09-12T00:23:25.773675+0000","last_fullsized":"2024-09-12T00:23:25.773675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:25.773341+0000","last_clean_scrub_stamp":"2024-09-12T00:23:25.773341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:28.853684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:31.767983+0000","last_change":"2024-09-12T00:23:31.767728+0000","last_active":"2024-09-12T00:23:31.767983+0000","last_peered":"2024-09-12T00:23:31.767983+0000","last_clean":"2024-09-12T00:23:31.767983+0000","last_became_active":"2024-09-12T00:18:54.256659+0000","last_became_peered":"2024-09-12T00:18:54.256659+0000","last_unstale":"2024-09-12T00:23:31.767983+0000","last_undegraded":"2024-09-12T00:23:31.767983+0000","last_fullsized":"2024-09-12T00:23:31.767983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:31.767491+0000","last_clean_scrub_stamp":"2024-09-12T00:23:31.767491+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:31.281516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'16","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:03.878714+0000","last_change":"2024-09-12T00:23:03.878714+0000","last_active":"2024-09-12T00:23:03.878714+0000","last_peered":"2024-09-12T00:23:03.878714+0000","last_clean":"2024-09-12T00:23:03.878714+0000","last_became_active":"2024-09-12T00:18:46.210285+0000","last_became_peered":"2024-09-12T00:18:46.210285+0000","last_unstale":"2024-09-12T00:23:03.878714+0000","last_undegraded":"2024-09-12T00:23:03.878714+0000","last_fullsized":"2024-09-12T00:23:03.878714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:03.878512+0000","last_clean_scrub_stamp":"2024-09-12T00:23:03.878512+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:25.214968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.306296+0000","last_change":"2024-09-12T00:22:40.306113+0000","last_active":"2024-09-12T00:22:40.306296+0000","last_peered":"2024-09-12T00:22:40.306296+0000","last_clean":"2024-09-12T00:22:40.306296+0000","last_became_active":"2024-09-12T00:18:44.192846+0000","last_became_peered":"2024-09-12T00:18:44.192846+0000","last_unstale":"2024-09-12T00:22:40.306296+0000","last_undegraded":"2024-09-12T00:22:40.306296+0000","last_fullsized":"2024-09-12T00:22:40.306296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.305907+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.305907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:35.508780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.794996+0000","last_change":"2024-09-12T00:23:11.794996+0000","last_active":"2024-09-12T00:23:11.794996+0000","last_peered":"2024-09-12T00:23:11.794996+0000","last_clean":"2024-09-12T00:23:11.794996+0000","last_became_active":"2024-09-12T00:19:24.290390+0000","last_became_peered":"2024-09-12T00:19:24.290390+0000","last_unstale":"2024-09-12T00:23:11.794996+0000","last_undegraded":"2024-09-12T00:23:11.794996+0000","last_fullsized":"2024-09-12T00:23:11.794996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:11.794802+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.794802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:30.268181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:42.956627+0000","last_change":"2024-09-12T00:23:42.956461+0000","last_active":"2024-09-12T00:23:42.956627+0000","last_peered":"2024-09-12T00:23:42.956627+0000","last_clean":"2024-09-12T00:23:42.956627+0000","last_became_active":"2024-09-12T00:18:50.242886+0000","last_became_peered":"2024-09-12T00:18:50.242886+0000","last_unstale":"2024-09-12T00:23:42.956627+0000","last_undegraded":"2024-09-12T00:23:42.956627+0000","last_fullsized":"2024-09-12T00:23:42.956627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:42.956256+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:42.956256+0000","last_clean_scrub_stamp":"2024-09-12T00:23:42.956256+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.069611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.218317+0000","last_change":"2024-09-12T00:23:30.218191+0000","last_active":"2024-09-12T00:23:30.218317+0000","last_peered":"2024-09-12T00:23:30.218317+0000","last_clean":"2024-09-12T00:23:30.218317+0000","last_became_active":"2024-09-12T00:18:52.243697+0000","last_became_peered":"2024-09-12T00:18:52.243697+0000","last_unstale":"2024-09-12T00:23:30.218317+0000","last_undegraded":"2024-09-12T00:23:30.218317+0000","last_fullsized":"2024-09-12T00:23:30.218317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.218010+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.218010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:35.490956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:58.836545+0000","last_change":"2024-09-12T00:23:58.836545+0000","last_active":"2024-09-12T00:23:58.836545+0000","last_peered":"2024-09-12T00:23:58.836545+0000","last_clean":"2024-09-12T00:23:58.836545+0000","last_became_active":"2024-09-12T00:18:54.265485+0000","last_became_peered":"2024-09-12T00:18:54.265485+0000","last_unstale":"2024-09-12T00:23:58.836545+0000","last_undegraded":"2024-09-12T00:23:58.836545+0000","last_fullsized":"2024-09-12T00:23:58.836545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:58.836341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:58.836341+0000","last_clean_scrub_stamp":"2024-09-12T00:23:58.836341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:34.809024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:14.923017+0000","last_change":"2024-09-12T00:23:14.922836+0000","last_active":"2024-09-12T00:23:14.923017+0000","last_peered":"2024-09-12T00:23:14.923017+0000","last_clean":"2024-09-12T00:23:14.923017+0000","last_became_active":"2024-09-12T00:18:46.214051+0000","last_became_peered":"2024-09-12T00:18:46.214051+0000","last_unstale":"2024-09-12T00:23:14.923017+0000","last_undegraded":"2024-09-12T00:23:14.923017+0000","last_fullsized":"2024-09-12T00:23:14.923017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:14.922649+0000","last_clean_scrub_stamp":"2024-09-12T00:23:14.922649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:06.834122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:42.386150+0000","last_change":"2024-09-12T00:22:42.385967+0000","last_active":"2024-09-12T00:22:42.386150+0000","last_peered":"2024-09-12T00:22:42.386150+0000","last_clean":"2024-09-12T00:22:42.386150+0000","last_became_active":"2024-09-12T00:18:44.201517+0000","last_became_peered":"2024-09-12T00:18:44.201517+0000","last_unstale":"2024-09-12T00:22:42.386150+0000","last_undegraded":"2024-09-12T00:22:42.386150+0000","last_fullsized":"2024-09-12T00:22:42.386150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:42.385774+0000","last_clean_scrub_stamp":"2024-09-12T00:22:42.385774+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:36.864966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:10.762576+0000","last_change":"2024-09-12T00:23:10.762434+0000","last_active":"2024-09-12T00:23:10.762576+0000","last_peered":"2024-09-12T00:23:10.762576+0000","last_clean":"2024-09-12T00:23:10.762576+0000","last_became_active":"2024-09-12T00:18:48.195586+0000","last_became_peered":"2024-09-12T00:18:48.195586+0000","last_unstale":"2024-09-12T00:23:10.762576+0000","last_undegraded":"2024-09-12T00:23:10.762576+0000","last_fullsized":"2024-09-12T00:23:10.762576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:10.762259+0000","last_clean_scrub_stamp":"2024-09-12T00:23:10.762259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:08.326149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'47","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.850131+0000","last_change":"2024-09-12T00:23:11.850131+0000","last_active":"2024-09-12T00:23:11.850131+0000","last_peered":"2024-09-12T00:23:11.850131+0000","last_clean":"2024-09-12T00:23:11.850131+0000","last_became_active":"2024-09-12T00:18:50.222420+0000","last_became_peered":"2024-09-12T00:18:50.222420+0000","last_unstale":"2024-09-12T00:23:11.850131+0000","last_undegraded":"2024-09-12T00:23:11.850131+0000","last_fullsized":"2024-09-12T00:23:11.850131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-12T00:23:11.849946+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.849946+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:01.522162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:30.733709+0000","last_change":"2024-09-12T00:23:30.733709+0000","last_active":"2024-09-12T00:23:30.733709+0000","last_peered":"2024-09-12T00:23:30.733709+0000","last_clean":"2024-09-12T00:23:30.733709+0000","last_became_active":"2024-09-12T00:18:52.238520+0000","last_became_peered":"2024-09-12T00:18:52.238520+0000","last_unstale":"2024-09-12T00:23:30.733709+0000","last_undegraded":"2024-09-12T00:23:30.733709+0000","last_fullsized":"2024-09-12T00:23:30.733709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:30.733523+0000","last_clean_scrub_stamp":"2024-09-12T00:23:30.733523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:25.856380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:55.860397+0000","last_change":"2024-09-12T00:23:55.860397+0000","last_active":"2024-09-12T00:23:55.860397+0000","last_peered":"2024-09-12T00:23:55.860397+0000","last_clean":"2024-09-12T00:23:55.860397+0000","last_became_active":"2024-09-12T00:18:54.275489+0000","last_became_peered":"2024-09-12T00:18:54.275489+0000","last_unstale":"2024-09-12T00:23:55.860397+0000","last_undegraded":"2024-09-12T00:23:55.860397+0000","last_fullsized":"2024-09-12T00:23:55.860397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-12T00:23:55.860149+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-12T00:23:55.860149+0000","last_clean_scrub_stamp":"2024-09-12T00:23:55.860149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:48.523263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'10","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.937126+0000","last_change":"2024-09-12T00:22:55.936957+0000","last_active":"2024-09-12T00:22:55.937126+0000","last_peered":"2024-09-12T00:22:55.937126+0000","last_clean":"2024-09-12T00:22:55.937126+0000","last_became_active":"2024-09-12T00:18:46.197994+0000","last_became_peered":"2024-09-12T00:18:46.197994+0000","last_unstale":"2024-09-12T00:22:55.937126+0000","last_undegraded":"2024-09-12T00:22:55.937126+0000","last_fullsized":"2024-09-12T00:22:55.937126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:55.936751+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.936751+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:28.262382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:54.067615+0000","last_change":"2024-09-12T00:22:54.067458+0000","last_active":"2024-09-12T00:22:54.067615+0000","last_peered":"2024-09-12T00:22:54.067615+0000","last_clean":"2024-09-12T00:22:54.067615+0000","last_became_active":"2024-09-12T00:18:44.202114+0000","last_became_peered":"2024-09-12T00:18:44.202114+0000","last_unstale":"2024-09-12T00:22:54.067615+0000","last_undegraded":"2024-09-12T00:22:54.067615+0000","last_fullsized":"2024-09-12T00:22:54.067615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:54.067268+0000","last_clean_scrub_stamp":"2024-09-12T00:22:54.067268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:29.961955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.295716+0000","last_change":"2024-09-12T00:23:18.295563+0000","last_active":"2024-09-12T00:23:18.295716+0000","last_peered":"2024-09-12T00:23:18.295716+0000","last_clean":"2024-09-12T00:23:18.295716+0000","last_became_active":"2024-09-12T00:18:48.212699+0000","last_became_peered":"2024-09-12T00:18:48.212699+0000","last_unstale":"2024-09-12T00:23:18.295716+0000","last_undegraded":"2024-09-12T00:23:18.295716+0000","last_fullsized":"2024-09-12T00:23:18.295716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:18.295354+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.295354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:33.445325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:45.990923+0000","last_change":"2024-09-12T00:23:45.990923+0000","last_active":"2024-09-12T00:23:45.990923+0000","last_peered":"2024-09-12T00:23:45.990923+0000","last_clean":"2024-09-12T00:23:45.990923+0000","last_became_active":"2024-09-12T00:18:50.244423+0000","last_became_peered":"2024-09-12T00:18:50.244423+0000","last_unstale":"2024-09-12T00:23:45.990923+0000","last_undegraded":"2024-09-12T00:23:45.990923+0000","last_fullsized":"2024-09-12T00:23:45.990923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:45.990711+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:45.990711+0000","last_clean_scrub_stamp":"2024-09-12T00:23:45.990711+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:27.243594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'286","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.742825+0000","last_change":"2024-09-12T00:23:24.742825+0000","last_active":"2024-09-12T00:23:24.742825+0000","last_peered":"2024-09-12T00:23:24.742825+0000","last_clean":"2024-09-12T00:23:24.742825+0000","last_became_active":"2024-09-12T00:18:52.263768+0000","last_became_peered":"2024-09-12T00:18:52.263768+0000","last_unstale":"2024-09-12T00:23:24.742825+0000","last_undegraded":"2024-09-12T00:23:24.742825+0000","last_fullsized":"2024-09-12T00:23:24.742825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'286","last_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_deep_scrub":"33'286","last_deep_scrub_stamp":"2024-09-12T00:23:24.742581+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.742581+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:14.118995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:56.835246+0000","last_change":"2024-09-12T00:23:56.835246+0000","last_active":"2024-09-12T00:23:56.835246+0000","last_peered":"2024-09-12T00:23:56.835246+0000","last_clean":"2024-09-12T00:23:56.835246+0000","last_became_active":"2024-09-12T00:18:54.266791+0000","last_became_peered":"2024-09-12T00:18:54.266791+0000","last_unstale":"2024-09-12T00:23:56.835246+0000","last_undegraded":"2024-09-12T00:23:56.835246+0000","last_fullsized":"2024-09-12T00:23:56.835246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:56.835034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:56.835034+0000","last_clean_scrub_stamp":"2024-09-12T00:23:56.835034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:41.031747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'16","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.692151+0000","last_change":"2024-09-12T00:23:01.691998+0000","last_active":"2024-09-12T00:23:01.692151+0000","last_peered":"2024-09-12T00:23:01.692151+0000","last_clean":"2024-09-12T00:23:01.692151+0000","last_became_active":"2024-09-12T00:18:46.184583+0000","last_became_peered":"2024-09-12T00:18:46.184583+0000","last_unstale":"2024-09-12T00:23:01.692151+0000","last_undegraded":"2024-09-12T00:23:01.692151+0000","last_fullsized":"2024-09-12T00:23:01.692151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-12T00:23:01.691825+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.691825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:28.900305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.393313+0000","last_change":"2024-09-12T00:22:43.393154+0000","last_active":"2024-09-12T00:22:43.393313+0000","last_peered":"2024-09-12T00:22:43.393313+0000","last_clean":"2024-09-12T00:22:43.393313+0000","last_became_active":"2024-09-12T00:18:44.193109+0000","last_became_peered":"2024-09-12T00:18:44.193109+0000","last_unstale":"2024-09-12T00:22:43.393313+0000","last_undegraded":"2024-09-12T00:22:43.393313+0000","last_fullsized":"2024-09-12T00:22:43.393313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.392968+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.392968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:10.459069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.295089+0000","last_change":"2024-09-12T00:23:17.294939+0000","last_active":"2024-09-12T00:23:17.295089+0000","last_peered":"2024-09-12T00:23:17.295089+0000","last_clean":"2024-09-12T00:23:17.295089+0000","last_became_active":"2024-09-12T00:18:48.217360+0000","last_became_peered":"2024-09-12T00:18:48.217360+0000","last_unstale":"2024-09-12T00:23:17.295089+0000","last_undegraded":"2024-09-12T00:23:17.295089+0000","last_fullsized":"2024-09-12T00:23:17.295089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:17.294701+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.294701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:06.708016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'77","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:24.149596+0000","last_change":"2024-09-12T00:23:24.149463+0000","last_active":"2024-09-12T00:23:24.149596+0000","last_peered":"2024-09-12T00:23:24.149596+0000","last_clean":"2024-09-12T00:23:24.149596+0000","last_became_active":"2024-09-12T00:18:50.236061+0000","last_became_peered":"2024-09-12T00:18:50.236061+0000","last_unstale":"2024-09-12T00:23:24.149596+0000","last_undegraded":"2024-09-12T00:23:24.149596+0000","last_fullsized":"2024-09-12T00:23:24.149596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'77","last_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_deep_scrub":"33'77","last_deep_scrub_stamp":"2024-09-12T00:23:24.149240+0000","last_clean_scrub_stamp":"2024-09-12T00:23:24.149240+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:59.010159+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:26.735509+0000","last_change":"2024-09-12T00:23:26.735232+0000","last_active":"2024-09-12T00:23:26.735509+0000","last_peered":"2024-09-12T00:23:26.735509+0000","last_clean":"2024-09-12T00:23:26.735509+0000","last_became_active":"2024-09-12T00:18:52.244416+0000","last_became_peered":"2024-09-12T00:18:52.244416+0000","last_unstale":"2024-09-12T00:23:26.735509+0000","last_undegraded":"2024-09-12T00:23:26.735509+0000","last_fullsized":"2024-09-12T00:23:26.735509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:26.735014+0000","last_clean_scrub_stamp":"2024-09-12T00:23:26.735014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:59.610604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:36.278119+0000","last_change":"2024-09-12T00:23:36.277960+0000","last_active":"2024-09-12T00:23:36.278119+0000","last_peered":"2024-09-12T00:23:36.278119+0000","last_clean":"2024-09-12T00:23:36.278119+0000","last_became_active":"2024-09-12T00:18:54.262266+0000","last_became_peered":"2024-09-12T00:18:54.262266+0000","last_unstale":"2024-09-12T00:23:36.278119+0000","last_undegraded":"2024-09-12T00:23:36.278119+0000","last_fullsized":"2024-09-12T00:23:36.278119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:36.277772+0000","last_clean_scrub_stamp":"2024-09-12T00:23:36.277772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:33.069312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.686706+0000","last_change":"2024-09-12T00:23:00.686548+0000","last_active":"2024-09-12T00:23:00.686706+0000","last_peered":"2024-09-12T00:23:00.686706+0000","last_clean":"2024-09-12T00:23:00.686706+0000","last_became_active":"2024-09-12T00:18:46.182333+0000","last_became_peered":"2024-09-12T00:18:46.182333+0000","last_unstale":"2024-09-12T00:23:00.686706+0000","last_undegraded":"2024-09-12T00:23:00.686706+0000","last_fullsized":"2024-09-12T00:23:00.686706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:00.686366+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.686366+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:12.119698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.088956+0000","last_change":"2024-09-12T00:22:55.088790+0000","last_active":"2024-09-12T00:22:55.088956+0000","last_peered":"2024-09-12T00:22:55.088956+0000","last_clean":"2024-09-12T00:22:55.088956+0000","last_became_active":"2024-09-12T00:18:44.212249+0000","last_became_peered":"2024-09-12T00:18:44.212249+0000","last_unstale":"2024-09-12T00:22:55.088956+0000","last_undegraded":"2024-09-12T00:22:55.088956+0000","last_fullsized":"2024-09-12T00:22:55.088956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:55.088613+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.088613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:30.497345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:09.719573+0000","last_change":"2024-09-12T00:23:09.719313+0000","last_active":"2024-09-12T00:23:09.719573+0000","last_peered":"2024-09-12T00:23:09.719573+0000","last_clean":"2024-09-12T00:23:09.719573+0000","last_became_active":"2024-09-12T00:18:48.207553+0000","last_became_peered":"2024-09-12T00:18:48.207553+0000","last_unstale":"2024-09-12T00:23:09.719573+0000","last_undegraded":"2024-09-12T00:23:09.719573+0000","last_fullsized":"2024-09-12T00:23:09.719573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:09.719094+0000","last_clean_scrub_stamp":"2024-09-12T00:23:09.719094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.163316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'45","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:22.713801+0000","last_change":"2024-09-12T00:23:22.713647+0000","last_active":"2024-09-12T00:23:22.713801+0000","last_peered":"2024-09-12T00:23:22.713801+0000","last_clean":"2024-09-12T00:23:22.713801+0000","last_became_active":"2024-09-12T00:18:50.224438+0000","last_became_peered":"2024-09-12T00:18:50.224438+0000","last_unstale":"2024-09-12T00:23:22.713801+0000","last_undegraded":"2024-09-12T00:23:22.713801+0000","last_fullsized":"2024-09-12T00:23:22.713801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-12T00:23:22.713460+0000","last_clean_scrub_stamp":"2024-09-12T00:23:22.713460+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:57.574379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:51.867674+0000","last_change":"2024-09-12T00:23:51.867674+0000","last_active":"2024-09-12T00:23:51.867674+0000","last_peered":"2024-09-12T00:23:51.867674+0000","last_clean":"2024-09-12T00:23:51.867674+0000","last_became_active":"2024-09-12T00:18:52.260968+0000","last_became_peered":"2024-09-12T00:18:52.260968+0000","last_unstale":"2024-09-12T00:23:51.867674+0000","last_undegraded":"2024-09-12T00:23:51.867674+0000","last_fullsized":"2024-09-12T00:23:51.867674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:51.867500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:51.867500+0000","last_clean_scrub_stamp":"2024-09-12T00:23:51.867500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.243666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'8","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:59.809418+0000","last_change":"2024-09-12T00:23:59.809418+0000","last_active":"2024-09-12T00:23:59.809418+0000","last_peered":"2024-09-12T00:23:59.809418+0000","last_clean":"2024-09-12T00:23:59.809418+0000","last_became_active":"2024-09-12T00:18:54.282373+0000","last_became_peered":"2024-09-12T00:18:54.282373+0000","last_unstale":"2024-09-12T00:23:59.809418+0000","last_undegraded":"2024-09-12T00:23:59.809418+0000","last_fullsized":"2024-09-12T00:23:59.809418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-12T00:23:59.809231+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-12T00:23:59.809231+0000","last_clean_scrub_stamp":"2024-09-12T00:23:59.809231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:17.034777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:11.976506+0000","last_change":"2024-09-12T00:23:11.976316+0000","last_active":"2024-09-12T00:23:11.976506+0000","last_peered":"2024-09-12T00:23:11.976506+0000","last_clean":"2024-09-12T00:23:11.976506+0000","last_became_active":"2024-09-12T00:18:46.183083+0000","last_became_peered":"2024-09-12T00:18:46.183083+0000","last_unstale":"2024-09-12T00:23:11.976506+0000","last_undegraded":"2024-09-12T00:23:11.976506+0000","last_fullsized":"2024-09-12T00:23:11.976506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:11.976131+0000","last_clean_scrub_stamp":"2024-09-12T00:23:11.976131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:32.650876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:40.782465+0000","last_change":"2024-09-12T00:22:40.782298+0000","last_active":"2024-09-12T00:22:40.782465+0000","last_peered":"2024-09-12T00:22:40.782465+0000","last_clean":"2024-09-12T00:22:40.782465+0000","last_became_active":"2024-09-12T00:18:44.215430+0000","last_became_peered":"2024-09-12T00:18:44.215430+0000","last_unstale":"2024-09-12T00:22:40.782465+0000","last_undegraded":"2024-09-12T00:22:40.782465+0000","last_fullsized":"2024-09-12T00:22:40.782465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:40.782108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:40.782108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.669423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:15.332073+0000","last_change":"2024-09-12T00:23:15.331937+0000","last_active":"2024-09-12T00:23:15.332073+0000","last_peered":"2024-09-12T00:23:15.332073+0000","last_clean":"2024-09-12T00:23:15.332073+0000","last_became_active":"2024-09-12T00:18:48.211511+0000","last_became_peered":"2024-09-12T00:18:48.211511+0000","last_unstale":"2024-09-12T00:23:15.332073+0000","last_undegraded":"2024-09-12T00:23:15.332073+0000","last_fullsized":"2024-09-12T00:23:15.332073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:15.331763+0000","last_clean_scrub_stamp":"2024-09-12T00:23:15.331763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:20.472102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'38","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:43.999901+0000","last_change":"2024-09-12T00:23:43.999764+0000","last_active":"2024-09-12T00:23:43.999901+0000","last_peered":"2024-09-12T00:23:43.999901+0000","last_clean":"2024-09-12T00:23:43.999901+0000","last_became_active":"2024-09-12T00:18:50.225752+0000","last_became_peered":"2024-09-12T00:18:50.225752+0000","last_unstale":"2024-09-12T00:23:43.999901+0000","last_undegraded":"2024-09-12T00:23:43.999901+0000","last_fullsized":"2024-09-12T00:23:43.999901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-12T00:23:43.999565+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-12T00:23:43.999565+0000","last_clean_scrub_stamp":"2024-09-12T00:23:43.999565+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:18.775778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:53.901619+0000","last_change":"2024-09-12T00:23:53.901619+0000","last_active":"2024-09-12T00:23:53.901619+0000","last_peered":"2024-09-12T00:23:53.901619+0000","last_clean":"2024-09-12T00:23:53.901619+0000","last_became_active":"2024-09-12T00:18:52.248416+0000","last_became_peered":"2024-09-12T00:18:52.248416+0000","last_unstale":"2024-09-12T00:23:53.901619+0000","last_undegraded":"2024-09-12T00:23:53.901619+0000","last_fullsized":"2024-09-12T00:23:53.901619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:53.901391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:53.901391+0000","last_clean_scrub_stamp":"2024-09-12T00:23:53.901391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:57.638214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:24:00.801820+0000","last_change":"2024-09-12T00:24:00.801820+0000","last_active":"2024-09-12T00:24:00.801820+0000","last_peered":"2024-09-12T00:24:00.801820+0000","last_clean":"2024-09-12T00:24:00.801820+0000","last_became_active":"2024-09-12T00:18:54.281714+0000","last_became_peered":"2024-09-12T00:18:54.281714+0000","last_unstale":"2024-09-12T00:24:00.801820+0000","last_undegraded":"2024-09-12T00:24:00.801820+0000","last_fullsized":"2024-09-12T00:24:00.801820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:24:00.801642+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:24:00.801642+0000","last_clean_scrub_stamp":"2024-09-12T00:24:00.801642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:51.497957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.718868+0000","last_change":"2024-09-12T00:22:59.718700+0000","last_active":"2024-09-12T00:22:59.718868+0000","last_peered":"2024-09-12T00:22:59.718868+0000","last_clean":"2024-09-12T00:22:59.718868+0000","last_became_active":"2024-09-12T00:18:46.182377+0000","last_became_peered":"2024-09-12T00:18:46.182377+0000","last_unstale":"2024-09-12T00:22:59.718868+0000","last_undegraded":"2024-09-12T00:22:59.718868+0000","last_fullsized":"2024-09-12T00:22:59.718868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.718519+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.718519+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:09.605835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.419905+0000","last_change":"2024-09-12T00:22:44.419775+0000","last_active":"2024-09-12T00:22:44.419905+0000","last_peered":"2024-09-12T00:22:44.419905+0000","last_clean":"2024-09-12T00:22:44.419905+0000","last_became_active":"2024-09-12T00:18:44.197319+0000","last_became_peered":"2024-09-12T00:18:44.197319+0000","last_unstale":"2024-09-12T00:22:44.419905+0000","last_undegraded":"2024-09-12T00:22:44.419905+0000","last_fullsized":"2024-09-12T00:22:44.419905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.419592+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.419592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:33.207405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.321004+0000","last_change":"2024-09-12T00:23:16.320735+0000","last_active":"2024-09-12T00:23:16.321004+0000","last_peered":"2024-09-12T00:23:16.321004+0000","last_clean":"2024-09-12T00:23:16.321004+0000","last_became_active":"2024-09-12T00:18:48.202483+0000","last_became_peered":"2024-09-12T00:18:48.202483+0000","last_unstale":"2024-09-12T00:23:16.321004+0000","last_undegraded":"2024-09-12T00:23:16.321004+0000","last_fullsized":"2024-09-12T00:23:16.321004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-12T00:23:16.320511+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.320511+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:44.404081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'54","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:41.989314+0000","last_change":"2024-09-12T00:23:41.989133+0000","last_active":"2024-09-12T00:23:41.989314+0000","last_peered":"2024-09-12T00:23:41.989314+0000","last_clean":"2024-09-12T00:23:41.989314+0000","last_became_active":"2024-09-12T00:18:50.225541+0000","last_became_peered":"2024-09-12T00:18:50.225541+0000","last_unstale":"2024-09-12T00:23:41.989314+0000","last_undegraded":"2024-09-12T00:23:41.989314+0000","last_fullsized":"2024-09-12T00:23:41.989314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'54","last_scrub_stamp":"2024-09-12T00:23:41.988920+0000","last_deep_scrub":"33'54","last_deep_scrub_stamp":"2024-09-12T00:23:41.988920+0000","last_clean_scrub_stamp":"2024-09-12T00:23:41.988920+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:00.613451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:27.716517+0000","last_change":"2024-09-12T00:23:27.716235+0000","last_active":"2024-09-12T00:23:27.716517+0000","last_peered":"2024-09-12T00:23:27.716517+0000","last_clean":"2024-09-12T00:23:27.716517+0000","last_became_active":"2024-09-12T00:18:52.242811+0000","last_became_peered":"2024-09-12T00:18:52.242811+0000","last_unstale":"2024-09-12T00:23:27.716517+0000","last_undegraded":"2024-09-12T00:23:27.716517+0000","last_fullsized":"2024-09-12T00:23:27.716517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:27.716028+0000","last_clean_scrub_stamp":"2024-09-12T00:23:27.716028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:24.562308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:57.839925+0000","last_change":"2024-09-12T00:23:57.839925+0000","last_active":"2024-09-12T00:23:57.839925+0000","last_peered":"2024-09-12T00:23:57.839925+0000","last_clean":"2024-09-12T00:23:57.839925+0000","last_became_active":"2024-09-12T00:18:54.282419+0000","last_became_peered":"2024-09-12T00:18:54.282419+0000","last_unstale":"2024-09-12T00:23:57.839925+0000","last_undegraded":"2024-09-12T00:23:57.839925+0000","last_fullsized":"2024-09-12T00:23:57.839925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:57.839741+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:57.839741+0000","last_clean_scrub_stamp":"2024-09-12T00:23:57.839741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:23.438050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.364318+0000","last_change":"2024-09-12T00:22:56.364160+0000","last_active":"2024-09-12T00:22:56.364318+0000","last_peered":"2024-09-12T00:22:56.364318+0000","last_clean":"2024-09-12T00:22:56.364318+0000","last_became_active":"2024-09-12T00:18:46.212738+0000","last_became_peered":"2024-09-12T00:18:46.212738+0000","last_unstale":"2024-09-12T00:22:56.364318+0000","last_undegraded":"2024-09-12T00:22:56.364318+0000","last_fullsized":"2024-09-12T00:22:56.364318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:56.363976+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.363976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.256275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.797911+0000","last_change":"2024-09-12T00:22:45.797737+0000","last_active":"2024-09-12T00:22:45.797911+0000","last_peered":"2024-09-12T00:22:45.797911+0000","last_clean":"2024-09-12T00:22:45.797911+0000","last_became_active":"2024-09-12T00:18:44.199004+0000","last_became_peered":"2024-09-12T00:18:44.199004+0000","last_unstale":"2024-09-12T00:22:45.797911+0000","last_undegraded":"2024-09-12T00:22:45.797911+0000","last_fullsized":"2024-09-12T00:22:45.797911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.797484+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.797484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:00.294956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.808574+0000","last_change":"2024-09-12T00:23:07.808574+0000","last_active":"2024-09-12T00:23:07.808574+0000","last_peered":"2024-09-12T00:23:07.808574+0000","last_clean":"2024-09-12T00:23:07.808574+0000","last_became_active":"2024-09-12T00:18:46.198138+0000","last_became_peered":"2024-09-12T00:18:46.198138+0000","last_unstale":"2024-09-12T00:23:07.808574+0000","last_undegraded":"2024-09-12T00:23:07.808574+0000","last_fullsized":"2024-09-12T00:23:07.808574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:07.808393+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.808393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.826760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:44.857883+0000","last_change":"2024-09-12T00:22:44.857717+0000","last_active":"2024-09-12T00:22:44.857883+0000","last_peered":"2024-09-12T00:22:44.857883+0000","last_clean":"2024-09-12T00:22:44.857883+0000","last_became_active":"2024-09-12T00:18:44.195003+0000","last_became_peered":"2024-09-12T00:18:44.195003+0000","last_unstale":"2024-09-12T00:22:44.857883+0000","last_undegraded":"2024-09-12T00:22:44.857883+0000","last_fullsized":"2024-09-12T00:22:44.857883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:44.857528+0000","last_clean_scrub_stamp":"2024-09-12T00:22:44.857528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:34.268174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'22","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:16.885038+0000","last_change":"2024-09-12T00:23:16.885038+0000","last_active":"2024-09-12T00:23:16.885038+0000","last_peered":"2024-09-12T00:23:16.885038+0000","last_clean":"2024-09-12T00:23:16.885038+0000","last_became_active":"2024-09-12T00:18:46.188563+0000","last_became_peered":"2024-09-12T00:18:46.188563+0000","last_unstale":"2024-09-12T00:23:16.885038+0000","last_undegraded":"2024-09-12T00:23:16.885038+0000","last_fullsized":"2024-09-12T00:23:16.885038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-12T00:23:16.884827+0000","last_clean_scrub_stamp":"2024-09-12T00:23:16.884827+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:08.406267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:56.064313+0000","last_change":"2024-09-12T00:22:56.064142+0000","last_active":"2024-09-12T00:22:56.064313+0000","last_peered":"2024-09-12T00:22:56.064313+0000","last_clean":"2024-09-12T00:22:56.064313+0000","last_became_active":"2024-09-12T00:18:44.216022+0000","last_became_peered":"2024-09-12T00:18:44.216022+0000","last_unstale":"2024-09-12T00:22:56.064313+0000","last_undegraded":"2024-09-12T00:22:56.064313+0000","last_fullsized":"2024-09-12T00:22:56.064313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:56.063956+0000","last_clean_scrub_stamp":"2024-09-12T00:22:56.063956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.325584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.875973+0000","last_change":"2024-09-12T00:23:02.875774+0000","last_active":"2024-09-12T00:23:02.875973+0000","last_peered":"2024-09-12T00:23:02.875973+0000","last_clean":"2024-09-12T00:23:02.875973+0000","last_became_active":"2024-09-12T00:18:46.197647+0000","last_became_peered":"2024-09-12T00:18:46.197647+0000","last_unstale":"2024-09-12T00:23:02.875973+0000","last_undegraded":"2024-09-12T00:23:02.875973+0000","last_fullsized":"2024-09-12T00:23:02.875973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:02.875589+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.875589+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.470261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:51.951519+0000","last_change":"2024-09-12T00:22:51.951351+0000","last_active":"2024-09-12T00:22:51.951519+0000","last_peered":"2024-09-12T00:22:51.951519+0000","last_clean":"2024-09-12T00:22:51.951519+0000","last_became_active":"2024-09-12T00:18:44.215165+0000","last_became_peered":"2024-09-12T00:18:44.215165+0000","last_unstale":"2024-09-12T00:22:51.951519+0000","last_undegraded":"2024-09-12T00:22:51.951519+0000","last_fullsized":"2024-09-12T00:22:51.951519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:22:51.951154+0000","last_clean_scrub_stamp":"2024-09-12T00:22:51.951154+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:49.515044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'10","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.882172+0000","last_change":"2024-09-12T00:22:58.882172+0000","last_active":"2024-09-12T00:22:58.882172+0000","last_peered":"2024-09-12T00:22:58.882172+0000","last_clean":"2024-09-12T00:22:58.882172+0000","last_became_active":"2024-09-12T00:18:46.193996+0000","last_became_peered":"2024-09-12T00:18:46.193996+0000","last_unstale":"2024-09-12T00:22:58.882172+0000","last_undegraded":"2024-09-12T00:22:58.882172+0000","last_fullsized":"2024-09-12T00:22:58.882172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:22:58.881909+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.881909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:59.881831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.860676+0000","last_change":"2024-09-12T00:22:47.860535+0000","last_active":"2024-09-12T00:22:47.860676+0000","last_peered":"2024-09-12T00:22:47.860676+0000","last_clean":"2024-09-12T00:22:47.860676+0000","last_became_active":"2024-09-12T00:18:44.195765+0000","last_became_peered":"2024-09-12T00:18:44.195765+0000","last_unstale":"2024-09-12T00:22:47.860676+0000","last_undegraded":"2024-09-12T00:22:47.860676+0000","last_fullsized":"2024-09-12T00:22:47.860676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.860353+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.860353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.356404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.351486+0000","last_change":"2024-09-12T00:22:57.351196+0000","last_active":"2024-09-12T00:22:57.351486+0000","last_peered":"2024-09-12T00:22:57.351486+0000","last_clean":"2024-09-12T00:22:57.351486+0000","last_became_active":"2024-09-12T00:18:46.217176+0000","last_became_peered":"2024-09-12T00:18:46.217176+0000","last_unstale":"2024-09-12T00:22:57.351486+0000","last_undegraded":"2024-09-12T00:22:57.351486+0000","last_fullsized":"2024-09-12T00:22:57.351486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.350978+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.350978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:29.676609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.419200+0000","last_change":"2024-09-12T00:22:45.418904+0000","last_active":"2024-09-12T00:22:45.419200+0000","last_peered":"2024-09-12T00:22:45.419200+0000","last_clean":"2024-09-12T00:22:45.419200+0000","last_became_active":"2024-09-12T00:18:44.212510+0000","last_became_peered":"2024-09-12T00:18:44.212510+0000","last_unstale":"2024-09-12T00:22:45.419200+0000","last_undegraded":"2024-09-12T00:22:45.419200+0000","last_fullsized":"2024-09-12T00:22:45.419200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:45.418677+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.418677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:28.543265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'6","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.889052+0000","last_change":"2024-09-12T00:23:01.889052+0000","last_active":"2024-09-12T00:23:01.889052+0000","last_peered":"2024-09-12T00:23:01.889052+0000","last_clean":"2024-09-12T00:23:01.889052+0000","last_became_active":"2024-09-12T00:18:46.210070+0000","last_became_peered":"2024-09-12T00:18:46.210070+0000","last_unstale":"2024-09-12T00:23:01.889052+0000","last_undegraded":"2024-09-12T00:23:01.889052+0000","last_fullsized":"2024-09-12T00:23:01.889052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:01.888826+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.888826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:23.218572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.761030+0000","last_change":"2024-09-12T00:22:46.760728+0000","last_active":"2024-09-12T00:22:46.761030+0000","last_peered":"2024-09-12T00:22:46.761030+0000","last_clean":"2024-09-12T00:22:46.761030+0000","last_became_active":"2024-09-12T00:18:44.197722+0000","last_became_peered":"2024-09-12T00:18:44.197722+0000","last_unstale":"2024-09-12T00:22:46.761030+0000","last_undegraded":"2024-09-12T00:22:46.761030+0000","last_fullsized":"2024-09-12T00:22:46.761030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.760505+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.760505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:03.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:55.411438+0000","last_change":"2024-09-12T00:22:55.411268+0000","last_active":"2024-09-12T00:22:55.411438+0000","last_peered":"2024-09-12T00:22:55.411438+0000","last_clean":"2024-09-12T00:22:55.411438+0000","last_became_active":"2024-09-12T00:18:46.210443+0000","last_became_peered":"2024-09-12T00:18:46.210443+0000","last_unstale":"2024-09-12T00:22:55.411438+0000","last_undegraded":"2024-09-12T00:22:55.411438+0000","last_fullsized":"2024-09-12T00:22:55.411438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:22:55.411085+0000","last_clean_scrub_stamp":"2024-09-12T00:22:55.411085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.955659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:43.837988+0000","last_change":"2024-09-12T00:22:43.837801+0000","last_active":"2024-09-12T00:22:43.837988+0000","last_peered":"2024-09-12T00:22:43.837988+0000","last_clean":"2024-09-12T00:22:43.837988+0000","last_became_active":"2024-09-12T00:18:44.197304+0000","last_became_peered":"2024-09-12T00:18:44.197304+0000","last_unstale":"2024-09-12T00:22:43.837988+0000","last_undegraded":"2024-09-12T00:22:43.837988+0000","last_fullsized":"2024-09-12T00:22:43.837988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:43.837619+0000","last_clean_scrub_stamp":"2024-09-12T00:22:43.837619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:26.962207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:04.433588+0000","last_change":"2024-09-12T00:23:04.433443+0000","last_active":"2024-09-12T00:23:04.433588+0000","last_peered":"2024-09-12T00:23:04.433588+0000","last_clean":"2024-09-12T00:23:04.433588+0000","last_became_active":"2024-09-12T00:18:46.194850+0000","last_became_peered":"2024-09-12T00:18:46.194850+0000","last_unstale":"2024-09-12T00:23:04.433588+0000","last_undegraded":"2024-09-12T00:23:04.433588+0000","last_fullsized":"2024-09-12T00:23:04.433588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:04.433267+0000","last_clean_scrub_stamp":"2024-09-12T00:23:04.433267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:39.027939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:58.127791+0000","last_change":"2024-09-12T00:22:58.127664+0000","last_active":"2024-09-12T00:22:58.127791+0000","last_peered":"2024-09-12T00:22:58.127791+0000","last_clean":"2024-09-12T00:22:58.127791+0000","last_became_active":"2024-09-12T00:18:44.215724+0000","last_became_peered":"2024-09-12T00:18:44.215724+0000","last_unstale":"2024-09-12T00:22:58.127791+0000","last_undegraded":"2024-09-12T00:22:58.127791+0000","last_fullsized":"2024-09-12T00:22:58.127791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:58.127465+0000","last_clean_scrub_stamp":"2024-09-12T00:22:58.127465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:20.328805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'10","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:18.895060+0000","last_change":"2024-09-12T00:23:18.894878+0000","last_active":"2024-09-12T00:23:18.895060+0000","last_peered":"2024-09-12T00:23:18.895060+0000","last_clean":"2024-09-12T00:23:18.895060+0000","last_became_active":"2024-09-12T00:18:46.197034+0000","last_became_peered":"2024-09-12T00:18:46.197034+0000","last_unstale":"2024-09-12T00:23:18.895060+0000","last_undegraded":"2024-09-12T00:23:18.895060+0000","last_fullsized":"2024-09-12T00:23:18.895060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-12T00:23:18.894667+0000","last_clean_scrub_stamp":"2024-09-12T00:23:18.894667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:12.737541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:45.829130+0000","last_change":"2024-09-12T00:22:45.828950+0000","last_active":"2024-09-12T00:22:45.829130+0000","last_peered":"2024-09-12T00:22:45.829130+0000","last_clean":"2024-09-12T00:22:45.829130+0000","last_became_active":"2024-09-12T00:18:44.215511+0000","last_became_peered":"2024-09-12T00:18:44.215511+0000","last_unstale":"2024-09-12T00:22:45.829130+0000","last_undegraded":"2024-09-12T00:22:45.829130+0000","last_fullsized":"2024-09-12T00:22:45.829130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:45.828769+0000","last_clean_scrub_stamp":"2024-09-12T00:22:45.828769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.446702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.843813+0000","last_change":"2024-09-12T00:22:57.843671+0000","last_active":"2024-09-12T00:22:57.843813+0000","last_peered":"2024-09-12T00:22:57.843813+0000","last_clean":"2024-09-12T00:22:57.843813+0000","last_became_active":"2024-09-12T00:18:46.197196+0000","last_became_peered":"2024-09-12T00:18:46.197196+0000","last_unstale":"2024-09-12T00:22:57.843813+0000","last_undegraded":"2024-09-12T00:22:57.843813+0000","last_fullsized":"2024-09-12T00:22:57.843813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:57.843490+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.843490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:06.187761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:46.388924+0000","last_change":"2024-09-12T00:22:46.388768+0000","last_active":"2024-09-12T00:22:46.388924+0000","last_peered":"2024-09-12T00:22:46.388924+0000","last_clean":"2024-09-12T00:22:46.388924+0000","last_became_active":"2024-09-12T00:18:44.201307+0000","last_became_peered":"2024-09-12T00:18:44.201307+0000","last_unstale":"2024-09-12T00:22:46.388924+0000","last_undegraded":"2024-09-12T00:22:46.388924+0000","last_fullsized":"2024-09-12T00:22:46.388924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:46.388580+0000","last_clean_scrub_stamp":"2024-09-12T00:22:46.388580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:18.873350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.374312+0000","last_change":"2024-09-12T00:23:01.374170+0000","last_active":"2024-09-12T00:23:01.374312+0000","last_peered":"2024-09-12T00:23:01.374312+0000","last_clean":"2024-09-12T00:23:01.374312+0000","last_became_active":"2024-09-12T00:18:46.205672+0000","last_became_peered":"2024-09-12T00:18:46.205672+0000","last_unstale":"2024-09-12T00:23:01.374312+0000","last_undegraded":"2024-09-12T00:23:01.374312+0000","last_fullsized":"2024-09-12T00:23:01.374312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.373987+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.373987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:05.846953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.405470+0000","last_change":"2024-09-12T00:22:47.405301+0000","last_active":"2024-09-12T00:22:47.405470+0000","last_peered":"2024-09-12T00:22:47.405470+0000","last_clean":"2024-09-12T00:22:47.405470+0000","last_became_active":"2024-09-12T00:18:44.193389+0000","last_became_peered":"2024-09-12T00:18:44.193389+0000","last_unstale":"2024-09-12T00:22:47.405470+0000","last_undegraded":"2024-09-12T00:22:47.405470+0000","last_fullsized":"2024-09-12T00:22:47.405470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:47.405108+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.405108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:56.440895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'4","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.408318+0000","last_change":"2024-09-12T00:22:59.408156+0000","last_active":"2024-09-12T00:22:59.408318+0000","last_peered":"2024-09-12T00:22:59.408318+0000","last_clean":"2024-09-12T00:22:59.408318+0000","last_became_active":"2024-09-12T00:19:24.548030+0000","last_became_peered":"2024-09-12T00:19:24.548030+0000","last_unstale":"2024-09-12T00:22:59.408318+0000","last_undegraded":"2024-09-12T00:22:59.408318+0000","last_fullsized":"2024-09-12T00:22:59.408318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:22:59.407970+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.407970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:07.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:57.085566+0000","last_change":"2024-09-12T00:22:57.085427+0000","last_active":"2024-09-12T00:22:57.085566+0000","last_peered":"2024-09-12T00:22:57.085566+0000","last_clean":"2024-09-12T00:22:57.085566+0000","last_became_active":"2024-09-12T00:18:44.182808+0000","last_became_peered":"2024-09-12T00:18:44.182808+0000","last_unstale":"2024-09-12T00:22:57.085566+0000","last_undegraded":"2024-09-12T00:22:57.085566+0000","last_fullsized":"2024-09-12T00:22:57.085566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:57.085239+0000","last_clean_scrub_stamp":"2024-09-12T00:22:57.085239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.771180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:02.421285+0000","last_change":"2024-09-12T00:23:02.421145+0000","last_active":"2024-09-12T00:23:02.421285+0000","last_peered":"2024-09-12T00:23:02.421285+0000","last_clean":"2024-09-12T00:23:02.421285+0000","last_became_active":"2024-09-12T00:18:46.200428+0000","last_became_peered":"2024-09-12T00:18:46.200428+0000","last_unstale":"2024-09-12T00:23:02.421285+0000","last_undegraded":"2024-09-12T00:23:02.421285+0000","last_fullsized":"2024-09-12T00:23:02.421285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-12T00:23:02.420954+0000","last_clean_scrub_stamp":"2024-09-12T00:23:02.420954+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:36.359342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:59.165740+0000","last_change":"2024-09-12T00:22:59.165563+0000","last_active":"2024-09-12T00:22:59.165740+0000","last_peered":"2024-09-12T00:22:59.165740+0000","last_clean":"2024-09-12T00:22:59.165740+0000","last_became_active":"2024-09-12T00:18:44.202881+0000","last_became_peered":"2024-09-12T00:18:44.202881+0000","last_unstale":"2024-09-12T00:22:59.165740+0000","last_undegraded":"2024-09-12T00:22:59.165740+0000","last_fullsized":"2024-09-12T00:22:59.165740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:59.165334+0000","last_clean_scrub_stamp":"2024-09-12T00:22:59.165334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:16.298385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:17.857582+0000","last_change":"2024-09-12T00:23:17.857582+0000","last_active":"2024-09-12T00:23:17.857582+0000","last_peered":"2024-09-12T00:23:17.857582+0000","last_clean":"2024-09-12T00:23:17.857582+0000","last_became_active":"2024-09-12T00:18:46.207220+0000","last_became_peered":"2024-09-12T00:18:46.207220+0000","last_unstale":"2024-09-12T00:23:17.857582+0000","last_undegraded":"2024-09-12T00:23:17.857582+0000","last_fullsized":"2024-09-12T00:23:17.857582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-12T00:23:17.857414+0000","last_clean_scrub_stamp":"2024-09-12T00:23:17.857414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:48.868003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:47.779705+0000","last_change":"2024-09-12T00:22:47.779560+0000","last_active":"2024-09-12T00:22:47.779705+0000","last_peered":"2024-09-12T00:22:47.779705+0000","last_clean":"2024-09-12T00:22:47.779705+0000","last_became_active":"2024-09-12T00:18:44.195521+0000","last_became_peered":"2024-09-12T00:18:44.195521+0000","last_unstale":"2024-09-12T00:22:47.779705+0000","last_undegraded":"2024-09-12T00:22:47.779705+0000","last_fullsized":"2024-09-12T00:22:47.779705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:22:47.779379+0000","last_clean_scrub_stamp":"2024-09-12T00:22:47.779379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.921779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.368579+0000","last_change":"2024-09-12T00:23:00.368297+0000","last_active":"2024-09-12T00:23:00.368579+0000","last_peered":"2024-09-12T00:23:00.368579+0000","last_clean":"2024-09-12T00:23:00.368579+0000","last_became_active":"2024-09-12T00:18:46.208877+0000","last_became_peered":"2024-09-12T00:18:46.208877+0000","last_unstale":"2024-09-12T00:23:00.368579+0000","last_undegraded":"2024-09-12T00:23:00.368579+0000","last_fullsized":"2024-09-12T00:23:00.368579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-12T00:23:00.368084+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.368084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:01.368006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.123443+0000","last_change":"2024-09-12T00:23:00.123271+0000","last_active":"2024-09-12T00:23:00.123443+0000","last_peered":"2024-09-12T00:23:00.123443+0000","last_clean":"2024-09-12T00:23:00.123443+0000","last_became_active":"2024-09-12T00:18:44.216085+0000","last_became_peered":"2024-09-12T00:18:44.216085+0000","last_unstale":"2024-09-12T00:23:00.123443+0000","last_undegraded":"2024-09-12T00:23:00.123443+0000","last_fullsized":"2024-09-12T00:23:00.123443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:23:00.123089+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.123089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:30.766748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:01.162155+0000","last_change":"2024-09-12T00:23:01.161909+0000","last_active":"2024-09-12T00:23:01.162155+0000","last_peered":"2024-09-12T00:23:01.162155+0000","last_clean":"2024-09-12T00:23:01.162155+0000","last_became_active":"2024-09-12T00:18:44.216265+0000","last_became_peered":"2024-09-12T00:18:44.216265+0000","last_unstale":"2024-09-12T00:23:01.162155+0000","last_undegraded":"2024-09-12T00:23:01.162155+0000","last_fullsized":"2024-09-12T00:23:01.162155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-12T00:23:01.161644+0000","last_clean_scrub_stamp":"2024-09-12T00:23:01.161644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:33.787276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:00.851646+0000","last_change":"2024-09-12T00:23:00.851387+0000","last_active":"2024-09-12T00:23:00.851646+0000","last_peered":"2024-09-12T00:23:00.851646+0000","last_clean":"2024-09-12T00:23:00.851646+0000","last_became_active":"2024-09-12T00:18:46.211048+0000","last_became_peered":"2024-09-12T00:18:46.211048+0000","last_unstale":"2024-09-12T00:23:00.851646+0000","last_undegraded":"2024-09-12T00:23:00.851646+0000","last_fullsized":"2024-09-12T00:23:00.851646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:00.851152+0000","last_clean_scrub_stamp":"2024-09-12T00:23:00.851152+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:34.789540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:22:49.888144+0000","last_change":"2024-09-12T00:22:49.887896+0000","last_active":"2024-09-12T00:22:49.888144+0000","last_peered":"2024-09-12T00:22:49.888144+0000","last_clean":"2024-09-12T00:22:49.888144+0000","last_became_active":"2024-09-12T00:18:44.215407+0000","last_became_peered":"2024-09-12T00:18:44.215407+0000","last_unstale":"2024-09-12T00:22:49.888144+0000","last_undegraded":"2024-09-12T00:22:49.888144+0000","last_fullsized":"2024-09-12T00:22:49.888144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:22:49.887620+0000","last_clean_scrub_stamp":"2024-09-12T00:22:49.887620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.894980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T00:23:07.362152+0000","last_change":"2024-09-12T00:23:07.361953+0000","last_active":"2024-09-12T00:23:07.362152+0000","last_peered":"2024-09-12T00:23:07.362152+0000","last_clean":"2024-09-12T00:23:07.362152+0000","last_became_active":"2024-09-12T00:18:46.216977+0000","last_became_peered":"2024-09-12T00:18:46.216977+0000","last_unstale":"2024-09-12T00:23:07.362152+0000","last_undegraded":"2024-09-12T00:23:07.362152+0000","last_fullsized":"2024-09-12T00:23:07.362152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-12T00:23:07.361766+0000","last_clean_scrub_stamp":"2024-09-12T00:23:07.361766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:56.738180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1888,"num_read_kb":1653,"num_write":789,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1786,"ondisk_log_size":1786,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705737,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":150916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40476,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331364,"statfs":{"total":96636764160,"available":96595316736,"internally_reserved":0,"allocated":995328,"data_stored":737144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705738,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":737488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":149912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:24:20.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T00:24:20.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7f71f640 1 Processor -- start 2024-09-12T00:24:20.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7f71f640 1 -- start start 2024-09-12T00:24:20.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7f71f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbd7812f4b0 0x7fbd7812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7f71f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7809bd60 con 0x7fbd7812fdd0 2024-09-12T00:24:20.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7f71f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbd7809aea0 con 0x7fbd7812f4b0 2024-09-12T00:24:20.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7ccba640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbd7812fdd0 0x7fbd78099680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54830/0 (socket says 172.21.15.31:54830) 2024-09-12T00:24:20.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7ccba640 1 -- 172.21.15.31:0/2352002305 learned_addr learned my addr 172.21.15.31:0/2352002305 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-12T00:24:20.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7d4bb640 1 --2- 172.21.15.31:0/2352002305 >> v2:172.21.15.31:3300/0 conn(0x7fbd7812f4b0 0x7fbd7812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd6ffff640 1 -- 172.21.15.31:0/2352002305 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359068319 0 0) 0x7fbd7809bd60 con 0x7fbd7812fdd0 2024-09-12T00:24:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd6ffff640 1 -- 172.21.15.31:0/2352002305 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd64003530 con 0x7fbd7812fdd0 2024-09-12T00:24:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7d4bb640 1 -- 172.21.15.31:0/2352002305 >> v1:172.21.15.31:6789/0 conn(0x7fbd7812fdd0 legacy=0x7fbd78099680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.682+0000 7fbd7d4bb640 1 -- 172.21.15.31:0/2352002305 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd78099d90 con 0x7fbd7812f4b0 2024-09-12T00:24:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 --2- 172.21.15.31:0/2352002305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd7812f890 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009740 tx=0x7fbd7401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df119ee67f6b576e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6ffff640 1 -- 172.21.15.31:0/2352002305 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740b0070 con 0x7fbd7812f4b0 2024-09-12T00:24:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6ffff640 1 -- 172.21.15.31:0/2352002305 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740ab530 con 0x7fbd7812f4b0 2024-09-12T00:24:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6ffff640 1 -- 172.21.15.31:0/2352002305 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740ab830 con 0x7fbd7812f4b0 2024-09-12T00:24:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/2352002305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 msgr2=0x7fbd7812f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/2352002305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd7812f890 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009740 tx=0x7fbd7401c370 comp rx=0 tx=0).stop 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/2352002305 shutdown_connections 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/2352002305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd7812f890 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/2352002305 >> 172.21.15.31:0/2352002305 conn(0x7fbd780a0010 msgr2=0x7fbd780a0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/2352002305 shutdown_connections 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/2352002305 wait complete. 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 Processor -- start 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- start start 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781382d0 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55332/0 (socket says 172.21.15.31:55332) 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 -- 172.21.15.31:0/4068432042 learned_addr learned my addr 172.21.15.31:0/4068432042 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 -- 172.21.15.31:0/4068432042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd78129470 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7d4bb640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbd740ae040 tx=0x7fbd74019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740b8020 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740aa6d0 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd78129930 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740b0040 con 0x7fbd7812f4b0 2024-09-12T00:24:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781c7b20 con 0x7fbd7812f4b0 2024-09-12T00:24:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd740bb020 con 0x7fbd7812f4b0 2024-09-12T00:24:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.686+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7812f890 con 0x7fbd7812f4b0 2024-09-12T00:24:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.690+0000 7fbd6dffb640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 0x7fbd5c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:24:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.690+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6342+0+0 (secure 0 0 0) 0x7fbd740e9800 con 0x7fbd7812f4b0 2024-09-12T00:24:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.690+0000 7fbd7ccba640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 0x7fbd5c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:24:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.690+0000 7fbd7ccba640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 0x7fbd5c03d6c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd68007fd0 tx=0x7fbd68007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:24:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.694+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbd740c2030 con 0x7fbd7812f4b0 2024-09-12T00:24:20.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.862+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbd78068e50 con 0x7fbd7812f4b0 2024-09-12T00:24:20.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fbd74015ff0 con 0x7fbd7812f4b0 2024-09-12T00:24:20.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd6dffb640 1 -- 172.21.15.31:0/4068432042 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbd740b2870 con 0x7fbd7812f4b0 2024-09-12T00:24:20.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 msgr2=0x7fbd5c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 0x7fbd5c03d6c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd68007fd0 tx=0x7fbd68007900 comp rx=0 tx=0).stop 2024-09-12T00:24:20.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 msgr2=0x7fbd781c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:24:20.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbd740ae040 tx=0x7fbd74019110 comp rx=0 tx=0).stop 2024-09-12T00:24:20.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 shutdown_connections 2024-09-12T00:24:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.66:6824/2854630610,v1:172.21.15.66:6825/2854630610] conn(0x7fbd5c03b200 0x7fbd5c03d6c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.866+0000 7fbd7f71f640 1 --2- 172.21.15.31:0/4068432042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd7812f4b0 0x7fbd781c75e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:24:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.870+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 >> 172.21.15.31:0/4068432042 conn(0x7fbd780a0010 msgr2=0x7fbd78133b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:24:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.870+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 shutdown_connections 2024-09-12T00:24:20.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-12T00:24:20.870+0000 7fbd7f71f640 1 -- 172.21.15.31:0/4068432042 wait complete. 2024-09-12T00:24:20.888 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T00:24:20.888 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T00:24:20.888 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T00:24:20.888 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:20.975 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T00:24:20.975 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T00:24:20.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:21.067 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T00:24:21.067 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T00:24:21.067 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:21.160 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T00:24:21.160 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T00:24:21.160 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:21.246 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T00:24:21.247 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T00:24:21.247 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T00:24:21.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:21.277 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T00:24:21.277 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T00:24:21.278 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T00:24:21.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:24:21.299 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T00:24:21.300 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T00:24:21.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-12T00:24:21.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-12T00:24:21.358 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T00:24:21.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:24:21.574 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T00:24:21.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:24:21.822 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T00:24:21.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:24:21.982 DEBUG:teuthology.orchestra.run.smithi066:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T00:24:22.177 INFO:tasks.ceph:Archiving mon data... 2024-09-12T00:24:22.178 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/data/mon.a.tgz 2024-09-12T00:24:22.178 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-12T00:24:22.184 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Gbl8Qcn7FD 2024-09-12T00:24:22.185 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Gbl8Qcn7FD 2024-09-12T00:24:22.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Gbl8Qcn7FD 2024-09-12T00:24:22.381 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Gbl8Qcn7FD is 277KB 2024-09-12T00:24:22.441 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Gbl8Qcn7FD 2024-09-12T00:24:22.446 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T00:24:22.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:24:22.492 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:24:22.547 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:24:22.556 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:24:22.557 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T00:24:22.558 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi031/crash 2024-09-12T00:24:22.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:24:22.604 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi066/crash 2024-09-12T00:24:22.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:24:22.618 INFO:tasks.ceph:Compressing logs... 2024-09-12T00:24:22.618 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:24:22.650 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:24:22.669 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24922.log 2024-09-12T00:24:22.670 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24525.log 2024-09-12T00:24:22.671 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24386.log 2024-09-12T00:24:22.671 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24922.log.gz 2024-09-12T00:24:22.671 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24420.log 2024-09-12T00:24:22.671 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24525.log.gz 2024-09-12T00:24:22.672 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24724.log 2024-09-12T00:24:22.672 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24420.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T00:24:22.672 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24386.log.gz 2024-09-12T00:24:22.672 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24724.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24420.log.gz 2024-09-12T00:24:22.672 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24423.log 2024-09-12T00:24:22.673 INFO:teuthology.orchestra.run.smithi031.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24724.log.gz 2024-09-12T00:24:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24896.log 2024-09-12T00:24:22.673 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25000.log 2024-09-12T00:24:22.674 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24423.log.gz 2024-09-12T00:24:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22677.log 2024-09-12T00:24:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T00:24:22.682 INFO:teuthology.orchestra.run.smithi031.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24896.log.gz 2024-09-12T00:24:22.682 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25000.log: /var/log/ceph/ceph-client.admin.22677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24844.log 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25000.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24631.log/var/log/ceph/ceph-mon.a.log: 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.22677.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25156.log 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24631.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24844.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24422.log 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24631.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23777.log 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25156.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24870.log 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24422.log.gz 2024-09-12T00:24:22.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.23777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25262.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23777.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24948.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24870.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25078.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25262.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24750.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24948.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22747.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24750.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25078.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22785.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24750.log.gz 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.22747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25209.log 2024-09-12T00:24:22.684 INFO:teuthology.orchestra.run.smithi031.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.22747.log.gz 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.22785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24308.log 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.22785.log.gz 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24288.log 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25209.log.gz 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24308.log: gzip 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24308.log.gz -5 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24527.log 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24424.log 2024-09-12T00:24:22.685 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24288.log: /var/log/ceph/ceph-client.admin.24527.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:24:22.696 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24424.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24288.log.gz 2024-09-12T00:24:22.696 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24527.log.gz 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24238.log 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.24424.log.gz 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24632.log 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24238.log: gzip 86.5% -- replaced with /var/log/ceph/ceph-client.admin.24238.log.gz -5 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24263.log 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24974.log 2024-09-12T00:24:22.697 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24632.log: /var/log/ceph/ceph-client.admin.24263.log: gzip 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24263.log.gz 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24776.log 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24632.log.gz 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24818.log 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24974.log: /var/log/ceph/ceph-client.admin.24776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25052.log 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24974.log.gz 2024-09-12T00:24:22.698 INFO:teuthology.orchestra.run.smithi031.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24776.log.gz 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24528.log 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.24818.log.gz 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25182.log 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25052.log.gz 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24528.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:24:22.699 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24528.log.gz 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25026.log 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25182.log.gz 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25104.log 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24516.log 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25026.log: /var/log/ceph/ceph-client.admin.25104.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21430.log 2024-09-12T00:24:22.700 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25026.log.gz 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24516.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25104.log.gz 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24334.log 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24516.log.gz 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.21430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25236.log 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21430.log.gz 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24624.log 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25236.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24334.log.gz 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose 85.6% -- -- replaced with /var/log/ceph/ceph-client.admin.25236.log.gz /var/log/ceph/ceph-client.admin.24620.log 2024-09-12T00:24:22.701 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24620.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24624.log.gz 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25286.log 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24620.log.gz 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24360.log 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.25286.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25286.log.gz 2024-09-12T00:24:22.702 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24360.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24360.log.gz 2024-09-12T00:24:22.707 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68609.log 2024-09-12T00:24:22.709 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:24:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.68609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67429.log 2024-09-12T00:24:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52679.log 2024-09-12T00:24:22.710 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.67429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80969.log 2024-09-12T00:24:22.710 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68609.log.gz/var/log/ceph/ceph-client.0.52679.log: 2024-09-12T00:24:22.726 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57989.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66249.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.80969.log: /var/log/ceph/ceph-client.0.57989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71559.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67429.log.gz 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29572.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52679.log.gz 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.71559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42059.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29596.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29572.log.gz 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.42059.log: -- replaced with /var/log/ceph/ceph-client.0.80969.log.gz 91.3% 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.66249.log.gz 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47959.log 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29596.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57989.log.gz 2024-09-12T00:24:22.727 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65659.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29596.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71559.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.47959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87459.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.65659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25165.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42059.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.87459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58579.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.25165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39699.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.47959.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65659.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.58579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32625.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.25165.log.gz 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.39699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29548.log 2024-09-12T00:24:22.728 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87459.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.32625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31445.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58579.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36159.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57399.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.31445.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29548.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39699.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.36159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70379.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.32625.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.57399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85689.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79211.log/var/log/ceph/ceph-client.0.70379.log: 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.85689.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59169.log 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.36159.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31445.log.gz 2024-09-12T00:24:22.729 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44419.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.79211.log: /var/log/ceph/ceph-client.0.59169.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70379.log.gz 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.57399.log.gz 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42649.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.79211.log.gz 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.44419.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85689.log.gz 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73329.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.59169.log.gz 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.42649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77459.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43239.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.73329.log: /var/log/ceph/ceph-client.0.77459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35569.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.43239.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65069.log 2024-09-12T00:24:22.730 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.44419.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.77459.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42649.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.35569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55039.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33799.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.65069.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73329.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43239.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34979.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.35569.log.gz 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.33799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41469.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54449.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.34979.log: /var/log/ceph/ceph-client.0.41469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76279.log 2024-09-12T00:24:22.731 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55039.log.gz 2024-09-12T00:24:22.737 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.54449.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.33799.log.gz 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41469.log.gz 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54449.log.gz 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.65069.log.gz 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34979.log.gz 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25117.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.76279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40289.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.25117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88049.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25117.log.gz/var/log/ceph/ceph-client.0.40289.log: 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63299.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.88049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63889.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.63299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59759.log 2024-09-12T00:24:22.738 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76279.log.gz/var/log/ceph/ceph-client.0.63889.log: 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40289.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50319.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86869.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88049.log.gz/var/log/ceph/ceph-client.0.59759.log: /var/log/ceph/ceph-client.0.50319.log: 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48549.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3%/var/log/ceph/ceph-client.0.86869.log: -- replaced with /var/log/ceph/ceph-client.0.63889.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.63299.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.48549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81559.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.50319.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46779.log 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-osd.3.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86869.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.81559.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.59759.log.gz 2024-09-12T00:24:22.739 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48549.log.gz 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81559.log.gz 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69789.log 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25093.log 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.69789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75099.log 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.25093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40879.log 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25093.log.gz 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.75099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34389.log 2024-09-12T00:24:22.740 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.46779.log.gz 2024-09-12T00:24:22.744 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66839.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.40879.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69789.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.34389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46189.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82739.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.66839.log: 91.4%/var/log/ceph/ceph-client.0.46189.log: -- replaced with /var/log/ceph/ceph-client.0.75099.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40879.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34389.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83919.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.66839.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.82739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52089.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46189.log.gz 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.83919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78043.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.52089.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T00:24:22.745 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.78043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29500.log 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.0.82739.log.gz 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83919.log.gz 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% 91.7% -- replaced with /var/log/ceph/ceph-client.0.52089.log.gz 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.78043.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.82149.log 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50909.log 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.82149.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29500.log.gz 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45599.log 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.50909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25141.log 2024-09-12T00:24:22.746 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.45599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73919.log 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.25141.log: 85.6% 91.4% -- replaced with /var/log/ceph/ceph-client.0.82149.log.gz 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50909.log.gz 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25141.log.gz 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62119.log 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45599.log.gz 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.73919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56219.log 2024-09-12T00:24:22.748 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.62119.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T00:24:22.749 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.56219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55629.log 2024-09-12T00:24:22.749 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-mgr.x.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73919.log.gz 2024-09-12T00:24:22.749 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.56219.log.gz 2024-09-12T00:24:22.753 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.62119.log.gz 2024-09-12T00:24:22.753 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75689.log 2024-09-12T00:24:22.755 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.55629.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55629.log.gz 2024-09-12T00:24:22.756 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37929.log 2024-09-12T00:24:22.757 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.75689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30855.log 2024-09-12T00:24:22.758 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.37929.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75689.log.gz 2024-09-12T00:24:22.758 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84509.log 2024-09-12T00:24:22.759 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.37929.log.gzgzip 2024-09-12T00:24:22.759 INFO:teuthology.orchestra.run.smithi066.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.56809.log 2024-09-12T00:24:22.760 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.30855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72739.log 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.84509.log: /var/log/ceph/ceph-client.0.56809.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30855.log.gz 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84509.log.gz 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56809.log.gz 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39109.log 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.72739.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T00:24:22.762 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.39109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53859.log 2024-09-12T00:24:22.764 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72739.log.gz 2024-09-12T00:24:22.764 INFO:teuthology.orchestra.run.smithi066.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T00:24:22.764 INFO:teuthology.orchestra.run.smithi066.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.39109.log.gz -5 2024-09-12T00:24:22.764 INFO:teuthology.orchestra.run.smithi066.stderr: --verbose -- /var/log/ceph/ceph-client.0.47369.log 2024-09-12T00:24:22.765 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.53859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69199.log 2024-09-12T00:24:22.765 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.47369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60939.log 2024-09-12T00:24:22.766 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.69199.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53859.log.gz 2024-09-12T00:24:22.767 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.47369.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.88645.log 2024-09-12T00:24:22.767 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:22.767 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.60939.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62709.log 2024-09-12T00:24:22.767 INFO:teuthology.orchestra.run.smithi066.stderr: -- replaced with /var/log/ceph/ceph-client.0.69199.log.gz 2024-09-12T00:24:22.768 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.88645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49729.log 2024-09-12T00:24:22.768 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.62709.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60939.log.gz 2024-09-12T00:24:22.769 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79795.log 2024-09-12T00:24:22.771 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.49729.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.62709.log.gz 2024-09-12T00:24:22.771 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88645.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.49729.log.gz 2024-09-12T00:24:22.771 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:22.771 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68019.log 2024-09-12T00:24:22.772 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.79795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37339.log 2024-09-12T00:24:22.772 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.68019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80379.log 2024-09-12T00:24:22.772 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.79795.log.gz 2024-09-12T00:24:22.773 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.37339.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.68019.log.gz 2024-09-12T00:24:22.773 INFO:teuthology.orchestra.run.smithi066.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37339.log.gz 2024-09-12T00:24:22.774 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49139.log 2024-09-12T00:24:22.774 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.80379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78627.log 2024-09-12T00:24:22.775 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.49139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30265.log 2024-09-12T00:24:22.775 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.78627.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78627.log.gz 2024-09-12T00:24:22.775 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80379.log.gz 2024-09-12T00:24:22.776 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86279.log 2024-09-12T00:24:22.776 INFO:teuthology.orchestra.run.smithi066.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T00:24:22.777 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49139.log.gz 2024-09-12T00:24:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.30265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33215.log 2024-09-12T00:24:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53269.log 2024-09-12T00:24:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.86279.log: /var/log/ceph/ceph-client.0.33215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72149.log 2024-09-12T00:24:22.778 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.53269.log: 92.2% -- replaced with /var/log/ceph/ceph-client.0.30265.log.gz 90.6% -- replaced with /var/log/ceph/ceph-client.0.33215.log.gz 2024-09-12T00:24:22.778 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:22.778 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86279.log.gz 2024-09-12T00:24:22.778 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74509.log 2024-09-12T00:24:22.780 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.72149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64479.log 2024-09-12T00:24:22.780 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.74509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43829.log 2024-09-12T00:24:22.780 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.53269.log.gz 2024-09-12T00:24:22.781 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.64479.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.72149.log.gz 2024-09-12T00:24:22.781 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64479.log.gz 2024-09-12T00:24:22.781 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60349.log 2024-09-12T00:24:22.782 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.43829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70969.log 2024-09-12T00:24:22.782 INFO:teuthology.orchestra.run.smithi066.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.74509.log.gz 2024-09-12T00:24:22.782 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.60349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32035.log 2024-09-12T00:24:22.783 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.70969.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43829.log.gz 2024-09-12T00:24:22.783 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83329.log 2024-09-12T00:24:22.783 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60349.log.gz 2024-09-12T00:24:22.784 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.32035.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70969.log.gz 2024-09-12T00:24:22.784 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76869.log 2024-09-12T00:24:22.784 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.83329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45009.log 2024-09-12T00:24:22.785 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.76869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51499.log 2024-09-12T00:24:22.785 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7%/var/log/ceph/ceph-client.0.45009.log: -- replaced with /var/log/ceph/ceph-client.0.32035.log.gz 2024-09-12T00:24:22.786 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38519.log 2024-09-12T00:24:22.787 INFO:teuthology.orchestra.run.smithi066.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83329.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.76869.log.gz 2024-09-12T00:24:22.787 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:22.787 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.51499.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45009.log.gz 2024-09-12T00:24:22.788 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85099.log 2024-09-12T00:24:22.788 INFO:teuthology.orchestra.run.smithi066.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51499.log.gz 2024-09-12T00:24:22.788 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.38519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61529.log 2024-09-12T00:24:22.789 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.85099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36749.log 2024-09-12T00:24:22.789 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.61529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29524.log 2024-09-12T00:24:22.790 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.0.36749.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38519.log.gz 2024-09-12T00:24:22.790 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.85099.log.gz 2024-09-12T00:24:22.790 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/ceph-client.admin.29524.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29524.log.gz 2024-09-12T00:24:22.791 INFO:teuthology.orchestra.run.smithi066.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.36749.log.gz 2024-09-12T00:24:22.791 INFO:teuthology.orchestra.run.smithi066.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61529.log.gz 2024-09-12T00:24:22.809 INFO:teuthology.orchestra.run.smithi066.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T00:24:22.883 INFO:teuthology.orchestra.run.smithi031.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T00:24:23.631 INFO:teuthology.orchestra.run.smithi066.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T00:24:23.686 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T00:24:23.688 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-12T00:24:23.688 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m1.038s 2024-09-12T00:24:23.688 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m1.219s 2024-09-12T00:24:23.688 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.091s 2024-09-12T00:24:23.755 INFO:teuthology.orchestra.run.smithi066.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T00:24:23.839 INFO:teuthology.orchestra.run.smithi066.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T00:24:23.841 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T00:24:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m1.172s 2024-09-12T00:24:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m3.239s 2024-09-12T00:24:23.841 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.219s 2024-09-12T00:24:23.841 INFO:tasks.ceph:Archiving logs... 2024-09-12T00:24:23.841 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi031/log 2024-09-12T00:24:23.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:24:24.098 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi066/log 2024-09-12T00:24:24.099 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:24:24.631 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:24:24.654 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:24:24.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:24:24.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:24:24.743 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:24:24.753 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:24:24.753 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:24:24.756 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout:+hv01.front.sepi 67.205.162.81 3 u 37 64 377 0.078 -3.712 1.325 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout:*hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.075 +1.179 1.530 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.077 +0.012 0.871 2024-09-12T00:24:24.767 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout:*hv01.front.sepi 67.205.162.81 3 u 40 64 377 0.109 +0.277 0.410 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi 63.231.80.2 3 u 35 64 377 0.067 +2.096 0.952 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.083 +1.973 0.672 2024-09-12T00:24:24.770 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:24:24.771 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:24:24.784 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:24:24.785 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:24:24.811 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:24:24.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:24:24.889 INFO:teuthology.task.internal:Duration was 968.900701 seconds 2024-09-12T00:24:24.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:24:24.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:24:24.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:24:24.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:24:24.975 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:24:24.975 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-09-12T00:24:24.976 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:24:25.024 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T00:24:25.024 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:24:25.034 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:24:25.034 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:24:25.068 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:24:25.102 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:24:25.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:24:25.136 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:24:25.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:24:25.210 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:24:25.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:24:25.221 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:24:25.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:24:25.244 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:24:25.264 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:24:25.273 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-09-12T00:24:25.286 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-12T00:24:25.306 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:24:25.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:24:25.347 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:24:25.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:24:25.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:24:25.369 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:24:25.371 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi031 2024-09-12T00:24:25.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:24:25.413 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901841/remote/smithi066 2024-09-12T00:24:25.413 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:24:25.436 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:24:25.436 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:25.452 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:25.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:24:25.518 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:24:25.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:24:25.546 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:24:25.547 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:24:25.550 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:24:25.554 INFO:teuthology.orchestra.run.smithi031.stdout: 658468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:24 /home/ubuntu/cephtest 2024-09-12T00:24:25.557 INFO:teuthology.orchestra.run.smithi066.stdout: 658670 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:24 /home/ubuntu/cephtest 2024-09-12T00:24:25.558 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:24:25.579 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:24:25.658 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} duration: 968.9007005691528 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T00:24:25.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:24:25.754 INFO:teuthology.run:pass